<h2>Overview:</h2>
<p>Farfalle is an open-source AI-powered search engine that offers the capability of running local models or using cloud models for search functionalities. It supports various search providers and allows users to ask questions to both cloud models and local models, enhancing the search experience.</p>
<h2>Features:</h2>
<ul>
<li><strong>Multiple Search Providers:</strong> Utilize search capabilities from different providers like Tavily, Searxng, Serper, and Bing.</li>
<li><strong>Answer Questions with Models:</strong> Ability to answer questions with cloud models like OpenAI/gpt4-o, OpenAI/gpt3.5-turbo, Groq/Llama3, or local models like llama3, mistral, gemma, phi3.</li>
<li><strong>Custom LLM Support:</strong> Users can leverage custom Language Model Models (LLMs) through LiteLLM for tailored search experiences.</li>
<li><strong>Agent-assisted Search:</strong> Conduct searches with an agent that plans and executes the search for better and accurate results.</li>
</ul>
<h3>Getting Started Locally:</h3>
<ol>
<li>
<p><strong>Prerequisites:</strong></p>
<ul>
<li>Docker</li>
<li>Ollama (if using local models)</li>
<li>Download and start any supported local models: llama3, mistral, gemma, phi3</li>
<li>Start the ollama server: <code>ollama serve</code></li>
<li>Get API keys for optional providers like Tavily, Serper, OpenAI, Bing, Groq</li>
</ul>
</li>
<li>
<p><strong>Quick Start:</strong></p>
<ul>
<li>Modify the <code>.env</code> file with API keys (optional for Ollama)</li>
</ul>
</li>
</ol>


Rashadphz

Farfalle