<h2>Overview</h2>
<p>The Local AI Stack is a tool that allows users to run a simple AI app locally, without the need for a credit card. It is based on the AI Starter Kit and enables document Q&#x26;A functionality. The stack includes various components such as Inference, VectorDB, LLM Orchestration, App logic, and Embeddings generation.</p>
<h2>Features</h2>
<ul>
<li><strong>Local AI App</strong>: Run AI applications locally without relying on cloud-based services.</li>
<li><strong>Document Q&#x26;A</strong>: Perform document question and answer tasks using the app.</li>
<li><strong>AI Starter Kit</strong>: Built on top of the AI Starter Kit, ensuring reliable and efficient AI functionality.</li>
<li><strong>Inference Stack</strong>: Utilizes the Ollama Inference stack for AI processing.</li>
<li><strong>VectorDB</strong>: Powering the app with Supabase's pgvector for vector storage.</li>
<li><strong>LLM Orchestration</strong>: Utilizing Langchain.js for LLM (Language Model) Orchestration.</li>
<li><strong>App Logic</strong>: Built with Next.js for efficient and scalable logic handling.</li>
<li><strong>Embeddings Generation</strong>: Transformer.js and all-MiniLM-L6-v2 are used to generate and store embeddings.</li>
</ul>


Ykhli

Local Ai Stack