Local AI Stack
A starter kit to build *local-only* AI apps that cost $0 to run -- starting with document Q&A. Written in Javascript
Overview
The Local AI Stack is a tool that allows users to run a simple AI app locally, without the need for a credit card. It is based on the AI Starter Kit and enables document Q&A functionality. The stack includes various components such as Inference, VectorDB, LLM Orchestration, App logic, and Embeddings generation.
Features
- Local AI App: Run AI applications locally without relying on cloud-based services.
- Document Q&A: Perform document question and answer tasks using the app.
- AI Starter Kit: Built on top of the AI Starter Kit, ensuring reliable and efficient AI functionality.
- Inference Stack: Utilizes the Ollama Inference stack for AI processing.
- VectorDB: Powering the app with Supabase's pgvector for vector storage.
- LLM Orchestration: Utilizing Langchain.js for LLM (Language Model) Orchestration.
- App Logic: Built with Next.js for efficient and scalable logic handling.
- Embeddings Generation: Transformer.js and all-MiniLM-L6-v2 are used to generate and store embeddings.
Summary
The Local AI Stack enables users to run a simple AI app locally, without the need to rely on cloud-based services. With features such as document Q&A, the stack leverages components like Inference, VectorDB, LLM Orchestration, and App logic. By following the installation guide, users can set up and deploy the app as per their requirements.
- Next.js
Next.js is a React-based web framework that enables server-side rendering, static site generation, and other powerful features for building modern web applications.
- React
React is a widely used JavaScript library for building user interfaces and single-page applications. It follows a component-based architecture and uses a virtual DOM to efficiently update and render UI components
- Tailwind
Tailwind CSS is a utility-first CSS framework that provides pre-defined classes for building responsive and customizable user interfaces.
- Headless UI
Headless UI is a set of completely unstyled, fully accessible UI components for React, Vue, and Alpine.js that empower developers to build their own fully accessible custom UI components. Headless UI allows developers to focus on building accessible and highly functional user interfaces, without the need to worry about styling or layout.
- Eslint
ESLint is a linter for JavaScript that analyzes code to detect and report on potential problems and errors, as well as enforce consistent code style and best practices, helping developers to write cleaner, more maintainable code.
- Postcss
PostCSS is a popular open-source tool that enables web developers to transform CSS styles with JavaScript plugins. It allows for efficient processing of CSS styles, from applying vendor prefixes to improving browser compatibility, ultimately resulting in cleaner, faster, and more maintainable code.
- Typescript
TypeScript is a superset of JavaScript, providing optional static typing, classes, interfaces, and other features that help developers write more maintainable and scalable code. TypeScript's static typing system can catch errors at compile-time, making it easier to build and maintain large applications.