Aido
3D multilingual chatbot with interactive gestures, contextual conversations, persistent chat history, and personalized medical and mental health support.
Overview
Aido has recently garnered attention after being awarded the 'Most Innovative Approach' at NivHack 2023, held at Niveus Solutions Pvt. Ltd. in Mangalore. This project features a robust microservice utilizing the VertexAi API, designed with Flask and effectively deployed on Google Cloud Run. Although accessibility to the deployments may be intermittent as they were primarily available during the hackathon, the underlying technology holds significant promise for future applications.
With remarkable features that cater to personalized interactions, Aido is paving the way for innovative solutions in the realm of virtual assistance and mental health support. Developers and users alike will appreciate the integration of cutting-edge technology and a user-centric approach.
Features
- Virtually Interactive 3D Character: Engages users with realistic speech capabilities and expressive hand gestures, creating a dynamic conversational experience.
- Multilingual Chat Sessions: Offers communication in various languages, making the tool accessible to a diverse user base.
- Follow-up Questions: Smartly continues conversations based on previous interactions, enhancing user engagement and satisfaction.
- Persistent Chat Sessions: Maintains chat history to provide context and continuity, improving the relevance of responses.
- Personalized Medical and Mental Health Support: Tailors responses to user inquiries in sensitive areas, promoting a supportive interaction.
- Multilingual Voice Chat Support: Allows users to interact through voice, accommodating those who prefer auditory communication.
- Integrations with Leading Technologies: Utilizes Google PaLM2 and services like Deepgram for speech-to-text and ElevenLabs for text-to-speech, ensuring high-level performance.
- Future Scalability: Envisions integration with MedPaLM for enhanced accuracy and potential applications in areas like children's training and lifestyle coaching.
- Next.js
Next.js is a React-based web framework that enables server-side rendering, static site generation, and other powerful features for building modern web applications.
- React
React is a widely used JavaScript library for building user interfaces and single-page applications. It follows a component-based architecture and uses a virtual DOM to efficiently update and render UI components
- TanStack
TanStack is a collection of high-quality, framework-agnostic libraries including TanStack Query for data fetching, TanStack Router for routing, TanStack Table for tables, and more. These tools provide powerful, type-safe solutions for common web development challenges.
- Tailwind
Tailwind CSS is a utility-first CSS framework that provides pre-defined classes for building responsive and customizable user interfaces.
- Shadcn UI
Beautifully designed components that you can copy and paste into your apps. Accessible. Customizable. Open Source.
- Prisma
Prisma is a server-side library that helps developers read and write data to the database in an intuitive, efficient and safe way.
- Fullstack
A fullstack boilerplate provides a starter application that includes both frontend and backend. It should include database, auth, payments, user roles and other backend services to build a fully featured saas or webapps.
- Eslint
ESLint is a linter for JavaScript that analyzes code to detect and report on potential problems and errors, as well as enforce consistent code style and best practices, helping developers to write cleaner, more maintainable code.
- Postcss
PostCSS is a popular open-source tool that enables web developers to transform CSS styles with JavaScript plugins. It allows for efficient processing of CSS styles, from applying vendor prefixes to improving browser compatibility, ultimately resulting in cleaner, faster, and more maintainable code.
- Typescript
TypeScript is a superset of JavaScript, providing optional static typing, classes, interfaces, and other features that help developers write more maintainable and scalable code. TypeScript's static typing system can catch errors at compile-time, making it easier to build and maintain large applications.
- Zod
Zod is a TypeScript-first schema declaration and validation library. It allows you to define schemas that can validate data at runtime while providing excellent TypeScript inference, making it perfect for API validation, form validation, and type-safe data handling.