<h2>Overview:</h2>
<p>Shush is an application that showcases the deployment of a WhisperV3 model with Flash Attention v2 on Modal and interacts with it through a NextJS app. The main purpose of this app is to offer a comprehensive demonstration for individuals interested in utilizing high-performance models and reliable APIs on demand with auto-scaling capabilities. It is a demo application constructed with Next.js for the frontend and Modal for the backend.</p>
<h2>Features:</h2>
<ul>
<li><strong>WhisperV3 Model Deployment:</strong> Demonstrates the deployment of a WhisperV3 model with Flash Attention v2 on Modal.</li>
<li><strong>NextJS Integration:</strong> Utilizes a NextJS app for interacting with the deployed model.</li>
<li><strong>Auto-Scaling Capabilities:</strong> Showcases the ability to run high-performance models and APIs on demand with auto-scaling.</li>
</ul>
<h3>Set Up:</h3>
<ol>
<li>Visit modal.com and create a free account.</li>
<li>Install the Modal python package and authenticate in your CLI by following the instructions on the website.</li>
</ol>
<h3>Deploy Backend:</h3>
<p>We will be using Modal to deploy and serve the WhisperV3 model.
Execute the following commands in your terminal:</p>
<pre><code># Commands to deploy the WhisperV3 model using Modal
</code></pre>


Arihanv

Shush