| title | emoji | colorFrom | colorTo | sdk | sdk_version | app_file | pinned | license | short_description |
|---|---|---|---|---|---|---|---|---|---|
AI Doctor App |
🏥 |
blue |
red |
gradio |
5.17.1 |
app.py |
false |
mit |
AI-powered medical assistant with vision and voice capabilities |
A multimodal AI-powered medical assistant that processes images, text, and voice to generate intelligent diagnostic responses. Built using state-of-the-art GenAI models and APIs, the app enables users to interact via uploaded images and natural speech, receiving both text and spoken feedback.
- 🧠 Uses Meta llama-4-scout-17b-16e-instruct for image + text-based reasoning
- 🎤 Speech-to-text input with OpenAI Whisper
- 🔊 Realistic voice responses using ElevenLabs TTS
- 🌐 Clean Gradio interface for real-time interaction
- 🧩 Supports Hugging Face Spaces deployment
- Python
- Gradio (UI & interface)
- Meta LLaMA 4 Scout 17b via GROQ API
- OpenAI Whisper (STT)
- ElevenLabs API (TTS)
- Hugging Face Spaces (deployment)
- Python ≥ 3.8
- pip
- API keys for:
- OpenAI
- ElevenLabs
- GROQ (for LLaMA model access)
-
Clone the repository
git clone https://github.com/yourusername/ai-doctor-app.git cd ai-doctor-app -
Create and activate a virtual environment
python -m venv venv source venv/bin/activate # On Windows: .\venv\Scripts\activate
-
Install dependencies
pip install -r requirements.txt
-
Set your API keys Create a .env file in the root directory with the following:
OPENAI_API_KEY=your_openai_key ELEVENLABS_API_KEY=your_elevenlabs_key GROQ_API_KEY=your_groq_key
-
Run the app
python app.py
- Open the app in your browser.
- Input your symptoms and Image in the provided field.
- Click on the "Submit" button to receive potential diagnoses and health advice.
For Hugging Face Spaces deployment, you need to set the following environment variables in your Space settings:
OPENAI_API_KEY: Your OpenAI API key for Whisper STTELEVENLABS_API_KEY: Your ElevenLabs API key for TTSGROQ_API_KEY: Your GROQ API key for LLaMA model access
This application is for educational and learning purposes only. It should not be used as a substitute for professional medical advice, diagnosis, or treatment. Always consult with qualified healthcare professionals for medical concerns.