🎤 Voice-Controlled Robotic Hand (P-arm_voiceControl)

A Python-based application that uses OpenAI Whisper for voice recognition to control a robotic hand via a serial connection.

🚀 Features

• Voice Recognition: Uses Whisper base model for offline-capable, high-accuracy transcription.
• Serial Communication: Send 5-bit binary commands (e.g., 01101) to an Arduino or similar microcontroller.
• Dynamic Mapping: Assign specific recognized phrases to custom binary commands.
• Continuous Listening: Toggle "Start Listening" for hands-free control.
• Real-time Logs: Monitor recognition and serial output through a built-in log.

🛠️ Requirements

• 🐍 Python 3.8+
• 🎙️ Microphone
• 🤖 Serial Device (Arduino, ESP32, etc.)

Python Dependencies

pip install numpy sounddevice scipy openai-whisper pyserial PyQt5

Note: openai-whisper depends on ffmpeg. Ensure it is installed on your system.

📖 How to Use

1. Select Serial Port: Choose the COM port/Device path of your robotic hand.
2. Connect: Click the 🔌 Connect button.
3. Assign Commands:
   • Click 🎙️ Record Voice (3 seconds).
   • Once recognized, enter a 5-bit binary command (e.g., 10001) in the input box.
   • Click ✅ Assign.
4. Control:
   • Speak the assigned phrase while the app is "Listening" or use the manual record button.
   • The corresponding binary command will be sent over Serial.

🏗️ Project Structure

• main.py: Core application logic and threads.
• fancy_ui.py: PyQt5 GUI layout and styling.

📜 License

MIT