AI-Powered E-Learning Platform with Sign Language Support
AIDE_Learning is an AI-based E-learning platform designed to provide secure access to educational content and support inclusive learning through text, voice, and sign language interaction. The platform integrates Natural Language Processing (NLP), Machine Learning, and Sign Tracking Technology to enhance accessibility for users, including people with hearing or speech impairments.
-
Provide a secure user registration and login system for personalized learning.
-
Develop a versatile AI chatbot that understands and responds via:
- Text
- Voice
- Sign Language
-
Implement data preprocessing and machine learning algorithms for accurate query classification and responses.
-
Enable real-time sign language recognition using trained CNN models.
-
Improve accessibility and engagement through multi-format learning content.
-
Secure user registration using:
- Username
- Password
- Phone number
-
Ensures authorized access only.
-
Personalized user experience after login.
-
Users can browse educational videos on various subjects.
-
Videos are converted into:
- 📄 Text format
- 🔊 Audio format
-
Users can choose their preferred learning mode.
-
Chatbot interacts with users and answers queries based on trained data.
-
Supports:
- Text input
- Voice input
- Sign language input
-
Enhances accessibility for users with different needs.
- Uses AI-powered Sign Tracking Technology.
- Tracks hand signs in real-time live streams.
- Converts signs into meaningful queries and provides answers instantly.
- Designed especially for people with hearing and speech impairments.
- Handling missing values
- Encoding categorical data
- Text cleaning and NLP techniques (tokenization, stop-word removal, etc.)
-
Machine learning models trained on pre-processed datasets.
-
Classification algorithm used:
- Random Forest Classifier
-
CNN-based model used for sign recognition:
cnn_housing.h5
The dataset and trained models (
cnn_housing.h5) are not included in this repository due to size and privacy constraints.
The system performance is evaluated using Accuracy:
[ Accuracy = \frac{TP + TN}{TP + TN + FP + FN} ]
Where:
- TP – True Positive
- TN – True Negative
- FP – False Positive
- FN – False Negative
Accuracy measures how correctly the classifier predicts class labels for new data.
- Python
- Machine Learning (Random Forest)
- Deep Learning (CNN)
- NLP (Natural Language Processing)
- Sign Language Recognition
- Speech-to-Text & Text-to-Speech
- Flask / Django (if applicable)
- OpenCV (for sign tracking)
- TensorFlow / Keras
- Include multilingual support.
- Improve sign recognition accuracy.
- Add more learning resources.
- Deploy on cloud for scalability.
- Mobile application support.
- Students
- Educators
- Hearing or speech-impaired learners
- Inclusive education platforms
Dataset and model training files are not uploaded to the repository. Please contact the author for access or use your own datasets for training.
If you want, I can also:
- Shorten this for college submission
- Add screenshots section
- Create a project abstract
- Write a final year project report format
Just tell me 👍