🍳 CookWithMe

📊 FACTs:

1. 81% of Consumers Cook More Than Half of Meals at Home in North America (source)
2. 56% of people surveyed in a recent poll say they struggle with even the most basic recipes (source)
3. CBC reports that only 35% of Canadians learned at least one new recipe between 2019-2022 (source)
4. 63% of 2000 Americans state they need help in the kitchen (source)
5. 74.5% of international students & immigrants surveyed were experiencing food insecurity (source)

👩‍🍳 About Us:

We are 4 international students/immigrants who:

1. Cook most meals ourselves, struggling to find the right taste and face health concerns.
2. Struggle to make even the most basic recipes.
3. Just 1 of us learned a new recipe in the past 6 months.
4. Obviously need help in the kitchen!
5. Face food insecurity (a challenge for every immigrant!).

CookWithMe was designed to make cooking accessible, engaging, and gamified. We allow users to follow recipes hands-free using voice commands via tedAI (we named it!). This lets users follow the steps without having to touch or scroll through the screen.

Features:

• Hands-free cooking experience.
• No intimidation of complicated recipes.
• "No water, No problem!" – No ingredient? No need to rush to get it!
• Support throughout the cooking journey.
• Users can listen to instructions through headphones or a speaker, boosting confidence in the kitchen.
• An engaging, interactive cooking experience (It’s like talking to your mom on how to boil an egg!).

Tech Stack:

• React
• Python
• Flask
• OpenAI
• Axios
• REST
• Amazon EC2
• Amazon S3
• GPT-4o-mini
• Web Speech API

Challenges Faced:

• Streaming for multiple users.
• Using React for the first time and writing 3k+ lines of code.
• Linking EC2 with the S3 instance.
• Formatting a smart query to generate personalized results.
• Integrating DALL-E for generating images.

What's Next:

• Isolating user instances.
• Increase functionality available on our UI.
• (Final Goal) Transition into a portable and powerful mobile application that hosts the llm and processing locally on the user's own device.

Learn More:

• nwHacks 2025 Devpost Submission (link)
• YouTube Demo (link)
• Filmora Wondershare Video Submission (link)

Acknowledgements:

• Thank you to nwPlus for hosting this amazing hackathon!
• Thank you to the mentors, panellists, and sponsors for making this weekend possible!