Skip to content

AI-powered video-to-playlist generator built with Next.js, TwelveLabs, and Gemini API to match footage with curated soundtracks.

Notifications You must be signed in to change notification settings

anthonytoyco/weaver

Repository files navigation

Weaver

Weaver is a web app that generates personalized soundtracks based on the emotional tone and visual content of videos. By analyzing uploaded footage, Weaver curates playlists that reflect the mood, genre, and atmosphere of the visuals — helping users enhance their stories through sound.


Overview

Weaver bridges the gap between visual storytelling and emotional sound design. Whether it's a sunset beach video or a lively birthday montage, Weaver crafts the perfect audio companion by analyzing uploaded videos and generating playlists that fit the vibe. Built with Next.js and powered by APIs like TwelveLabs, Google Gemini, and Spotify, the app provides a seamless way to soundtrack your memories.


Core Features

Video Upload and Analysis
Upload a video and let Weaver detect the emotional and visual tone of the footage.

AI-Generated Playlists
Weaver uses Google Gemini to generate a personalized playlist based on the analyzed video.

Seamless Integration with Spotify
Playlists are created using the Spotify API, allowing for direct playback and sharing.

Targeted for Creators and Everyday Users
Whether you're a filmmaker, influencer, or someone who wants to relive their moments, Weaver creates the right music for every scene.


Technology Stack


Challenges We Faced

  • Migrating from a Node.js-only environment to a full-stack Next.js framework.
  • Integrating the TwelveLabs API, which was new to the team and required learning and experimentation.
  • Coordinating between frontend, backend, and multiple APIs under tight time constraints.

What We Learned

  • Collaborating effectively as a team using complementary skillsets.
  • Integrating multiple third-party APIs and managing asynchronous data.
  • Understanding full-stack application structure using modern frameworks.
  • Improving project management under tight timelines.

Future Improvements

  • 📱 Social media integration for selecting songs based on visual posts
  • 🎬 Integration into video editing software to assist content creators
  • 🖼️ Image input support
  • 🔁 Playlist history tracking
  • 🤝 Playlist sharing functionality
  • 🎨 UI/UX polish and quality-of-life enhancements

Screenshots

Home Upload Loading Generated


Try It Out


About

AI-powered video-to-playlist generator built with Next.js, TwelveLabs, and Gemini API to match footage with curated soundtracks.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Contributors 3

  •  
  •  
  •