Add Missing You x Seedance 2.0 and Take Me Stars MV pipelines#26
Open
virtari wants to merge 2 commits intocalesthio:mainfrom
Open
Add Missing You x Seedance 2.0 and Take Me Stars MV pipelines#26virtari wants to merge 2 commits intocalesthio:mainfrom
virtari wants to merge 2 commits intocalesthio:mainfrom
Conversation
Adds a complete end-to-end music video production system for the track "Missing You" by Chef-8080, built on top of OpenMontage tooling. Production scripts: - produce_missing_you.py: initial pipeline attempt (v1) - produce_missing_you_v2.py: portrait 9:16 social teasers with Pexels footage + Whisper word-level karaoke subtitle sync - produce_final_mixed.py: final mixed pipeline combining FAL AI-generated woman character shots (Kling v1.6) with Pexels city rain atmosphere, interleaved 2:1 city/woman edit pattern, ASS karaoke subtitles - generate_fal_shots.py: FAL Kling v1.6 generation of 5 consistent woman character shots for portrait teasers - mv_generate_scenes.py: full music video scene generator with 30 FAL clips across 10 scene pairs, consistent Sofia/Marcus characters across 2000 and 2025 eras, 16:9 YouTube format - mv_assemble.py: 60-shot timeline assembler for full 3-minute YouTube 16:9 720p video with era-specific color grades, Whisper-timed ASS karaoke subtitles, and professional cut rhythm Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
- missing_you_seedance_mv/: Full Seedance 2.0 pipeline for "Still Missing You" - mv_generate_chars.py: FLUX Pro character reference generation (Sofia/Marcus 2000+2025) - mv_generate_scenes.py: 36 scenes with director-level prompts, @Image/@Audio references, numbered filenames (001-036), film grade, beat-sync audio segments - mv_assemble.py: FFmpeg concat + audio mix → chef8080_missing_you_FULLMV_720p.mp4 - take_me_stars_mv/: Kling v3 i2v pipeline for "Take Me Where The Stars Go" - mv_generate_frames.py: FLUX Pro still frame generation with Tapa C film grade - mv_generate_scenes.py: 31 scenes, Kling v3 standard i2v with elements (character ref) - mv_assemble.py: 54-segment timeline, vintage color grades per location, subtitle burn - lyrics.ass: Full ASS subtitle file - mv_template/: Reusable Seedance 2.0 scene generator template - Root mv_assemble.py + mv_generate_scenes.py: Minor updates from production learnings Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
Owner
|
Integrating Seedance 2.0 is a great idea. It is currently one of the strongest video generation models, so having a real OpenMontage path for it would be valuable. That said, this PR does not feel mergeable in its current form because it is adding project-specific production scripts rather than integrating Seedance into the platform architecture. Main issues:
I think the underlying direction is good, but I would recommend re-scoping this before merge. A stronger version of this contribution would be one of:
So: strong idea, but this needs to be productized and aligned with the repo architecture before it makes sense to review deeply for merge. |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
chef8080_missing_you_FULLMV_720p.mp4New files
missing_you_seedance_mv/mv_generate_chars.pymissing_you_seedance_mv/mv_generate_scenes.pymissing_you_seedance_mv/mv_assemble.pyTest plan
python mv_generate_chars.pygenerates 4 character reference imagespython mv_generate_scenes.py --anchor-onlygenerates anchor clips (001–003)python mv_generate_scenes.pygenerates remaining 33 production scenespython mv_assemble.pyoutputschef8080_missing_you_FULLMV_720p.mp4🤖 Generated with Claude Code