Skip to content

adds initial support for orpheus#90

Merged
mmwillet merged 6 commits intomainfrom
add-orpheus-support
Jun 19, 2025
Merged

adds initial support for orpheus#90
mmwillet merged 6 commits intomainfrom
add-orpheus-support

Conversation

@mmwillet
Copy link
Copy Markdown
Owner

@mmwillet mmwillet commented Jun 18, 2025

Addresses: #9

Additionally, this adds:

  • An abstraction of the general neural audio codec pattern (used by both DAC and SNAC)
  • Support for BPE tokenization.
  • Fixes a small bug in the #split function
  • DRYs up behavior around preparing the output buffer.

The model will be available for testing here

Currently there are some compatibility issues between different GGUF encoders, so preparing the GGUF file locally may require some code changes.

The model has been tested with short, medium and long prompts. It sometimes (though very rarely) has an issue with stopping so using --vad is recommended. Additionally --voice should be set to leah and --temperature to 0.7.

Copy link
Copy Markdown
Owner Author

@mmwillet mmwillet left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Mostly looks fine, but still need to fix python incompatibilities.

@mmwillet mmwillet marked this pull request as ready for review June 18, 2025 21:38
Copy link
Copy Markdown
Owner Author

@mmwillet mmwillet left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@mmwillet mmwillet merged commit eea7fdc into main Jun 19, 2025
2 checks passed
@mmwillet mmwillet deleted the add-orpheus-support branch June 19, 2025 17:58
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant