Train llm (bloom, llama, baichuan2-7b, chatglm3-6b) with deepspeed pipeline mode. Faster than zero/zero++/fsdp.
-
Updated
Feb 5, 2024 - Python
Train llm (bloom, llama, baichuan2-7b, chatglm3-6b) with deepspeed pipeline mode. Faster than zero/zero++/fsdp.
Fine-tuning toolkit for Maya1, a 3B-parameter open-source TTS model by Maya Research. Supports full fine-tuning with SNAC neural codec, natural language voice design, and inline emotion tags. Features YAML-based config, offline preprocessing, and automatic audio sample generation at every checkpoint.
Add a description, image, and links to the full-finetune topic page so that developers can more easily learn about it.
To associate your repository with the full-finetune topic, visit your repo's landing page and select "manage topics."