Skip to content

Adding Qwen3-Omni inference#38

Merged
sarapapi merged 4 commits intomainfrom
feature/Qwen3-Omni
Mar 19, 2026
Merged

Adding Qwen3-Omni inference#38
sarapapi merged 4 commits intomainfrom
feature/Qwen3-Omni

Conversation

@dannigt
Copy link
Copy Markdown
Collaborator

@dannigt dannigt commented Mar 17, 2026

Adds Qwen3-Omni-30B-A3B-Instruct as a MLLM baseline under the name qwen3_omni.

Changes

  • New model file baselines/models/mllm/qwen3_omni.py
  • Registered in baselines/main.py

Example usage

python main.py \
  --model qwen3_omni \
  --lang en \
  --track long \
  --modality audio \
  --prompt fixed \
  --in_data_folder $PATH2DATA \
  --out_folder ./baseline

Notes

  • Requires flash_attention_2 and sufficient VRAM for a 30B MoE model

@sarapapi sarapapi requested a review from mgaido91 March 17, 2026 17:34
dannigt and others added 2 commits March 18, 2026 15:46
Co-authored-by: sarapapi <57095209+sarapapi@users.noreply.github.com>
Co-authored-by: sarapapi <57095209+sarapapi@users.noreply.github.com>
@sarapapi sarapapi merged commit 78c405d into main Mar 19, 2026
1 check passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants