Skip to content

oQ4e for Nemotron-3-Super-120B-A12B and Qwen3.5-122B-A10B #476

@copilotprosub1

Description

@copilotprosub1

Hey guys, would love for someone to make oQ4e quants of Nemotron-3-Super-120B-A12B-JANG_2L and Qwen3.5-122B-A10B , oQ is actually the best mlx has right now. did some testing for JANG for medicine.
not good.
"model_id": "Mistral-Small-4-119B-A6B-JANG_2L",
"benchmark": "mmlu",
"subject": "professional_medicine",
"batch_size": 4,
"isolated_requests": true,
"accuracy": 0.21323529411764705,
"correct": 58,
"total": 272,
"time_s": 1127.957444190979,

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions