Skip to content

BUG: Default setting won't work #72

@gzqx

Description

@gzqx

I am not sure if this is universal behavior or the default setting is generated automatically for different devices.

Currently, on M4 pro with 24GB memory, the default Model is Qwen3-14B, and default context length is 48000. However, Qwen3 only supports 32,768 context length, and with context length set to 48000 it will always fail to generate any output.

I reduced it to 32000 and it can generate output correctly.

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't working

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions