-
Notifications
You must be signed in to change notification settings - Fork 142
Open
Labels
bugSomething isn't workingSomething isn't working
Description
I am not sure if this is universal behavior or the default setting is generated automatically for different devices.
Currently, on M4 pro with 24GB memory, the default Model is Qwen3-14B, and default context length is 48000. However, Qwen3 only supports 32,768 context length, and with context length set to 48000 it will always fail to generate any output.
I reduced it to 32000 and it can generate output correctly.
Metadata
Metadata
Assignees
Labels
bugSomething isn't workingSomething isn't working