This repository was archived by the owner on May 11, 2025. It is now read-only.
This repository was archived by the owner on May 11, 2025. It is now read-only.
Qwen3 support #753
Description
model = AutoAWQForCausalLM.from_pretrained(model_path, low_cpu_mem_usage=True, use_cache=False, device_map={"": "cpu"},offload_folder="offload_folder",max_memory=memory_config)
File "/data/jcxy/haolu/anaconda3/envs/haolu/lib/python3.10/site-packages/awq/models/auto.py", line 70, in from_pretrained
model_type = check_and_get_model_type(
File "/data/jcxy/haolu/anaconda3/envs/haolu/lib/python3.10/site-packages/awq/models/auto.py", line 48, in check_and_get_model_type
raise TypeError(f"{config.model_type} isn't supported yet.")
TypeError: qwen3 isn't supported yet.