If you would like to contribute to the repo, please feel free to comment on what task you would like to work on, and feel free to go ahead to create a PR for it, or convert it to an Issue.
Refactoring / Cleanup:
README / Documentation:
Verbosity
Tinygemm:
APIs:
Tests:
Packaging:
If you would like to contribute to the repo, please feel free to comment on what task you would like to work on, and feel free to go ahead to create a PR for it, or convert it to an Issue.
Refactoring / Cleanup:
eval.py,generate.py,diff.py,analyze.pygroup_qvsgroup_q1degroup_qvsdegroup_q1eval.pyvseval_perplexity.pypseudo_**_quantizerinllm-awqREADME / Documentation:
Verbosity
convertinany4.pyfunction that prints every layer name. Perhaps by printing to a tqdm bar?eval.pythat prints different groups of results ("Perplexity (GPTQ Implementation) Eval Results","Perplexity Eval Results","Code Eval Results","NLP Eval Results"Tinygemm:
APIs:
sample_weightargumentanyqdefault to what we have in the paper? [skip lm_head,scale_sample weight,sample_weight]Tests:
int4,int8,any4,nf4,fp4Packaging:
tinygemma pip-installable libraryany4a pip-installable library