New version of the code and lora support #6
Description
Thanks for the amazing paper. I wanted to know if there's any plan on adding LoRA support. I want to train on 8 * 40GB A100 GPUs. What configuration values would you suggest?
{{ message }}
Thanks for the amazing paper. I wanted to know if there's any plan on adding LoRA support. I want to train on 8 * 40GB A100 GPUs. What configuration values would you suggest?