Some question about GQA #7
Description
Thank you for your contribution to KV cache compression. I would like to ask
- Does the llama-3 model, e.g., llama-3-8b, support this?
- Does CHAI still work well with the GQA model?
{{ message }}
Thank you for your contribution to KV cache compression. I would like to ask