This repository was archived by the owner on Aug 5, 2025. It is now read-only.
This repository was archived by the owner on Aug 5, 2025. It is now read-only.
Support for Autoregressive generation with LLMs #1136
Description
Hi, I was able to run llama for a single forward, but when I tried to make it generate texts in an autoregressive way, there were errors with input shapes. Looks like a fixed sized input is set when exporting the model (correct me if I'm wrong). I would like to know if LLM text generation is currently supported. Thanks.