This repository was archived by the owner on Jun 24, 2024. It is now read-only.
This repository was archived by the owner on Jun 24, 2024. It is now read-only.
Replying to messages to continue generation #11
{{ message }}
You should be able to reply to generated text to insert new text into a generation. This should have an optional prefix for chat mode.
It should keep a few sessions in memory in a LRU cache. Sessions not in memory are replayed with a progress indicator.