Skip to content

Conversation

amakropoulos
Copy link
Collaborator

No description provided.

Copy link

@Draco18s Draco18s left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Downloaded this to see if it solves any of the problems I've been having.

Some issues:

  • Sample chat bot scene has a missing script on the LLMCharacter object and the ChatBot monobehavior has no reference for its LLMAgent, so that will throw an NRE
  • LLMAgent.Warmup calls ChatAsync before the Lama llmAgent.llmAgent field is set (by SetupLLMClient), throwing a NRE, even if not using a Lama based model.
  • Using a coroutine to wait for the field to be non-null before calling Warmup just straight up crashes the Unity editor.
  • Ended up just waiting for the field to be non-null and calling WarmupCallback directly instead.
  • Whether or not the response is streamed has gone missing. Seems to always be in stream mode, chatbot demo doesn't populate the chat bubble, just constantly replaces with the next token.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants