Skip to content

Add LiveKit voice package with authenticated playground tooling#15

Open
punitarani wants to merge 7 commits intomainfrom
feat/add-voice-package-with-livekit
Open

Add LiveKit voice package with authenticated playground tooling#15
punitarani wants to merge 7 commits intomainfrom
feat/add-voice-package-with-livekit

Conversation

@punitarani
Copy link
Copy Markdown
Owner

Summary

  • add a new @amby/voice package for running a LiveKit voice worker backed by the existing agent runtime
  • wire voice support into shared channel, agent, and env interfaces, including voice conversation creation and streamed message metadata
  • add authenticated local tooling to create a real user and mint short-lived LiveKit Playground tokens with embedded agent dispatch
  • update root scripts, env examples, and lockfile for the new voice workflow and dependencies

Testing

  • bun run format
  • bun run lint:fix
  • bun run typecheck
  • bun run build

@chatgpt-codex-connector
Copy link
Copy Markdown

You have reached your Codex usage limits for code reviews. You can see your limits in the Codex usage dashboard.
To continue using code reviews, you can upgrade your account or add credits to your account and enable them for code reviews in your settings.

…e-with-livekit

# Conflicts:
#	packages/agent/src/agent.ts
…or voice agent setup. Enhance user schema with role and ban fields in the database. Refactor user creation logic in voice package to use new API method. Improve script for generating development environment variables.
…M interactions. Update AmbyVoiceAgent to utilize NoopLLM, ensuring compatibility with LiveKit's requirements. Enhance error handling in voice session management.
…ng, adding contextual and generic filler phrases, and refining metadata parsing with validation. Update AmbyVoiceAgent to emit fillers based on tool activity and user input, ensuring a smoother interaction experience.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant