Skip to content

Feature/voice companion#12

Open
JulieJi07 wants to merge 6 commits intomainfrom
feature/voice-companion
Open

Feature/voice companion#12
JulieJi07 wants to merge 6 commits intomainfrom
feature/voice-companion

Conversation

@JulieJi07
Copy link
Copy Markdown
Collaborator

Summary

  • 实现语音+文字双输入的持续陪伴模式
  • 接入 MiniMax Speech-02-HD TTS 语音回复
  • 替换 STT 为 SiliconFlow SenseVoice(更快)
  • 优化杂音过滤(VAD 阈值 + 最短时长 + 结果过滤)
  • 经过 10+ 轮迭代的陪伴式 prompt
  • 添加 .gitignore,清除历史中的 API 密钥

1in0 and others added 6 commits April 8, 2026 02:37
Design the home screen with a header bar, date display, hero title,
subtitle, decorative orb image, and CTA button. Layout uses flexible
spacers for proportional distribution across all screen sizes.

Add custom typography (Akkurat, Romana) and a themed color palette
with light/dark mode support.

Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
Wire up the start button to present a full-screen conversation
interface. Users can type thoughts and receive a streaming-style
response. Includes outlined button variant and divider in Theme.

Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
- WebRTC 实时语音通道(火山引擎 STT + 豆包大模型 LLM)
- 持续录音模式:2秒静默自动触发回应,12秒兜底
- 新增文字输入框,跳过 STT 直接走 LLM,秒回
- 优化 AI prompt:站在用户一边陪伴,不否定不放大焦虑
- iOS 端:连接状态指示、键盘适配、语音/打字并行

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
- 接入 MiniMax Speech-02-HD,音色 Warm_Bestie
- AI 回复同时发送文字和语音(MP3 via WebSocket)
- iOS 端 AVAudioPlayer 播放 TTS 语音
- 重写 system prompt:示范对话驱动,有温度不敷衍
- 文字输入框 + 键盘适配

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
- 替换火山引擎 STT 为 SiliconFlow SenseVoiceSmall(更快的 HTTP API)
- VAD 阈值提高到 120,只响应近距离人声
- 过滤 RMS < 20 的静音帧,减少噪音送识别
- 最短音频时长从 500ms 提到 1200ms,避免短杂音触发
- STT 结果过滤:去标点后不足 2 字的识别结果跳过

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
- 创建 .gitignore 排除 .env、node_modules、.DS_Store、xcuserdata
- 从 git 历史中清除所有 API 密钥
- 更新 .env.example 包含所有需要的环境变量说明

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants