📋 Sheet
Revamp architecture for video chatbot
👤 Siddhant⚠ no ETA🏃 16-30 May'26Pending
What we've maxed out in current build:
* Voice quality – OpenAI Realtime (best in class)
* Reliability – retries, timeouts, backpressure all solid
* KB search gap – filled with natural filler speech
* Language – English + Hindi auto-detect working
Two hard ceilings we've hit (platform limits, not bugs):
* Lip-sync lag: 200–400ms — this is HeyGen's architectural ceiling, can't be fixed without switching approach
* Voice accent: sounds American — OpenAI Realtime doesn't offer Indian accent natively
Bottom line: Current build is a solid . We've squeezed everything possible out of this architecture.
To go the best version need rework work:
* Switch to text-based avatar speech for more better lip-sync
* Plug in ElevenLabs/PlayHT Indian voice clone
* Evaluate replacing HeyGen with Tavus or D-ID — they have native Indian avatars + built-in TTS, tighter sync, one system instead of three
since we have other priorities too LMK
Additional requirements:
1. Can we use an Indian avatar or p
🎯 Goal & proof
📋 SDLC actionables
SDLC checklist
In Sprint (2)
Kickoff call (optional) with owner
Confirm sprint label is set on the row