Hi, I am facing 2 issues with Lipsyncing in Unity with Realusion CC4 character.
The lipsync works fine 4/5 times so it means the settings are correct. It occurs with multiple different character, different voices (GCP, Azure, Elevenlabs, Open AI).
Issue 1: The character keeps mouth closed while audio plays.
Issue 2: The character kepps mouth open even after audio finishes.
Issue 2 is a big issue since if no users start a conversation for a while the character just stands there with it’s mouth wide open which looks really bad.
Is there a way to programatically close the mouth, we can add this code after we get the event that the character stops talking. At least this way it won’t look too unprofessional.
If the issues can be resolved, that would be great.
Character ID : e1251142-7f48-11f0-9366-42010a7be01f (but happening with all our characters)
Character description : only 80 words
Character Voice : All voices
Character AI LLM : gpt-4.1-nano
Character knowledge bank : no files at all
Country : India
Platform : Unity
Thanks for the details. In ConvaiNPC.cs, please try increasing BUFFER_TIMEOUT to 3 or 4 (and adjust higher if needed) to see which value stabilizes the behavior.
Hi, I know with my Reallusion characters after I have imported them from CC4 into Unity the Jaw Bone field assignment in the Rig setup has to be given the value of “None” otherwise the jaw hangs open. Once “None” is assigned (just delete whatever is in the Jaw Bone Root field in rig setup I think it is) the character operates normally afterwards, talking etc works. Please do a backup if you’re going to try this.
@K3 please help urgently. why is this only happening with ElevenLabs voice? we need this voice because of low latency. OpenAI voice lipsync works well but has too much latency (8-12 sec).
Hi, yesterday I updated the API and set the constant to 4. It seemed to be working, but today sometimes the mouth moves and sometimes it doesn’t. Additionally, with the new API update, I’m noticing quite long response times.