Lipsync gets off sync and stops before the end of the audio

Integrations Unity SDK
, ,
1

What do you need help with?

Question

Installation method

UPM

Issue area

Lip Sync / Facial Animation

Impact

Blocker - I cannot continue

Unity version

6000.3.19f1

Convai Unity SDK version

4.5.0

Character ID

c15f9644-9f35-11f1-80c8-42010a7be02f

Target platform

Meta Quest

Where does it happen?

Both sample and custom scene

Short summary

Lipsync gets off sync and stops before the end of the audio

What happened?

Hello,

I’ve been having an issue with the lipsync on my convai character which is using a GCP german voice.
I am using unity version 6000.3.19f1, i did try to change the language just to see what happends but the problem is still the same, althought the dialogues are in german, but i wanted to test if using only english will solve the issue but it didnt.

The issue is that sometimes the lipsync seems to get offset from the audio, it seems to run untill half and then at the end of the message the lips stop moving before the audio ends.

This is really a blocker for me, where I want the avatar to speak german with complete normal lipsync otherwise character is of no use, if the speech is still going but lips has stopped moving.

What did you expect?

That it will work perfectly with German language

I checked the relevant documentation, resources, and similar forum posts before posting.

on

I confirm that I did not include API keys, tokens, passwords, secrets, private character data, private conversation logs, or customer data.

on

2

Could you please share a video recording and the relevant logs so we can review the issue properly?

3

what logs? where i can see them relevent, and more onto the problem i am using tags in the Narrative Design would that be a problem for TTS pipline for lipsync?

4

Please go to Project Settings → Convai SDK and set Global Log Level to Debug.

Test, then copy all the logs, paste them into a .txt file, and share the file with us.