Lipsync gets off sync and stops before the end of the audio

Unreal Engine Questions
,
1

Hello,

I’ve been having an issue with the lipsync on my convai character which is using a custom Elevenlabs voice.

I’m using unreal 5.4 and the 3.6.6 version of the convai plugin, with the following extraparams “ExtraParams=MinBufferDuration=4,EnableSync=1,AudioLipSyncRatio=1”

The issue is that sometimes the lipsync seems to get offset from the audio, it seems to speed up and then at the end of the message the lips stop moving before the audio ends.

When I added those extraparams it seemed to have helped at first but then it just happened again after a few sessions.

2

Hello @eduardo.caramujo,

Welcome to the Convai Developer Forum!

Please try removing all extra parameters first and check if the issue still occurs with just the audio. If it does, remove the FaceSync Component and see if the problem continues. Then re-add FaceSync and test again with these parameters:

MinBufferDuration=7, AudioLipSyncRatio=0.5, EnableSync=1

Could you also share a short video showing the issue, along with your Character ID, the affected Session IDs and Logs? This will help us investigate further.