Lip Sync and Audio not snychronising

Unreal Engine Bugs
1

Hi Team,

Testing out the Metahuman in Unreal 5.6 with Convai, works well, however noticed that the Lip Sync and Audio are not snychronising.

Also the audio cuts out midway through.

Character ID: 60e087de-76af-11ef-80ce-42010a7be011 for further investigation.

Thanks!

Jeasy

2

Also, the character is not looking at the camera but slight lowered, how can I fix his eye line to look at the camera?

3

Good Morning @K3

Testing the new plugin update in UE 5.6, Managed to get it working, trying to speak to the digital human and a few issues I am seeing as below:

  • He stops talking in the middle of the sentence
  • The lip sync seems to be off from the audio
  • The eyes don’t look straight at the camera but slightly below
  • The Idel animation transitions for the face and Body seem to be too fast giving the impression of restlessness and being twitchy, How can this be smoothed and slowed down a bit?
  • When the user speaks to the Digital Human, the response latency is rather high with almost 7+seconds waiting time. This is intermittent.

Will continue testing and report back.

Thanks,

Jeasy

4

Is there an update or solution to this issue @K3 ?

5

There are existing posts on this topic, please check them before creating a new one.

You can enable the Look Exactly At Camera checkbox in the Convai_MetaHuman_FaceAnim.

We couldn’t reproduce the other issues, and there haven’t been any recent changes related to them. It might be related to your internet connection. Could you test the response time directly on convai.com and let us know how it behaves there?