Where is the ConvaiOVRLipSync option?

Unreal Engine Questions
1

Original Discord Post by .waqas | 2024-09-21 05:10:49

I don’t have ConvaiOVRLipSync as an option? I’m using the Methumans Tutorial 5.1 project.

I’m trying to follow this : https://www.youtube.com/watch?v=1QT40NGO8gQ&t=183s

Embedded Content:
Transform Ready Player Me Characters using AI in Unreal Engine | Co…
Welcome to the final part of the Convai UE Tutorial series. In this video, we dive into adding all the AI functionalities we’ve learned in the previous parts to a Ready Player Me Avatar in Unreal Engine.

Extra plugins here: Convai Shared Plugins - Google Drive

Full Playlist here: https://www.youtube.com…
Link: https://www.youtube.com/watch?v=1QT40NGO8gQ&start=183

Thumbnail
Thumbnail640×480 73.5 KB

2

Reply by k3kalinix | 2024-09-21 12:55:40

Hello <@223891889747787776>,

3

Reply by k3kalinix | 2024-09-21 12:59:15

OVRLipSync Deprecated.

Please add FaceSync

Images:

image.png
image.png341×267 15.5 KB

4

Reply by .waqas | 2024-09-22 06:32:53

I did use Face Sync. The character does respond but there is no lip synch or other animations playing… you just hear the AI audio responding

5

Reply by k3kalinix | 2024-09-22 21:37:57

<@&1163218672580575372>

6

Replying to k3kalinix’s Message

Reply by k3kalinix | 2024-09-22 21:37:57
<@&1163218672580575372>

Reply by .waqas | 2024-09-23 18:09:45

I’d really like to try to have this figured today if possible

7

Reply by mighty_brute | 2024-09-24 11:16:57

Hello <@223891889747787776> ,

Please ensure that the Convai animation blueprints are correctly assigned. Additionally, idle animation is playing?

8

Reply by .waqas | 2024-09-25 00:25:37

Yes, I believe so. He just stands arms by his side barely moving. Under the RPM charater BP I set up the Anim BP here

Images:

image.png
image.png852×440 35.5 KB

9

Reply by .waqas | 2024-09-25 00:25:50

for the Skeletal Mesh

10

Reply by .waqas | 2024-09-25 00:26:22

where else is the Anim BP supposed to go?

11

Reply by mighty_brute | 2024-09-25 05:23:15

<@223891889747787776> , could you please share a short clip of the issue you’re facing?

12

Reply by .waqas | 2024-09-25 05:52:01

<@1216254232957685765> I noticed the UE Demo Project UE 5.2 has both RPM & Metahuman characters working… and it used ConvaiOVRLipSync the ConvaiMetahumansTutorial UE5.1 has Convai Face Sync could that have something to do with it ? or is this Metahu,mansTuorial UE5.1 outdated and the reason FaceSync wont work?

13

Reply by .waqas | 2024-09-25 06:55:29

<@1216254232957685765> The mouth does not move at all. SO basically the lip synch animation is not working

14

Reply by ephemeralm | 2024-09-26 03:23:01

Hello, I have the same issue. I added the Face Sync component. I don’t receive any audio and the mouth doesn’t work. I already set the proper BP Animation for Body and Face inside the Metahuman. Any ideas?

15

Replying to ephemeralm’s Message

Reply by ephemeralm | 2024-09-26 03:23:01
Hello, I have the same issue. I added the Face Sync component. I don’t receive any audio and the mouth doesn’t work. I already set the proper BP Animation for Body and Face inside the Metahuman. Any ideas?

Reply by .waqas | 2024-09-26 06:09:14

Make sure you are adding the Character ID from the Convai site to the Details panel of the character that’s placed in your scene and not the Character BP

16

Replying to .waqas’s Message

Reply by .waqas | 2024-09-26 06:09:14
Make sure you are adding the Character ID from the Convai site to the Details panel of the character that’s placed in your scene and not the Character BP

Reply by ephemeralm | 2024-09-26 19:34:51

I did so, I am able to converse with the AI when playing the level. However it doesn’t move the mouth nor have any audio.

17

Replying to ephemeralm’s Message

Reply by ephemeralm | 2024-09-26 19:34:51
I did so, I am able to converse with the AI when playing the level. However it doesn’t move the mouth nor have any audio.

Reply by .waqas | 2024-09-26 22:33:23

Oh I haven’t tried setting up a custom MetaHuman yet. I got my Reallusion character working though. I assume its the same process. I know for me after I plugged in the Transition Animation in the Anim BP I didn’t see the Apply button on the bottom right. It’s not showing now but it was here

Images:

image.png
image.png1419×565 71.3 KB

18

Reply by .waqas | 2024-09-26 22:34:33

<@1216254232957685765> I’m still having trouble with the Ready Player LipSynch animations not playing at all. The AI part of being able to talk and get responses is working

19

This conversation happened on the Convai Discord Server, so this post will be closed.