Convai LipSync 5.4?

Original Discord Post by salvo_nostrato | 2024-05-11 11:35:40

Hi there how can we use Convai LipSync Plugin in unreal 5.4?

Reply by k3kalinix | 2024-05-11 13:32:29

Hello <@722442955608031296>

Reply by k3kalinix | 2024-05-11 13:32:30

https://www.unrealengine.com/marketplace/en-US/product/convai

Reply by k3kalinix | 2024-05-11 13:33:06

You can download our SDK compatible with Unreal Engine 5.4 from our market page.

Reply by salvo_nostrato | 2024-05-12 07:20:18

So we don’t need the lipSync plugin which we had to download from the google drive ?

Reply by salvo_nostrato | 2024-05-12 07:21:20

Also I have migrated the project to 5.4 but the metahuman body just got stretched … how can be fixed

Reply by salvo_nostrato | 2024-05-12 07:22:00

Also the expressions are very weird in 5.4

Reply by salvo_nostrato | 2024-05-12 07:58:25

Images:

Reply by k3kalinix | 2024-05-12 08:16:14

Hey <@722442955608031296>

Reply by k3kalinix | 2024-05-12 08:16:16

Reply by k3kalinix | 2024-05-12 08:16:22

Please follow this thread.

Reply by k3kalinix | 2024-05-12 08:16:31

Cc: <@365628745886859267>

Reply by k3kalinix | 2024-05-12 08:37:28

<@722442955608031296> Did it work?

Reply by freezfast | 2024-05-12 11:59:13

Hi <@722442955608031296>, we have a new lipsync component called FaceSync, please use it instead of the ConvaiOVRLipsync
cc: <@1023671043287699568> please share our quick guide on using the FaceSync component

Reply by k3kalinix | 2024-05-12 12:00:34

Adding LipSync

Embedded Content:
Adding LipSync to MetaHuman (From plugin version 3.0.0 or later ) |…
Add lip sync to your MetaHuman from base plugin
Link: Adding LipSync to MetaHuman (From plugin version 3.0.0 or later ) | Documentation

Reply by .roy_l1977 | 2024-05-21 10:55:08

Hello <@1023671043287699568> does this new LipSync component work with Ready Player Me characters ?

Reply by freezfast | 2024-05-21 10:56:26

Hi <@432610293441363978>, yes indeed it does, similar to the deprecated ConvaiOVRLipSync, it works with Ready Player Me, Reallusion, MetaHumans and custom integrations with other character types

Reply by .roy_l1977 | 2024-05-21 11:02:16

Cool,thanks,so the setup is the same ? just add it to the pawn blueprint i am using (Unreal engine)?

Reply by freezfast | 2024-05-21 11:03:41

Yes indeed, simply make sure to remove the ConvaiOVRLipsync and replace it with FaceSync

Reply by .roy_l1977 | 2024-05-21 11:04:56

great thank you