Issues with LipSync and Reallusion in Unity

Replying to raymondedmund’s Message

Reply by raymondedmund | 2024-07-17 17:40:20
<@389522858386128918> Can you schedule a call with me on my calendar at https://calendar.app.google/FTm4JbSxu6giKJH5A

Thanks a lot

Reply by ragnarockfb97 | 2024-07-18 07:19:34

Thank you, I’ve scheduled it for tomorrow

Replying to raymondedmund’s Message

Reply by raymondedmund | 2024-07-17 17:51:21
Because of Reallusion’s bone structure organisation, we use the lower jaw bone, otherwise the character talks and “lip syncs” without actually opening the mouth

I am not exactly sure why the mustache issue is happening. My best guess is that the mustache is a separate entity not attached to the upper lip blendshapes. We can check by seeing if the Hierarchy of the model in Unity has the mouth and mustache separately. If that is indeed the case, we can check if mustache has the necessary blendshapes for appropriate lip sync, and then modify the script accordingly

Reply by ragnarockfb97 | 2024-07-18 07:22:41

I’ve made my 3D modelist export the same character from Character Creator without the moustache, I’ll let you know in a second if the upper lip moves or not

Reply by raymondedmund | 2024-07-19 10:33:56

Hi <@389522858386128918> I was curious if you were able to make any progress or were facing any issues

Reply by ragnarockfb97 | 2024-07-19 13:13:08

I’ve managed to make the jaw stay in the correct place by changing this value, but now the only thing that’s moving is the jaw. The lips stay still

Images:

Reply by ragnarockfb97 | 2024-07-19 13:22:39

Attachments:

Reply by raymondedmund | 2024-07-19 16:23:20

<@389522858386128918> Do you have Parsec on your computer?

Reply by ragnarockfb97 | 2024-07-19 16:43:29

No, I don’t. Do I need to download it?

Reply by ragnarockfb97 | 2024-07-19 16:47:49

I’ve downloaded it

Replying to ragnarockfb97’s Message

Reply by ragnarockfb97 | 2024-07-16 12:51:11
I’m having the same issue, with the added problem that the jaw now looks like this:.

Reply by ragnarockfb97 | 2024-07-19 17:12:09

.

Reply by raymondedmund | 2024-07-19 17:32:09

<@389522858386128918> Here are a few documentation pages to help you through the lip sync process. The Reallusion documentation isn’t great on explaining how to update the blendshapes, so if your character artist needs any help, please feel free to set up another call and I’d be happy to show the process

https://manual.reallusion.com/Character-Creator-4/Content/ENU/4.0/06-Facial-Profile-Editor/Introduction-of-Facial-Profile-Editor.htm?Highlight=expression%20profile

Embedded Content:
Adding Lip-Sync to your Character | Documentation
Learn to add lip sync to your Unity characters using Convai. Improve realism and interactivity.
Link: Adding Lip-Sync to your Character | Documentation

Reply by ragnarockfb97 | 2024-07-22 07:01:15

Thank you very much, we’ll test out what you told me last time and as soon as we get any result I’ll let you know

Reply by ragnarockfb97 | 2024-07-23 07:53:57

Good morning. My 3D artist did put the CC4+ facial profile as you instructed us and, in fact, our character and the Amelia NPC have the same face blends, but it still has the same effect

Images:


Reply by ragnarockfb97 | 2024-07-23 07:56:45

I’ve also tried changing the value I showed you in the call here and the result is as shown. Also, our character still isn’t moving his lips, only the jaw

Images:


Reply by k3kalinix | 2024-07-23 08:15:38

cc: <@415207243487772673>

Reply by k3kalinix | 2024-07-23 08:15:45

<@433610960725344267>

Reply by raymondedmund | 2024-07-24 04:02:29

<@389522858386128918> Can you please schedule another call with me using this Calendar link: https://calendar.app.google/yUgXAvt4F7a83vBs7

Embedded Content:
Appointments
Link: https://calendar.app.google/yUgXAvt4F7a83vBs7

Reply by ragnarockfb97 | 2024-07-24 07:09:07

Thank you, I scheduled it for friday

This conversation happened on the Convai Discord Server, so this post will be closed.