# Issues with LipSync and Reallusion in Unity **URL:** \ **Category:** Unity SDK\ **Tags:** question, unity\ **Created:** [July 16, 2024, 11:10am UTC](https://forum.convai.com/t/issues-with-lipsync-and-reallusion-in-unity/1240 "2024-07-16T11:10:20Z")\ **Posts on this page:** 20\ **Page:** 1
**Author:** ![K3](https://yyz2.discourse-cdn.com/flex004/user_avatar/forum.convai.com/k3/32/2611_2.png) [@K3](https://forum.convai.com/u/K3)\ **Post date:** [July 16, 2024, 11:10am UTC](https://forum.convai.com/t/issues-with-lipsync-and-reallusion-in-unity/1240/1 "2024-07-16T11:10:20Z")
**Original Discord Post by ragnarockfb97 | 2024-07-16 11:10:20** Hello everyone. I’m currently having a few problems with some avatars that we imported from Character Creator. Sometimes, the lip sync won’t work at all and some other times, instead of moving the lips, the character moves his eyebrows. I’m also (sometimes) getting an error saying that the indexes for the mesh renderer are out of bounds, although all characters are created more or less in the same way. Does anyone know how I can solve this? **Images:** ![image.png](https://canada1.discourse-cdn.com/flex004/uploads/convai/original/2X/8/814a39abcb278fbf115128ddb24f6f2fa80da555.jpeg) ---
**Author:** ![K3](https://yyz2.discourse-cdn.com/flex004/user_avatar/forum.convai.com/k3/32/2611_2.png) [@K3](https://forum.convai.com/u/K3)\ **Post date:** [July 16, 2024, 11:18am UTC](https://forum.convai.com/t/issues-with-lipsync-and-reallusion-in-unity/1240/2 "2024-07-16T11:18:50Z")
**Reply by ragnarockfb97 | 2024-07-16 11:18:50** **Images:** ![image.png](https://canada1.discourse-cdn.com/flex004/uploads/convai/original/2X/2/2dfd4b45e2160088fd498f927971245ab5984e73.png) ---
**Author:** ![K3](https://yyz2.discourse-cdn.com/flex004/user_avatar/forum.convai.com/k3/32/2611_2.png) [@K3](https://forum.convai.com/u/K3)\ **Post date:** [July 16, 2024, 11:32am UTC](https://forum.convai.com/t/issues-with-lipsync-and-reallusion-in-unity/1240/3 "2024-07-16T11:32:13Z")
**Reply by k3kalinix | 2024-07-16 11:32:13** Hello \<@389522858386128918\> 👋🏻 ---
**Author:** ![K3](https://yyz2.discourse-cdn.com/flex004/user_avatar/forum.convai.com/k3/32/2611_2.png) [@K3](https://forum.convai.com/u/K3)\ **Post date:** [July 16, 2024, 11:32am UTC](https://forum.convai.com/t/issues-with-lipsync-and-reallusion-in-unity/1240/4 "2024-07-16T11:32:19Z")
**Reply by k3kalinix | 2024-07-16 11:32:19** Welcome to Convai Community! ---
**Author:** ![K3](https://yyz2.discourse-cdn.com/flex004/user_avatar/forum.convai.com/k3/32/2611_2.png) [@K3](https://forum.convai.com/u/K3)\ **Post date:** [July 16, 2024, 11:33am UTC](https://forum.convai.com/t/issues-with-lipsync-and-reallusion-in-unity/1240/5 "2024-07-16T11:33:18Z")
**Reply by k3kalinix | 2024-07-16 11:33:18** Make sure you have assigned the correct object to the Lipsync component. ---
**Author:** ![K3](https://yyz2.discourse-cdn.com/flex004/user_avatar/forum.convai.com/k3/32/2611_2.png) [@K3](https://forum.convai.com/u/K3)\ **Post date:** [July 16, 2024, 11:33am UTC](https://forum.convai.com/t/issues-with-lipsync-and-reallusion-in-unity/1240/6 "2024-07-16T11:33:50Z")
**Reply by k3kalinix | 2024-07-16 11:33:50** [![](https://canada1.discourse-cdn.com/flex004/uploads/convai/original/1X/1b4884856ef230e4d9289e691c3c3756837c6dd0.jpeg "Creating Lifelike NPCs in Unity with Reallusion CC4 Characters | Convai Unity Tutorial") ](https://www.youtube.com/watch?v=va-qyFa312g) **Embedded Content:** **Creating Lifelike NPCs in Unity with Reallusion CC4 Characters | Co…** By the end of this tutorial, you will have a working @reallusion Character Creator 4 NPC that you can talk to and interact with in a 3D web environment using Unity 3D. We will create a character using Reallusion’s Character Creator 4 and then import that character directly into Unity. Next, we will connect that character to Convai’s AI brain and… Link: [https://www.youtube.com/watch?v=va-qyFa312g](https://www.youtube.com/watch?v=va-qyFa312g) ![Thumbnail](https://canada1.discourse-cdn.com/flex004/uploads/convai/original/1X/1b4884856ef230e4d9289e691c3c3756837c6dd0.jpeg) ---
**Author:** ![K3](https://yyz2.discourse-cdn.com/flex004/user_avatar/forum.convai.com/k3/32/2611_2.png) [@K3](https://forum.convai.com/u/K3)\ **Post date:** [July 16, 2024, 12:51pm UTC](https://forum.convai.com/t/issues-with-lipsync-and-reallusion-in-unity/1240/7 "2024-07-16T12:51:11Z")
**Reply by ragnarockfb97 | 2024-07-16 12:51:11** I’m having the same issue, with the added problem that the jaw now looks like this:. **Images:** ![image.png](https://canada1.discourse-cdn.com/flex004/uploads/convai/original/2X/1/1d32a9a423b904297323b33e15851a3440c54c7c.png) ---
**Author:** ![K3](https://yyz2.discourse-cdn.com/flex004/user_avatar/forum.convai.com/k3/32/2611_2.png) [@K3](https://forum.convai.com/u/K3)\ **Post date:** [July 16, 2024, 1:08pm UTC](https://forum.convai.com/t/issues-with-lipsync-and-reallusion-in-unity/1240/8 "2024-07-16T13:08:02Z")
**Reply by k3kalinix | 2024-07-16 13:08:02** Did you edit the Avatar file? ---
**Author:** ![K3](https://yyz2.discourse-cdn.com/flex004/user_avatar/forum.convai.com/k3/32/2611_2.png) [@K3](https://forum.convai.com/u/K3)\ **Post date:** [July 16, 2024, 1:16pm UTC](https://forum.convai.com/t/issues-with-lipsync-and-reallusion-in-unity/1240/9 "2024-07-16T13:16:37Z")
**Reply by ragnarockfb97 | 2024-07-16 13:16:37** I followed the instructions in the video. I imported the character, removed the jawroot from the avatar file, added the jawroot and tongue1 to the respective fields in the lipsync script (along with the cc\_base\_body, teeth and tongue) and now it’s doing this ---
**Author:** ![K3](https://yyz2.discourse-cdn.com/flex004/user_avatar/forum.convai.com/k3/32/2611_2.png) [@K3](https://forum.convai.com/u/K3)\ **Post date:** [July 16, 2024, 1:19pm UTC](https://forum.convai.com/t/issues-with-lipsync-and-reallusion-in-unity/1240/10 "2024-07-16T13:19:13Z")
**Reply by ragnarockfb97 | 2024-07-16 13:19:13** It is moving its lips, but I don’t know why it’s doing that ---
**Author:** ![K3](https://yyz2.discourse-cdn.com/flex004/user_avatar/forum.convai.com/k3/32/2611_2.png) [@K3](https://forum.convai.com/u/K3)\ **Post date:** [July 16, 2024, 1:31pm UTC](https://forum.convai.com/t/issues-with-lipsync-and-reallusion-in-unity/1240/11 "2024-07-16T13:31:28Z")
**Reply by k3kalinix | 2024-07-16 13:31:28** I see, let me tag my teammate. cc: \<@415207243487772673\> ---
**Author:** ![K3](https://yyz2.discourse-cdn.com/flex004/user_avatar/forum.convai.com/k3/32/2611_2.png) [@K3](https://forum.convai.com/u/K3)\ **Post date:** [July 16, 2024, 2:39pm UTC](https://forum.convai.com/t/issues-with-lipsync-and-reallusion-in-unity/1240/12 "2024-07-16T14:39:45Z")
**Reply by ragnarockfb97 | 2024-07-16 14:39:45** You can see for yourself by downloading the character from here [https://drive.google.com/file/d/1UPggUny-QYKsxd71LaYZxNnp1Sz2in\_3/view?usp=drive\_link](https://drive.google.com/file/d/1UPggUny-QYKsxd71LaYZxNnp1Sz2in_3/view?usp=drive_link) **Embedded Content:** **Socrate.zip** Link: [https://drive.google.com/file/d/1UPggUny-QYKsxd71LaYZxNnp1Sz2in\_3/view?usp=drive\_link](https://drive.google.com/file/d/1UPggUny-QYKsxd71LaYZxNnp1Sz2in_3/view?usp=drive_link) ---
**Author:** ![K3](https://yyz2.discourse-cdn.com/flex004/user_avatar/forum.convai.com/k3/32/2611_2.png) [@K3](https://forum.convai.com/u/K3)\ **Post date:** [July 16, 2024, 5:55pm UTC](https://forum.convai.com/t/issues-with-lipsync-and-reallusion-in-unity/1240/13 "2024-07-16T17:55:14Z")
**Reply by raymondedmund | 2024-07-16 17:55:14** \<@433610960725344267\> This seems like a weight issue in the Lipsync. Can you please advise \<@389522858386128918\> on how to update these values in script? ---
**Author:** ![K3](https://yyz2.discourse-cdn.com/flex004/user_avatar/forum.convai.com/k3/32/2611_2.png) [@K3](https://forum.convai.com/u/K3)\ **Post date:** [July 17, 2024, 1:19pm UTC](https://forum.convai.com/t/issues-with-lipsync-and-reallusion-in-unity/1240/14 "2024-07-17T13:19:14Z")
**Reply by ragnarockfb97 | 2024-07-17 13:19:14** Thank you for your help, I’ll patiently wait for your response ---
**Author:** ![K3](https://yyz2.discourse-cdn.com/flex004/user_avatar/forum.convai.com/k3/32/2611_2.png) [@K3](https://forum.convai.com/u/K3)\ **Post date:** [July 17, 2024, 3:26pm UTC](https://forum.convai.com/t/issues-with-lipsync-and-reallusion-in-unity/1240/15 "2024-07-17T15:26:58Z")
**Reply by ragnarockfb97 | 2024-07-17 15:26:58** I’ve noticed that if I don’t remove the JawRoot bone from the avatar rig, the mouth stays in place, although it obviously doesn’t move the jaw when it’s talking (although it does move the lips). There is also the issue that it seems that if the model has a moustache, the upper lip doesn’t seem to move ---
**Author:** ![K3](https://yyz2.discourse-cdn.com/flex004/user_avatar/forum.convai.com/k3/32/2611_2.png) [@K3](https://forum.convai.com/u/K3)\ **Post date:** [July 17, 2024, 3:27pm UTC](https://forum.convai.com/t/issues-with-lipsync-and-reallusion-in-unity/1240/16 "2024-07-17T15:27:49Z")
**Reply by ragnarockfb97 | 2024-07-17 15:27:49** **Attachments:** - [VerseJunior\_-_RomanScene_-_Android_-\_Unity\_2022.3.10f1\_\_\_DX11\_\_2024-07-17\_17-27-28.mp4](https://cdn.discordapp.com/attachments/1262728021958201404/1263155204602331296/VerseJunior_-_RomanScene_-_Android_-_Unity_2022.3.10f1 ___DX11__ 2024-07-17_17-27-28.mp4?ex=673dfff5&is=673cae75&hm=a67b9ef48c69c2c129453384261d72fed318075f16fde75464c851729db580bd&) ---
**Author:** ![K3](https://yyz2.discourse-cdn.com/flex004/user_avatar/forum.convai.com/k3/32/2611_2.png) [@K3](https://forum.convai.com/u/K3)\ **Post date:** [July 17, 2024, 3:31pm UTC](https://forum.convai.com/t/issues-with-lipsync-and-reallusion-in-unity/1240/17 "2024-07-17T15:31:41Z")
**Reply by ragnarockfb97 | 2024-07-17 15:31:41** **Attachments:** - [VerseJunior\_-_RomanScene_-_Android_-\_Unity\_2022.3.10f1\_\_\_DX11\_\_2024-07-17\_17-30-55.mp4](https://cdn.discordapp.com/attachments/1262728021958201404/1263156177949294663/VerseJunior_-_RomanScene_-_Android_-_Unity_2022.3.10f1 ___DX11__ 2024-07-17_17-30-55.mp4?ex=673e00dd&is=673caf5d&hm=6aaa011d5cd72ea6c6936809882e77cf676d0af29e13231fdc132bc22e074589&) ---
**Author:** ![K3](https://yyz2.discourse-cdn.com/flex004/user_avatar/forum.convai.com/k3/32/2611_2.png) [@K3](https://forum.convai.com/u/K3)\ **Post date:** [July 17, 2024, 5:40pm UTC](https://forum.convai.com/t/issues-with-lipsync-and-reallusion-in-unity/1240/18 "2024-07-17T17:40:20Z")
**Reply by raymondedmund | 2024-07-17 17:40:20** \<@389522858386128918\> Can you schedule a call with me on my calendar at [https://calendar.app.google/FTm4JbSxu6giKJH5A](https://calendar.app.google/FTm4JbSxu6giKJH5A) Thanks a lot **Embedded Content:** **Appointments** Link: [https://calendar.app.google/FTm4JbSxu6giKJH5A](https://calendar.app.google/FTm4JbSxu6giKJH5A) ---
**Author:** ![K3](https://yyz2.discourse-cdn.com/flex004/user_avatar/forum.convai.com/k3/32/2611_2.png) [@K3](https://forum.convai.com/u/K3)\ **Post date:** [July 17, 2024, 5:51pm UTC](https://forum.convai.com/t/issues-with-lipsync-and-reallusion-in-unity/1240/19 "2024-07-17T17:51:21Z")
**Replying to ragnarockfb97’s Message** > **Reply by ragnarockfb97 | 2024-07-17 15:26:58** > I’ve noticed that if I don’t remove the JawRoot bone from the avatar rig, the mouth stays in place, although it obviously doesn’t move the jaw when it’s talking (although it does move the lips). There is also the issue that it seems that if the model has a moustache, the upper lip doesn’t seem to move **Reply by raymondedmund | 2024-07-17 17:51:21** Because of Reallusion’s bone structure organisation, we use the lower jaw bone, otherwise the character talks and “lip syncs” without actually opening the mouth I am not exactly sure why the mustache issue is happening. My best guess is that the mustache is a separate entity not attached to the upper lip blendshapes. We can check by seeing if the Hierarchy of the model in Unity has the mouth and mustache separately. If that is indeed the case, we can check if mustache has the necessary blendshapes for appropriate lip sync, and then modify the script accordingly ---
**Author:** ![K3](https://yyz2.discourse-cdn.com/flex004/user_avatar/forum.convai.com/k3/32/2611_2.png) [@K3](https://forum.convai.com/u/K3)\ **Post date:** [July 17, 2024, 5:55pm UTC](https://forum.convai.com/t/issues-with-lipsync-and-reallusion-in-unity/1240/20 "2024-07-17T17:55:25Z")
**Replying to ragnarockfb97’s Message** > **Reply by ragnarockfb97 | 2024-07-17 15:31:41** **Reply by raymondedmund | 2024-07-17 17:55:25** This is because the script updates the Jaw every frame, so even though you are updating the jaw directly, the lip sync script is updating it the next frame and your changes are not showing up [Next page](https://forum.convai.com/t/issues-with-lipsync-and-reallusion-in-unity/1240.md?page=2)