Original Discord Post by mapleaber | 2024-10-15 02:20:05
Hello, I’m currently trying to add lip sync to a custom model fbx and am just having a bit of trouble getting it to work. My model has the 52 facial blendshapes but im unsure how to link it with the lip sync component. Any help would be appreciated.
The NPC’s in the demo scene has working lip sync and ive tried replicating the same settings they had, but I just didnt have much luck.
Reply by entropia3d | 2024-10-15 05:49:32
Hello, I’m not from Convai, but I can give you a first hint.
In Assets/Convai/ you will find the file “Convai Visemes Efectors”. (Perhaps make a copy with the name of your character beforehand) Click on it and in the Inspector you can assign individual blendshapes to the visemes .
Then enter this file in the ConvaiLipSync component.
Reply by k3kalinix | 2024-10-15 07:06:22
Hello <@234059361683505153> ,
Reply by k3kalinix | 2024-10-15 07:06:23
Embedded Content:
Adding Lip-Sync to your Character | Documentation
Learn to add lip sync to your Unity characters using Convai. Improve realism and interactivity.
Link: Adding Lip-Sync to your Character | Documentation
Reply by k3kalinix | 2024-10-15 07:06:35
Please follow this documentation.
Reply by k3kalinix | 2024-10-15 07:06:50
<@317236362355015680> thanks for the help.
Reply by entropia3d | 2024-10-15 07:13:22
<@1023671043287699568> I guess even you need some sleep 
Reply by k3kalinix | 2024-10-15 07:20:43
Ahaha Thank you, no worries. 
Reply by mapleaber | 2024-10-16 01:10:00
<@317236362355015680> <@1023671043287699568> ill give it a try. I followed the documentation you linked but I wasn’t able to figure out how to use the visme effectors correctly. Was hoping for a YouTube tutorial if that existed.
Reply by k3kalinix | 2024-10-16 14:15:05
Which LipSync Blendshapes does your character support?
Replying to k3kalinix’s Message
Reply by k3kalinix | 2024-10-16 14:15:05
Which LipSync Blendshapes does your character support?
Reply by mapleaber | 2024-10-16 18:13:34
Sorry, can you elaborate on this? My character’s facial blendshapes were created based on this documentation which uses ARKit documents. It has the 52 different blendshapes.
https://hinzka.hatenablog.com/entry/2021/12/21/222635
Embedded Content:
Get your model ready for Perfect-Sync - 52 blendshapes for iPhon…
window.dataLayer = window.dataLayer || ; function gtag(){dataLayer.push(arguments);} gtag(‘js’, new Date()); gtag(‘config’, ‘G-YQZJBXZGR6’); 日本語版 Description of 52 blendshapes for iPhone face Tracking - GoogleDocs Blendshapes LIST Sample Models Glossary of Terms The following is a summary of infor…
Link: Get your model ready for Perfect-Sync - 52 blendshapes for iPhone face Tracking - - はいぬっかメモ
Replying to k3kalinix’s Message
Reply by k3kalinix | 2024-10-16 14:15:05
Which LipSync Blendshapes does your character support?
Reply by mapleaber | 2024-10-16 18:14:06
Do i need to do my blendshapes differently for lipsync?
Reply by k3kalinix | 2024-10-17 17:01:28
We Support OVR / ARKit / Reallusion Blendshapes
Reply by k3kalinix | 2024-10-17 17:01:40
Which Blendshape type do you use?
Reply by mapleaber | 2024-10-21 03:40:56
I use ARkit, ive tried with different models with ARkit blendshapes but still no result…
Reply by k3kalinix | 2024-10-21 21:11:09
Are you checking the Blendshape values from the inspector?
This conversation happened on the Convai Discord Server, so this post will be closed.
