Original Discord Post by originalnightcreature | 2024-05-08 12:22:40
I’m trying to modify the lip syncing made by convai, is there a way i can access the audio solver or is that hidden can can’t be accessed in unreal engine ?
Original Discord Post by originalnightcreature | 2024-05-08 12:22:40
I’m trying to modify the lip syncing made by convai, is there a way i can access the audio solver or is that hidden can can’t be accessed in unreal engine ?
Reply by originalnightcreature | 2024-05-08 12:30:49
Audio solver and lipsync
Reply by k3kalinix | 2024-05-08 22:25:21
<@365628745886859267>
Reply by freezfast | 2024-05-09 08:59:10
It can be accessed, you need to find the Face animation blueprint and inside you will find an animation layer for lipsync. You can study the logic in there and adjust to your liking
Reply by freezfast | 2024-05-09 08:59:42
But what is your use case, are you trying to integrate a custom character that had different blendshapes?
Reply by originalnightcreature | 2024-05-10 13:03:37
no we just want to add our own set of phoneme animations and tweak the values, the current lip sync is too fast when it comes to mouth movements, or rather blending between the different phonemes, it feels mechanical, so we’re trying to make it smoother
Reply by freezfast | 2024-05-11 13:59:01
I see, in that case you can give the VisemeLipSync animation layer in the Face animation blueprint a look, you can replace the animations there with your own
This conversation happened on the Convai Discord Server, so this post will be closed.