Convai + Metahuman + Android Pico VR headset - Will lipsync work?

Unreal Engine Questions
,
1

Original Discord Post by cgfrosty | 2024-07-15 21:27:16

Hello,
We tried to use metahuman SDK with Android Pico VR, but lipsync not working.
We decided to try Convai.
We have 2 questions before we will start:

  1. Will the lipsync work with our own metahuman character on Android platform? Some of collegues afraid bones limitation on Android device.
  2. Could we use audio files for generating lipsync with Convai?
2

Reply by k3kalinix | 2024-07-16 18:58:15

<@&1163218672580575372>

3

Reply by freezfast | 2024-07-16 19:08:38

Hi <@605699340086018060>, for your first question to the best of my knowledge lipsync should work just fine if you use the correct FaceSync component for lipsync, for the second question, we do not plan to support that functionality at the moment. However, you can use the invoke speech function to get the character to say the exact same paraphrase that you would like, so you can use Convai as a text to audio and lipsync, instead of audio to lipsync solution

4

Reply by cgfrosty | 2024-07-16 19:09:38

thank you! we will try!

5

This conversation happened on the Convai Discord Server, so this post will be closed.