Need to implement MoCap body data and Facial Animation data to MetaHuman

[Jeasy_Sehgal]

Continuing the discussion from UE5 + Reallusion documentation (Custom Events/Emotions):

Hi @K3,

I have downloaded the animation blueprint for Reallusion Characters from here: Latest (5.0-5.5) - Google Drive and wonder if I can apply it to the Metahuman characters?

For a research grant we are presenting the metahuman character as well as preparing Reallusion Characters custom designed for specific time frame in history, as well as regions around the world. Hopefully we can get the grant which will allow us to get the Scale Plan to integrate Vision Ability via APIs and Plugins. I have been trying to find any documentation or tutorial about this but can’t find any, can you please share.

I really want the Digital Human, when not interacted with to lose focus, and to perhaps continue doing some activity animation like sitting, having coffee, working, checking computer, walking around, etc. in the virtual world until interacted with and then come back to life by having conversations with the participant.

How can I implement this feature? Also how can I start testing the Vision Ability in a sandbox environment to test out if the Digital Human can see me talking to it via Webcam, understanding if I am smiling, or sad and responding with appropriate animation.

[K3]

Hello @Jeasy_Sehgal,

The Reallusion Animation Blueprint (ABP) is specifically intended for Reallusion characters only. For MetaHuman characters, please use the Convai_Metahuman_FaceAnim ABP.

Also, we kindly ask that for better clarity and support, please create a new post for each separate question you may have.

Thanks for your understanding!

[Jeasy_Sehgal]

Thank you @K3, will do. Will come back to you with more.