Convai and metahumans web

Original Discord Post by erikmendes | 2024-08-24 22:46:12

In Unreal we have the plugin to generate the animations for the characters…

To run in a web application, for example

does your WEB SDK also have this function?
Can I, for example, export the metahuman in some way and generate its animation on the web?

I want to do something similar to digital humans using conva, can I achieve this result using only metahuman resources?

Reply by k3kalinix | 2024-08-24 22:49:41

What is your question about Convai?

Reply by k3kalinix | 2024-08-24 22:50:49

Convai provides the character’s brain. Customizing the character is up to you.

Reply by erikmendes | 2024-08-24 22:54:24

the conva web sdk generates animations, so based on the web sdk I can, for example, get the animation data to pass on to a 3D model, correct?

I want to create a 3D chatbot for chatting.

My question is…
Can I do this using metahuman or reallusion?
Is there a specific 3D format that the web sdk supports for this type of integration?

Reply by k3kalinix | 2024-08-24 22:57:15

I don’t understand your question. Let me tag my teammate <@368669084952428554>

Reply by erikmendes | 2024-08-24 22:59:33

ok

Replying to k3kalinix’s Message

Reply by k3kalinix | 2024-08-24 22:57:15
I don’t understand your question. Let me tag my teammate <@368669084952428554>

Reply by erikmendes | 2024-08-24 23:05:09

What requirements and settings are needed to make a 3D model compatible with the viseme and facial expression data generated by the Convai SDK? Does Convai provide specific guidelines or support for integrating this data into models such as MetaHumans or characters created with Reallusion (Character Creator/iClone)?

Reply by purn3ndu | 2024-08-25 09:59:29

<@179743651163799553> to use Metahumans on web you’ve to use pixel streaming. you can schedule a call with Convai Sales if you’d like access to that. Calendly - Convai Team

Embedded Content:
Let’s chat! - Convai Team
Sign up for a friendly conversation where we can discuss your use case and answer your questions. We’d love to explore how Convai can help you achieve your goals.
Link: Calendly - Convai Team

Reply by purn3ndu | 2024-08-25 10:00:18

if you want client based rendering with Reallusion characters you can follow this tutorial https://youtu.be/5tYyeXPo5vg?si=tcPWiVB7UeupT1Ee

Embedded Content:
AI Characters in Web Browser using ThreeJS and Reallusion Character…
Convai powers the minds of 3D avatars in virtual worlds. In this video, we’ll be guiding you on integrating Convai’s AI functionalities with a @reallusion Avatar, all on your web browser using Three.js and React. Using Convai, you can effortlessly add complex AI functionalities to your Reallusion character, enabling dynamic natural conversations…
Link: https://www.youtube.com/watch?v=5tYyeXPo5vg

This conversation happened on the Convai Discord Server, so this post will be closed.