can I use Convai on my own character that is not a metahuman, like a puppy, a zombie, or any other original character, and how would I make it move its mouth in sync with the responses, or if it’s a zombie or monster, how can it show emotions when speaking? Thanks in advance.
Hi 
you can use Convai with just about any character, or even just a simple cube or something if you wanted to test it.
To have lip sync with the audio you’d need to use things like viseme’s and blendshapes, I think Convai offer a lip sync component for Unity that can be used with specific character types like Character Creator avatars, this is the much easier route.
Also, there are Unity Assets (helpful applications) like Salsa Lip Sync which can give lip sync (plus other things like head tracking etc) to specific character types in a few clicks.
Some avatar types will require you to manually set up the lip sync’ing which is more involved so I always use Salsa (there are other Unity Assets that do it too).
To have emotions you could again use Salsa : Convai send emotion info with the avatars response, so things like “happy”, “sad”, “interest”, things like that, you can map these to Salsa Emotes which are basically facial expressions for the character, that’s how I do it.
1 Like
Thank you very much, but there’s no way I can do it myself, as I only work with Unreal Engine 5 (UE5) and don’t use other engines. My question is actually whether there is any way to achieve it within UE5.
Thanks in advance.
No problem! The workflow will be similar to a large extent I imagine, some of the things like emotion data, etc, will happen with both engines. I don’t have Unreal experience so can’t comment on that specifically, but yes all this is possible in Unreal 