How to make the convai head & eye tracking compatible with animation added from else where

Original Discord Post by holiday_29398 | 2024-07-11 02:36:34

this question has been brought up in another post (but it is closed now). when I added the animation from mixamo, the convai head & eye tracking function was overridden. I am wondering if I do it using Reallusion CC4 Characters by following this youtube tutorial, will it be compatible with convai head & eye tracking function? https://www.youtube.com/watch?v=va-qyFa312g&list=PLn_7tCx0ChipYHtbe8yzdV5kMbozN2EeB&index=3 I can’t tell from the tutorial as there are not too many conversations with NPC. If convai head & eye tracking function will not be compatible with animation added from elsewhere, could you provide solutions for this (even do it manually)? Thank you!

Embedded Content:
Creating Lifelike NPCs in Unity with Reallusion CC4 Characters | Co…
By the end of this tutorial, you will have a working @reallusion Character Creator 4 NPC that you can talk to and interact with in a 3D web environment using Unity 3D. We will create a character using Reallusion’s Character Creator 4 and then import that character directly into Unity. Next, we will connect that character to Convai’s AI brain and…
Link: https://www.youtube.com/watch?v=va-qyFa312g

Reply by k3kalinix | 2024-07-11 22:54:33

Cc: <@&1163218322200989806>

Reply by holiday_29398 | 2024-07-15 02:16:58

hello? any update? thanks

Reply by k3kalinix | 2024-07-15 16:30:15

Hey <@1248490084588847235>,

In this case, you can disable the head eye tracking component when the character’s head turns.

Reply by holiday_29398 | 2024-07-16 02:04:48

but I need this function, I want my NPC to have natural eye contact with me

Reply by k3kalinix | 2024-07-16 22:59:53

But if you think about it, there will be different head or eye movement in the animation, there will be different head movement in head tracking.

How do you plan to use both at the same time?

Reply by holiday_29398 | 2024-07-17 02:03:47

can I disable the head movement of the animation added from elsewhere and enable convai eye and head tracking?

Reply by holiday_29398 | 2024-07-18 08:31:35

or maybe, I don’t even need an animation elsewhere because all I want is to let my NPC sit down. So if there is any way that I can get her sit down without changing any conv ai parameters?

Replying to holiday_29398’s Message

Reply by holiday_29398 | 2024-07-17 02:03:47
can I disable the head movement of the animation added from elsewhere and enable convai eye and head tracking?

Reply by k3kalinix | 2024-07-18 08:42:13

You have to edit animation frames

Replying to holiday_29398’s Message

Reply by holiday_29398 | 2024-07-18 08:31:35
or maybe, I don’t even need an animation elsewhere because all I want is to let my NPC sit down. So if there is any way that I can get her sit down without changing any conv ai parameters?

Reply by k3kalinix | 2024-07-18 08:42:35

You don’t change any Convai Parameter already.

Reply by k3kalinix | 2024-07-18 08:42:47

Just remove head related animation parameters

Reply by k3kalinix | 2024-07-18 08:43:00

Or try using avatar masking

Reply by holiday_29398 | 2024-07-18 09:05:02

what is avatar masking

Reply by k3kalinix | 2024-07-18 09:32:16

Please search in google/youtube

Reply by k3kalinix | 2024-07-18 09:32:24

Embedded Content:
Avatar Masks - Unity Official Tutorials
Watch this video in context on Unity’s learning pages here - http://unity3d.com/learn/tutorials/modules/beginner/animation/avatar-masks
Avatar Masks allow you to isolate parts of a model’s anatomy, allowing the rest to ignore an animation. This game be useful when you want to layer or combine multiple animations. In this video you will learn abo…
Link: https://www.youtube.com/watch?v=1dMoRECcstQ

Reply by holiday_29398 | 2024-07-19 02:30:00

thanks i will check it out later!

This conversation happened on the Convai Discord Server, so this post will be closed.