Player location problem in NPC environment variable (UE5.5.4 convai 3.6.9-hotfix-1 and convai 3.6.9-hotfix-2)

Hello, I’ve had some issues with the follow me action as well as having the NPC consistently turn their head towards the player. I’ve read other posts but haven’t found a solution.. I’ve created a new project to make sure it wasn’t anything in my level. I’ve had some instances in my project where the head turn when spoken to worked but stopped working after some time or when I asked the NPC to follow me. I also noticed that when asking the NPC to follow me and in the occasions that it does start moving, it moves to the location of PlayerStart, the original location of the VRPawn, but not the current location of VRPawn where I am at.

Video’s followed for setup:

For setting up the metahuman:

And this one for the VRPawn:

Steps followed for the new project:
Downloaded the convai 3.6.9-hotfix-1 (I also tried with 3.6.9-hotfix-2) from the github, put it in a Plugins folder of the new project, restart project, download a metahuman and add it to the project (through Quixel Bridge). Set the API key in project settings and the character id on the metahuman. Change in the class settings the parent class of the metahuman blueprint to Convai Base Character, change the body and face class, add ConvaiFaceSync component.
Then for the VRPawn: change in class settings the parent class to Convai Base Player, in the capsule component change capsule radius and half height to 0, in VRPawn itself change gravity scale to 0. I also added the logic for Pressing A on an Oculus controller instead of t on the keyboard to talk to the NPC inside the convai_base_player blueprint event graph. The level is simply the VRTemplate level, so the nav mesh is fine

I don’t think (but it’s still possible) that it’s simply due to the headset possibly sometimes having a mess up with the guardian/boundary system as I remember the head turning to have worked on some occasions, but not consistenly? I’m using a meta quest 3 and have tested with other meta quest 3 headsets. In the current set up of the new project, only my Player Start location gets detected.
Thanks for your help


From looking at these blueprints, I assume the player origin is checked to get the distance and rotation to move to, it is also not possible for me to change this to the camera component of the VRPawn as that is a component and thus doesn’t fit in the input slot of “AI MoveTo” that requires an actor

Could you please show your Player and Character blueprints?

Give me five minutes, I’ll redo the steps mentioned, I was just trying out if convai 3.6.9 (the version before the hotfixes) would work correctly or not and thus have changed the previous project I was talking about

Do you wish to see the event graphs of just the VRPawn and Metahuman blueprint?

After saying “Follow me,” please press F8 and check where the Blueprint with the Convai Player Component is located in the scene.

If i’m in VR, pressing f8 doesn’t do anything even if i move away from the preview using shift + f1 and go to the other unreal engine tab. Should i do this in the active level editor viewport?

Yes, please test this inside the Unreal Editor.

What I’d like you to do is eject from Play mode so you can inspect the scene while the game is still running. In a normal editor preview, this is usually done with F8.

After ejecting, check where the player actor or the Blueprint with the Convai Player Component is located in the level. This will help confirm whether the player position is being tracked correctly.

Should I not move the character in game? I don’t know how to move in game in normal preview. Im asking as the NPC moves to the PlayerStart position, so not moving away would not show much, no?

I’m sorry Im actually also struggling for the audio input, this desktop doesn’t have a proper microphone, so i think I have to use the VR headset for the audio input, but I’m struggling to make the voice command follow me in normal editor mode

Oh I forgot i could just type.. here you go
During play:


Before play:

Could you also share why you prefer not to use V4?

I was using V4, but before actions were supported and couldn’t wait for when it got out as I have a deadline. I was then told to use v3.6.9 and have been trying to make my application work since, to no avail.

Would you have a recommendation for a specific V4 version for Unreal Engine 5.5.4?

V4 now supports Actions. We have also tested it in XR, and it works without issues.

You can check out an example demo here:
https://forum.convai.com/t/demo-it-sees-navigates-converses-acts-spatially-aware-ai-npc-demo-in-xr-powered-by-convai/6190

You can download the latest Unreal Engine V4 plugin here:
https://github.com/Conv-AI/Convai-UnrealEngine-SDK-V4/releases