Why does my Convai metahuman fail to perform simple actions

What do you need help with?

Bug report

Installation method

Manual installation / GitHub

Issue area

Other

Impact

Normal - something is not working as expected

Unreal Engine version

5.8

Convai Unreal Engine Plugin version

most recent

Character ID

d49269f6-68e1-11f1-994e-42010a7be02e

Project setup

Blueprint and C++

Target platform

Unreal Editor

Where does it happen?

Custom project

Short summary

The AI isn’t really good…in my opinion.

What happened?

Whenever I ask it to do something with my current convai metahuman, it does work but it is not getting my metahuman to do much and if it does it is very buggy. I even asked the AI to do simple tasks like follow me or clap and he doesn’t do it. He will agree to do the action but not actually perform it. But keep in mind this is the codex agents work that caused this. It thinks it is supposed to work too and just leaves me with a mess. I followed convai’s tutorial directly even with the same exact commands and the AI Agent just doesn’t do it properly. I do have chat gpt plus codex agent.

What did you expect?

For it to work better than what it really does.

I checked the relevant documentation, resources, and similar forum posts before posting.

on

I confirm that I did not include API keys, tokens, passwords, secrets, private character data, private conversation logs, or customer data.

on

You do not need to use ChatGPT or Codex to set this up.

Please follow our official tutorials and documentation directly. These cover the correct workflow for setting up Convai characters and Actions in Unreal Engine:

I understand and I did use these tutorials before but I am asking how did your codex agent run so great without any issues but mine is making a big mess with a previously working program? I noticed the AI mcp agent was trying to get my metahuman to recognize certain objects without actually filling in the object panel with anything. Like I said, I followed the same exact commands from your tutorial and while yours worked perfectly, mine did not.

Hi Wesam, the agent might have not detected the Convai Skills coming in with the plugin, could you share which codex version are you using? Codex 5.5, 5.4-mini?

Additionally can you ask the agent “What Convai Skills and Tools do you have access to?” it should list out something like this and should include ConvaiActions skill and ConvaiActionToolset toolset:

  • ConvaiMetahumanSetup
  • ConvaiActions
  • ConvaiCustomActions
  • ConvaiSimpleAnimationActions
  • ConvaiSceneObjects
  • ConvaiConversation
  • ConvaiPlayerAndInput
  • ConvaiDynamicContext
  • ConvaiGazeAttention
  • ConvaiExpressiveness
  • ConvaiFaceAndAnimation
  • ConvaiNarrativeDesign
  • ConvaiVision
  • ConvaiRestAndAudioUtilities
  • ConvaiCharacterReference

I also see Convai MCP toolsets directly:

  • ConvaiToolset.ConvaiSetupToolset
  • ConvaiToolset.ConvaiActionToolset

Right after it shows the above list, try asking the agent the same questions you had before.

Let us know if the list does not show up or it is still not working as expected.

One more note, sometimes the edits done by the agent are in the blueprint of the chracter but does not propagate to the actual scene, so try deleting the character in the scene and spawning it again from the blueprint.