I’ve been using the Convai plugin in Unreal Engine (5.5.4) to develop an AI to chat with. I implemented metahuman for the 3D model and used all the required components in the correct actors to achieve this.
Unfortunately, mic input only works rarely. While I can confidently type messages to the AI, attempts to speak are mostly unsuccessful. I’ve verified microphone settings and tested all available devices, changed settings in both Unreal and Windows, started a new unreal project, and yet they rarely listen. I can never hear my voice back when I test in f10 settings but regardless, the AI can only hear me sometimes. The push-to-talk function (holding “T”) also doesn’t work either. In the rare moments I can speak to the AI, they are always listening.
In blueprints, I discovered several ghost nodes causing broken yet successfully compiled scripts. I’ve included screenshots, as I believe they may be related to the issues. These scripts are pre-built from the components and are unedited.
I installed the latest version of the plugin directly from epic games, details stated it supports unreal versions 5.2 - 5.7.
What may be the solution to these issues? I hope this can be resolved soon please.
I set the parent class for the player as Convai Base Player. For the metahuman, I set Convai Base Character as the parent class, along with the chatbot and facesync components.
I must’ve picked that up from an older tutorial I attempted (https://www.youtube.com/watch?v=HHJvY9dmwwg) as an alternative solution. Is changing the parent classes a cause? What should they be set to?
Hi, I reinstalled the plugin, created a new project and followed the tutorial exactly. Unfortunately still having the same issues. Push-to-talk doesn’t work, only able to type to the AI, and the same ghost nodes are found in BP.
I also discovered that if I change the mic input device from settings (f10) while playing it will cause unreal to crash as soon as I stop playing. I then receive the following error message -
Yes it is enabled. Upon restarting the project after the crash it seems to be working now. Unreal has detected another mic device as the default. I restarted the project once more to confirm and push to talk is still working.
Regardless, do you know what could be the reason for the error above and why the restart suddenly solved the issue?
