Why is lip-sync not working in Convai UE Beta

Hi Kaan,

I have duplicated my Unreal Engine project and trying to install Convai Unreal Engine SDK Version 4.0.0-beta.2 Plugin to start testing.

From the start, the setup is different and the installation documentation doesn’t really explain details in Installation and Setup | Convai Documentation.

  • For the MetaHuman Blueprint, What is the Parent Class supposed to be for this version?
  • In the player component BP, is there a class we need to pick as well?
  • Also, on pressing Play in Editor, getting this error message.

Can you please share the setup steps for the new 4.00-beta.2 plugin please so I can get it setup and start testing to report back?

What am I missing? I am not sure what I am doing wrong…

Thanks,

Jeasy

Hello Jeasy,

Your project must be a C++ project. Blueprint-only projects are not supported with the beta package.

Also note that lip-sync is not yet supported in this beta version.

For installation, you only need to add the components exactly as shown in the video and documentation. There is no parent class change required.

Additionally, I strongly recommend testing the plugin in a new, empty Unreal project first, before moving it into your main project. This will help you confirm the setup is correct and avoid conflicts from previous project settings.

Thanks Kaan,

I’ll start a new C++ first person based Unreal game project to implement the plugin first to ensure everythign is working as intended, then proceed to import the MetaHuman for implementation into this project.

Does the team have the steps to follow precisely for this implementation, it would be most helpful and save a lot of time trying to document all the steps point by point for the research team.

Thanks.

You can follow these steps:

  1. Create a new C++ Unreal project.

  2. Drag the Convai folder into your project’s Plugins directory.

  3. Open the project and build it in Visual Studio.

  4. After it compiles, enable the plugin in Unreal.

Hello! I’m also facing the same issues with the Convai Face BP. I tried following the tutorial but with a C++ project. Also, instead of putting the chatbot component on the player BP like in the tutorial, I placed it in a metahuman BP with the “Actor“ class. I tried looking for where the compiling issue is, and saw it was in the lip sync under the Event Graph.

1 Like

lip-sync is not yet supported in this beta version.