Convai Plugin on Unreal – Audio Cuts Off at End of Conversation (Since June 11)

Hello,

We’ve just released the 3.6.4 update. Could you please try this version with MinBufferDuration=10 and let us know if you’re still experiencing the issue?

This may increase the response time slightly, but it should help reduce stutters. If this setting works for you, you can experiment with values between 0.7 and 2 to find the best balance for your use case.

  • Higher values → Longer response time, fewer stutters
  • Lower values → Faster response time, but potentially more stutters

You can download the latest release here: Convai Unreal Engine SDK – v3.6.4

Please test and share your results so we can further assist you.

@K3 using the Convai SDK 3.6.4, the first problem that happens is that the “Convai_MetaHuman_BodyAnim” is broken and distorts the MetaHuman body.

Can’t really test anything if the MetaHuman can’t be proper. Critical Issue needs urgent fix please.

Note, Reverting to the 3.6.2 plugin SDK, the Anim Blueprint is still broken. Damn, should have setup a new project with the new SDK. :frowning:

We haven’t made any changes regarding that. I recommend either reinstalling the plugin or trying the solution I’ve shared below to see if it resolves the problem.

Ok, trying to reinstall the plugin from the Fab Library, hoping it works. Also downloading the File you provided to test out with the 3.6.4 SDK.

Quick Question, If we don’t uninstall the Fab Library Plugin version and add the 3.6.4 SDK in the project Plugins Folder, will that work, if it break, we simply delete the project plugins folder and should revert back to the Engine Plugin 3.6.2+?

No need to install it from FAB. Create a Plugins folder and move the downloaded Convai file there.

@K3 Sorry to report, even with downloading and installing the Fab Library Plugin and replacing with the file you provided, the Anim BP is still broken.

Don’t use FAB Version.

Ok just adding the 3.6.4 plugin with the Content file you provided above in the Project>Plugins folder worked, setting the MinBufferDuration=10 seems to have increased delay, testing out the speech, still getting cut offs with the following code in the output log:

ConvaiGRPCLog: Warning: OnStreamFinish: Status.ok():Not Ok | Debug Log: | Error message:enter idle | Error Details: | Error Code:14 | Character ID:81b2b358-6cca-11f0-9210-42010a7be01f | Session ID:1bfedfc0899c845eb5f9f6a567f2c13b
ConvaiChatbotComponentLog: Warning: UConvaiChatbotComponent Get Response Failed! | Character ID : 81b2b358-6cca-11f0-9210-42010a7be01f | Session ID : 1bfedfc0899c845eb5f9f6a567f2c13b

But stress testing for land form answers, the lip sync drift is still present, noticeably less but still there. Added the following instruction in speaking style and seems to give a slightly better result:

Pause for Breath after a few sentences for dramatic effect but also to help recalibrate the Lip Sync Drift.

I believe, the issue might be that the text is being streamed faster than the lip sync. By providing breath for resync, forcing the text to be broken into smaller chunks, we can achieve a smoother speech and li sync with less drifting and addressing the Uncanny Valley effect better.

Humans take a breath in between 2-3 sentences anyway, so why not program that here as well.

Here is the LOG file. You’ll find the Error Code 14, as well as Error Code 2 in the log.

MetaHuman_Test_20250731_160400.log (2.4 MB)

The issue you’ve shared is different from the one being addressed in this thread. Here, we are specifically focusing on the stuttering issue, where the voice stops and resumes after a brief pause of around half a second to one second.

Could you please confirm whether you’re experiencing this stuttering problem? At this time, there have been no improvements related to Enter Idle or LipSync in this update.

I can confirm that the stuttering is still happening intermittently and randomly even with the 3.6.4 SDK. Seems to not happen as often as it was happening previously, but it is still present and breaks the illusion when it does happen. Hope this helps.

Here is a video showcasing the issue: https://drive.google.com/file/d/1NsbzC2U9OP--ExwglHqHppAQdzKJaUnq/view?usp=sharing

Could you please test it with an ElevenLabs voice?

It’s even worse with ElevenLabs Voice @K3.

Also testing the framework and SDK, I’m using up my credits on my account. Any chance those getting reset to help identify issues? Would be a good faith gesture as a side note…

Are you sure you are using the 3.6.4 update? Could you check in the plugin window?

image

I’m testing your character, and there’s no stuttering at all.

Also testing the framework and SDK, I’m using up my credits on my account. Any chance those getting reset to help identify issues? Would be a good faith gesture as a side note…

I will check and get back to you.

1 Like

So I am not sure what is really happening inside Unreal Engine. Are you testing it on the Playground or are you testing it in Unreal Engine

Unreal 5.6 / 3.6.4

Anyway, thanks, let’s check it out some more.

1 Like

What do you suppose is causing the stuttering in Unreal Engine? what are you doing differently. Maybe we should evaluate that. As an Unreal Gold Authorized Instructor partner, I can help, but I am not a coder, developer or programmer.