Text To Speech often fails - character stuck without FinishTalking event

Hi,

This is an issue that has happened to us with OpenAI voices first, and we then moved to Azure voices which seemed better at first - but it’s now happening increasingly often here as well.

The issue that happens is that the character starts speaking, but then only the text is received (no voice). It also doesn’t send a Finish Talking event at all.
In some instances, no voice is received even in the beginning, only the text for the subtitles.

Running on UE5.5 with plugin version 3.5.0.

Character ID for example: 5d31790e-e2de-11ef-9226-42010a7be016
Session ID: 71e5ee31e00bb40aa8f43291d18370ba

PS: There doesn’t seem to be a way to add attachments here, but I have UE output logs from another session where the issue occured, if that’s helpful.

Hello @heivoll,

We’ll need to check the Unreal Engine Output logs to investigate this issue.

Before testing, please clear your output logs, then start your level and try to reproduce the issue. Once it happens, share the logs with us. If your API Key appears in the logs, make sure to remove it before sharing.

You can upload the logs as attachments or paste them as text. If you encounter any issues while sharing, please let us know. :blush:

@K3 Sorry, didn’t see the upload button when posting a comment. Here is an output log. It’s not from a cleared one from the beginning - I could always give you this if needed, but I hope this gives you the info needed?

I had to remove the attachment because your logs contained your API Key.

Unfortunately, I couldn’t find any errors in the logs.

If possible, please clear your logs, reproduce the issue from the start, and share the updated logs with us. That would be really helpful!

@K3 Here’s another log, without API key, and including everything from the start. The first thing the character said came through as audio, but super slow. The second one never came through at all (but they responded after I talked to them).

LogStreaming Display FlushAsyncLoad.txt (110.1 KB)

@K3 Here’s a new log for when an issue like this occured - in Standalone mode, so somewhat closer to production setting. You can see towards the end of the log that it says things like this:

Warning: OnStreamFinish: Status.ok():Not Ok | Debug Log: | Error message:Received RST_STREAM with error code 2 | Error Details: | Error Code:13 | Character ID:87a46d5c-dfe3-11ef-bbf7-42010a7be016 | Session ID:61f42bf687b2d9e3dbdf27296beb4706

[2025.02.04-13.01.30942][740]ouput-log.txt (46.5 KB)

Here’s one where the character never started speaking to begin with. Not sure if this is the same issue or not?
output-log-1448.txt (2.9 KB)

The frequency of this error should be significantly reduced with version 3.5.1 (1 every ~130 interactions). Could you double-check in the Plugins menu of the editor to confirm that the plugin has been updated?

Additionally, does the error occur less frequently with audio chat compared to text chat, or does it feel the same across both?

Lastly, we’re planning major updates to the code, so this issue will be fully resolved in the next plugin update.

@K3 I see. We were running 3.5.0, as the release notes of 3.5.1 mainly mentioned multiplayer stuff. But I’ve updated to the latest version now. We’ll test more thoroughly to see if it’s still happening or not.

We’re mainly using audio chat, but at least before when using text chat it seemed more stable. So without being able to say 100% sure, I think it’s more frequent with audio chat.

1 Like