We’ve been noticing increasingly that when characters give very short responses (under 1.5 seconds, just a word or two), enabling microphone input doesn’t seem to work - no transcription is received (except for a “.”).
I log the transcription as it’s coming in to On Transcription Received (UE event), and when this happens, nothing comes in there while the microphone is active.
Example session ID: 0e46861a734397a0e871372475dfad5b
We’re using Unreal 5.5 with Convai plugin 3.5.1
Hello @heivoll,
Thanks for the detailed report and the session ID. Could you please test the same scenario on the Convai Playground (convai.com) and let us know if the issue persists there as well? This will help us determine whether the problem is SDK-specific or more general.
Hi @K3 . I’m not able to reproduce this in the playground (the web based chat), so looks like it’s an SDK issue.
I wanted to try with your own pixel streaming solution (the “Call” function) as well, but that one doesn’t seem to work right now.
PS: It doesn’t seem to happen for every session for the affected characters, but for some characters, like 35f7e67a-2109-11f0-a5e0-42010a7be01a , it happens about every 2/3 sessions in UE.
Thanks for the details. I have informed my teammates to investigate this issue further.
Thank you for looking into it!
Hi, any news on this, @K3 ?
I’ve been able to trigger this same error in the “video call” in the Convai dashboard as well - I assume that one uses UE5 with Pixel Streaming? I get the same issue there - no speech detected if you press T right after a very short message.
Using this character: 35f7e67a-2109-11f0-a5e0-42010a7be01a
To trigger: Tell the character to “Say hi and nothing more”, then after they’ve said it, immediately press T and start to talk. Nothing is received.
It seems like if you wait for a couple of seconds before pressing T, it will work (the same happens locally for us).
We were able to reproduce this issue and it will be resolved in our next update.
Aah, that is amazing news! Do you have any ETA on when the next update will be out, just so we can plan accordingly?
I can’t give an exact date, I expect it to be completed within this month. Though that’s not a firm guarantee. Thanks for your patience!
@K3 Ok, I understand, thank you.
We have an important project going live later this month, where this is a pretty big risk/issue. Is there any chance we could get a workaround - patch, file changes or similar - before the update release? Will they be committed to the beta branch or something on Github?
At the moment, we have several higher-priority developments and bug fixes already in the pipeline, and updates are being handled in that order. Premium support and early access to custom patches or expedited fixes are exclusive to our Enterprise customers.
We appreciate your patience and understanding, and we’re committed to ensuring the platform continues to improve for all users.