Hello, I need assistance regarding Pixel Streaming. While the STT (speech-to-text) performs well when speaking in English during Pixel Stream sessions, it produces a high number of errors when recognizing Turkish speech. Is there a way to improve or correct this issue?
Hello,
When you click your character on convai.com, and use the voice chat in the chatbox on the right side, does the same Turkish STT issue occur there as well?
Although it is not as problematic as in Unreal Engine, there are still some issues. The language is set to Turkish, yet sometimes it fails to recognize certain words, and at other times it does not capture the final word correctly.
Please create a new character, select only Turkish as the language, and test with this beta version.
The new hands-free conversation flow uses WebRTC, so it behaves differently from the older version.
Also, please focus only on STT accuracy, not the pronunciation or the character’s spoken response.
You can follow this guide to test properly:
https://docs.convai.com/api-docs/convai-playground/get-started/interact-in-voice-mode-beta
Yes, I tried what you suggested, and the STT works remarkably well. However, is there any way to use this on the Unreal Engine side as well?
If you are using our Unreal Engine plugin, yes, you can try our Beta Plugin, but please keep in mind that it is still in beta, so some features are limited or not yet supported. For example, LipSync and several other features are currently unavailable.
Please make sure to:
• Create a new C++ project when testing
• Do not update your existing production projects
• Use the beta package only for testing new features like Hands-Free mode, Vision, and Low-Latency responses
You can follow the video tutorial here: https://youtu.be/HCgVlCKpDvg
Documentation: https://docs.convai.com/api-docs/plugins-and-integrations/unreal-engine-plugin-beta-overview/installation-and-setup
Hopefully, the lip-sync issue will also be resolved with this version, and believe me, we would be very happy about that. ![]()
No need to worry! This will be announced soon. It’s not an issue, everything is being updated step by step. Thank you for your patience. The same improvements will also come to Avatar Studio and Convai Sim.
Thank you for the information, Kaan. I will be looking forward to it with great interest. Başarılar diliyorum dostum ![]()