Conv.ai in Unreal Engine can let actors speak English and output Chinese subtitles at the same time?

Original Discord Post by zhiyong_1 | 2024-04-11 17:36:52

<:unreal:1146144246223614084> When I was running it, I found that their Chinese voice package was very unstable. I wonder if there could be a solution to allow Conv.ai’s characters to keep interacting with the audience in Chinese and limit Conv.ai’s characters to output only stable English voice packages.

Reply by sss_official | 2024-04-12 18:54:05

You can use google translate with the google API. Try using the method where the output in English is translated into Chinese through the API and then displayed on the HUD.

Replying to sss_official’s Message

Reply by sss_official | 2024-04-12 18:54:05
You can use google translate with the google API. Try using the method where the output in English is translated into Chinese through the API and then displayed on the HUD.

Reply by zhiyong_1 | 2024-04-12 20:24:01

Will this ensure that the audience continues to speak in Chinese?

Replying to sss_official’s Message

Reply by sss_official | 2024-04-12 18:54:05
You can use google translate with the google API. Try using the method where the output in English is translated into Chinese through the API and then displayed on the HUD.

Reply by zhiyong_1 | 2024-04-12 20:25:44

Do I need to install a google Translate plug-in? Can you recommend relevant teaching videos to me

Reply by sss_official | 2024-04-14 06:14:21

Ah, sorry for the late reply. What are you going to use it for? Are you looking to use it for chatting during streaming, or does it need to be processed as speech to text?

Replying to sss_official’s Message

Reply by sss_official | 2024-04-14 06:14:21
Ah, sorry for the late reply. What are you going to use it for? Are you looking to use it for chatting during streaming, or does it need to be processed as speech to text?

Reply by zhiyong_1 | 2024-04-14 07:43:12

Hello,

Firstly, I’d like to extend my gratitude for your suggestions. I am currently developing a VR project that allows the audience to engage in real-time interactions with NPCs in Chinese. Convai plays an integral role in enhancing the narrative and introducing voice interactions within my project. Since the project is aimed at a Chinese-speaking audience, and considering that not everyone is fluent in English, providing Chinese subtitles is essential for understanding the NPCs’ spoken content.

However, I have encountered significant stability issues with the Chinese voice packs provided by Convai, and additionally, the voices do not align with the character settings of our story. Therefore, I am in search of a solution that would enable the characters to converse in English (as it better suits our character settings) while offering accurate and reliable Chinese subtitles to ensure comprehension amongst all viewers.

Thank you for your assistance and understanding.

This conversation happened on the Convai Discord Server, so this post will be closed.