Original Discord Post by kyu.168 | 2024-08-15 13:23:44
Good morning, I’m developing a corporate coaching tool using Convai and Oculus VR. I have an Unreal 5.4/Oculus project that is packaged correctly but the remapping of speech to text from T to Oculus Touch A button (right controller) [I followed one of the VR tutorials on youtube for convai] doesn’t seem to be working. I need some help to resolve the configuration of my project please.
Images:
Reply by kyu.168 | 2024-08-15 16:33:41
Hello <@1023671043287699568> is there any documentation I can look at for this to revise my project? Would appreciate some help please.
Reply by k3kalinix | 2024-08-15 16:38:05
Hello <@961499420199890944>,
Reply by k3kalinix | 2024-08-15 16:38:06
Embedded Content:
Push to Talk | API Docs
This document explains how to change the default push to talk key.
Link: Push to Talk | Documentation
Reply by k3kalinix | 2024-08-15 16:38:21
You can check this documentation.
Reply by kyu.168 | 2024-08-15 16:39:48
yes I followed this tutorial to modify that push to talk blueprint: https://www.youtube.com/watch?v=HHhkBd6NOlo, but the controls to talk to convai API are not working on Oculus Quest 3 now.
Embedded Content:
Creating Talking AI Characters in VR and Android | Convai Unreal En…
Learn how to add AI NPCs in Unreal Engine for Android and VR applications using the Convai plugin. This tutorial walks you through the installation of the plugin, creating interactive characters and integrating them, adding actions and scene perception, and finally creating the application for Android VR.
GDrive link for the ConvaiReadyPlayerMe…
Link: https://www.youtube.com/watch?v=HHhkBd6NOlo
Reply by k3kalinix | 2024-08-15 16:40:21
<@&1163218672580575372>
Replying to kyu.168’s Message
Reply by kyu.168 | 2024-08-15 16:39:48
yes I followed this tutorial to modify that push to talk blueprint: https://www.youtube.com/watch?v=HHhkBd6NOlo, but the controls to talk to convai API are not working on Oculus Quest 3 now.
Reply by freezfast | 2024-08-15 17:11:09
Hi <@961499420199890944>, perhaps the controller event is not being triggered properly? try to link it with a simple print text to see if there is any signal coming in from the control to the engine
Reply by freezfast | 2024-08-15 17:11:45
does not need to trigger the start talking or finish talking functions of Convai, just a simple test that the engine can actually sense the button triggering
Reply by kyu.168 | 2024-08-15 21:28:34
Hi <@365628745886859267> I’ve tried it and it’s able to print text. Do you guys have an Unreal VR base file setup with Convai I can use as a starting point to see where I went wrong?
Reply by freezfast | 2024-08-15 22:33:47
not at the moment, so now that the trigger is verified to be working (both when pressed and released) then the issue might stem from the character itself, try connecting back the T key and see if the character is working
Reply by kyu.168 | 2024-08-16 01:50:22
okay what I’ll do is rebuild the project from scratch and put down the steps here.
Reply by kyu.168 | 2024-08-19 13:33:14
The project is currently working. What I missed out was Voice bEnabled=true in the config.
Reply by kyu.168 | 2024-08-19 13:33:23
How do I mark this as resolved? thanks!
Reply by k3kalinix | 2024-08-19 13:34:10
I did.
Reply by k3kalinix | 2024-08-19 13:34:41
<@961499420199890944>
If you have any other questions, please do not hesitate to ask.
We would be very grateful if you could leave a comment on our store pages with your company name or the name of your project. We value your feedback and comments as they help us improve our services and products.
https://www.unrealengine.com/marketplace/en-US/product/convai/reviews
Embedded Content:
AI for NPC, MetaHuman - Dialog, actions and general intelligence - …
Convai powers NPCs with human-like intelligence.
Link: https://www.unrealengine.com/marketplace/en-US/product/convai/reviews
This conversation happened on the Convai Discord Server, so this post will be closed.
