Convai NPC mic is disabled when switching OpenXR Unity plugin to 3.0.3

[K3]

Original Discord Post by dominiquewu | 2024-07-06 06:03:46

Hi <@1023671043287699568> , I started a new OpenXR 3.0.3 Unity project to get the best sample scenes with framework, and then I imported Convai plugin (old version of OpenXR). If you see the video, the testing recording works, which means microphone works. However, when I was speaking to the NPC, on the chatbot text panel - microphone icon is disabled, and the NPC is not responding. Anyway to solve the problems - text panel microphone disable, and NPC is not responding? Thank you!

Images:

Attachments:

• Voice_not_working.mp4

[K3]

Reply by dominiquewu | 2024-07-06 06:33:37

XR interaction toolkit examples on Github: GitHub - Unity-Technologies/XR-Interaction-Toolkit-Examples: This repository contains various examples to use with the XR Interaction Toolkit

Embedded Content:
GitHub - Unity-Technologies/XR-Interaction-Toolkit-Examples: This r…
This repository contains various examples to use with the XR Interaction Toolkit - Unity-Technologies/XR-Interaction-Toolkit-Examples
Link: GitHub - Unity-Technologies/XR-Interaction-Toolkit-Examples: This repository contains various examples to use with the XR Interaction Toolkit

[K3]

Reply by k3kalinix | 2024-07-06 07:57:47

Hello, could you please show me console logs?

[K3]

Reply by dominiquewu | 2024-07-06 16:34:35

There’s no error. I successfully built on the Quest headset

[K3]

Reply by dominiquewu | 2024-07-06 16:35:37

at the beginning, the Canvai locomotion was not working, so I switch to new OpenXR locomotion, other than that, no changes.

[K3]

Reply by k3kalinix | 2024-07-06 16:42:42

Good Morning <@666347308165627971>,

[K3]

Reply by dominiquewu | 2024-07-06 16:42:52

Morning! K3

[K3]

Reply by k3kalinix | 2024-07-06 16:43:55

Convai does not have a Locomotion system. We use the XR Interaction Tool Kit.

[K3]

Reply by k3kalinix | 2024-07-06 16:44:19

Basically, we provide the character’s brain. But the rest of the customization is up to you.

[K3]

Reply by k3kalinix | 2024-07-06 16:46:50

I have to see console logs.

[K3]

Reply by dominiquewu | 2024-07-06 16:47:53

I see. I am not on my PC now. I will screenshot to you later. No error on console, only some texture warning. I will send you later. Thank you!

[K3]

Reply by k3kalinix | 2024-07-06 16:49:28

Okay let me know.

[K3]

Reply by dominiquewu | 2024-07-06 17:49:31

Hey <@1023671043287699568> , actually if Convai is the brain, I love to use Meta Quest SDK since I am familiar with the input system. The XR Interaction Tool Kit has new input system which is over complicated. Is that possible to use Meta Quest SDK v67 fo Convai? My only questions is that Convai’s input in one script, using new input system which is - biding T key and Right hand Primary button for Talk action. Is there any way to make it the Quest SDK system (using scripts to call). Any template or previous user shares the solution/URLs for this? Anyone successfully integrates Meta Quest SDK with Convai?

[K3]

Reply by k3kalinix | 2024-07-06 18:00:15

Unity has two types of input systems.

Old and Input Input System. Convai works compatible with these input systems.

As I said before, there are dozens of SDKs for VR. Convai works with all of them.

What you need to do

Having Convai Essentials VR in your scene,

Your have to add,

ConvaiNPCManager
GRPCAPI

to your Character.

You also need to add ConvaiHandPanelHolder to your left hand.

After that, you can remove ConvaiVRPlayer.

However, as we mentioned in our documentation, basic unity knowledge is required.

[K3]

Reply by dominiquewu | 2024-07-06 20:21:29

Thank you for the clarification. As you know, I have art background and only have basic unity knowledge. (Simple coding), do you have any resource for templates or any downloads for Meta Quest SDK integrations. Or anyone can create a very simple like under 5 minutes tutorial for the integrations? Convai use OpenXR, and for me as a Creators, I use Meta Quest SDK. I integrated it - you saw my project, I got a lot of bugs. So if there’s a simple walkthrough for setup, that would be helpful, or templates I can use, that would be great. Let me know if there’s any. Thank you!

[K3]

Reply by k3kalinix | 2024-07-06 21:26:21

These bugs are not bugs related to Convai.

Your project already had issues with package conflicts and existing packages in general.

The easiest way,

• Open a new project.
• Integrate the Meta Quest SDK.
• Then integrate Convai.
• Add the Convai Essentials VR prefab to your scene.
• Add NPCManager and GRPCApi components to your Meta Quest Player.
• Add the ConvaiHandPanelHolder object to your left hand (you can find it by searching Hiearchy).
• Remove Convai VR Player.

When you follow these steps, the problem will be solved. We spent a lot of time helping you with your project, you can take a look at the scene there.

[K3]

Reply by k3kalinix | 2024-07-06 21:29:23

Why don’t you use the old project?

[K3]

Reply by dominiquewu | 2024-07-07 07:23:57

Everything works. Thanks for the instruction. The only thing that is not working is UI, The UI is not showing up on the Meta Quest SDK settings. No errors. Any suggestions?

Images:

[K3]

Reply by k3kalinix | 2024-07-07 21:31:43

Could you please share details?

[K3]

Reply by k3kalinix | 2024-07-07 21:32:19

If you can talk to the character, you should be able to see the user interface.