Convai character in MR on Quest 3 with unity. Has anyone done this yet?

Original Discord Post by soulbenders | 2024-08-20 17:36:29

I’m interested if there has been much experience yet with utilizing a Convai character in MR in Unity on the quest 2 and/or 3. I have a nicely functioning character and I’d like to figure out the simplest path to interacting with him in MR on a quest 3 as a demo.

Reply by kyu.168 | 2024-08-21 00:29:16

We’ve started doing this for Metahuman in Unreal Engine but it’s a tedious process so far.

Reply by k3kalinix | 2024-08-21 00:42:35

Hello <@785527608447467520> :wave:t2:,

It is pretty easy.

  • Integrate the Meta Quest SDK or MR Project Template
  • Then integrate Convai.
  • Import Convai VR Package by manually. Documentation
  • Add the Convai Essentials VR prefab to your scene.
  • Add NPCManager and GRPCApi components to your Meta Quest Player.
  • Add the ConvaiHandPanelHolder object to your left hand (you can find it by searching Hiearchy).
  • Remove Convai VR Player.

Embedded Content:
Building for VR | API Docs
Building for VR - Unity Plugin Guide for VR development with Convai.
Link: Building for VR | Documentation

Replying to kyu.168’s Message

Reply by kyu.168 | 2024-08-21 00:29:16
We’ve started doing this for Metahuman in Unreal Engine but it’s a tedious process so far.

Reply by k3kalinix | 2024-08-21 00:43:47

Unity is generally more useful in the XR environment.

Reply by soulbenders | 2024-08-21 19:38:46

When I start a new unity project, which of the core templates should I select to begin? I chose the MR template, but it seems older. not sure if you have had success with a different one? <@1023671043287699568>

Reply by soulbenders | 2024-08-21 20:03:16

Also, Can you link to the “Meta Quest SDK” That you have had success with? The one I’m trying is Meta XR All-in-One SDK | Integration | Unity Asset Store

Embedded Content:
Meta XR All-in-One SDK | Integration | Unity Asset Store
Use the Meta XR All-in-One SDK from Oculus on your next project. Find this integration tool & more on the Unity Asset Store.
Link: Meta XR All-in-One SDK | Integration | Unity Asset Store

Reply by k3kalinix | 2024-08-21 20:06:36

Yes, i said. Convai is compatible with SDKs.

Replying to soulbenders’s Message

Reply by soulbenders | 2024-08-21 19:38:46
When I start a new unity project, which of the core templates should I select to begin? I chose the MR template, but it seems older. not sure if you have had success with a different one? <@1023671043287699568>

Reply by k3kalinix | 2024-08-21 22:28:13

It’s not important. You can use whatever you want.

Reply by soulbenders | 2024-08-23 17:55:35

I’m stuck at Add NPCManager and GRPCApi components to your Meta Quest Player. Is there more detailed instrucitons for this step?

Reply by k3kalinix | 2024-08-23 18:25:01

We haven’t Meta Quest Player.

What do you mean?

Reply by k3kalinix | 2024-08-23 18:25:35

Could you please show me your player object?

Reply by soulbenders | 2024-08-23 18:47:10

I Was working through these steps you outlined above. t is pretty easy.

Integrate the Meta Quest SDK or MR Project Template
Then integrate Convai.
Import Convai VR Package by manually. Documentation
Add the Convai Essentials VR prefab to your scene.
Add NPCManager and GRPCApi components to your Meta Quest Player.
Add the ConvaiHandPanelHolder object to your left hand (you can find it by searching Hiearchy).
Remove Convai VR Player.

Reply by k3kalinix | 2024-08-23 18:48:40

Okay, what is the issue right now?

Reply by soulbenders | 2024-08-23 18:49:03

So, I have followed the other steps up until Add NPCManager and GRPCApi components to your Meta Quest Player.

Reply by soulbenders | 2024-08-23 18:49:11

I do not know how to complete this step

Reply by k3kalinix | 2024-08-23 18:51:09

Okay could you please show me the Hiearchy?

This conversation happened on the Convai Discord Server, so this post will be closed.