Original Discord Post by eggman28 | 2024-01-23 10:42:19
Has anyone added passthrough to their Unity scene with the Convai package from Asset Store ?
Seems like it should be possible with Met’s OpenXR support now - Explore cross-platform mixed reality development on Meta Quest 3
I followed these steps and I just see the scene with a black background instead of passthrough when I built to test on device - Project setup | Unity OpenXR Meta | 0.2.1
(I wasn’t able to change the “Tracked Pose Driver” compoent though as I don’t see the “centerEyePosition [XR HMD]” specified.
This is a question about Unity / Oculus MR rather than Convai.
Unfortunately, I personally haven’t started working on MR yet.
I think you can get an answer if you ask this question on the Unity forum channel or Discord channel.
Or if there is a tutorial about it on youtube, you can follow it.
I created a new Unity project, added Meta’s SDK first via Package Mgr, configured it as per normal XR project, then added Convai SDK.
Loaded up a character scene, added Camera Rig and Passthrough via Meta’s Building Blocks.
Moved the Camera Rig to the “Convai Player Character”, disabled the camera there, added the “Convai NPC Manager” script that was on the previous camer to that gameobject.
Hid the plane mesh renderer and that was it.
I had to play around with the character’s scale (1.25 is shown in video) and transform (Y 1.08)
There would be more required to make it work better with Quest like adding touch controller button for talk trigger (demo recorded with connected BT keyboard and pressing T) , making the UIs visible with World Scale…
Reply by eggman28 | 2024-01-24 19:25:28
There would be more required to make it work better with Quest like adding touch controller button for talk trigger (demo recorded with connected BT keyboard and pressing T) , making the UIs visible with World Scale…
Reply by eggman28 | 2024-01-24 19:25:28
There would be more required to make it work better with Quest like adding touch controller button for talk trigger (demo recorded with connected BT keyboard and pressing T) , making the UIs visible with World Scale…
Reply by eggman28 | 2024-01-24 19:30:09
Trying that now. I can add Gamepad button but don’t see anything for XR Controller. Will try that and see if it works.
