Can Unity beta package with vision see rendered virtual scene?

Core Features Language and Speech
, ,
1

Hi there,

I’d been experimenting with the Unity beta package with vision, trying to get it to see the rendered VR scene in my Quest 3 instead of live camera feed in MR mode.

So I’d deactivated the [BuildingBlock] Passthrough gameobject in Unity(which disables passthrough mode in Quest) and set Track Source in the Convai Vision Publisher Meta component of Vision Publisher gameobject to “Source Screenshare” or “Source Screenshare Audio” while Capture Camera is already set to “CenterEyeAnchor”, hoping that this will enable the vision functionality to process the virtual scene instead.

However this doesn’t work - the AI doesn’t respond to voice prompts any more(seemingly deactivated).

So am I missing something here?

Thanks!

Melvin Eng.