Demo: It Sees, Navigates, Converses & Acts: Spatially Aware AI NPC Demo in XR | Powered by Convai

Hello everyone,

We are incredibly excited to share our latest Mixed Reality showcase featuring Maya, a 3D AI avatar powered by Convai on the Meta Quest 3.

This isn’t a scripted experience—it’s a live demonstration of how conversational AI and spatial computing have finally merged to create truly interactive and spatially aware digital humans.

:sparkles: Meet Maya: What Can She Do?

Maya brings a new level of presence to XR experiences by fully utilizing Convai’s capabilities alongside the Quest 3’s hardware:

  • :eye: SEE: Using the Quest 3’s passthrough and room mapping, Maya understands exactly where she is in your physical space.

  • :person_walking: NAVIGATE: She doesn’t just stand there. She walks through your real room, avoiding obstacles and navigating around your actual furniture.

  • :speaking_head: CONVERSE: Powered by Convai’s on-device LLM pipeline, you can hold natural, low-latency conversations with her about anything.

  • :bullseye: ACT: Maya can dynamically interact with your environment—from sitting on your physical sofa to placing virtual objects on your real tables.

:goggles: Try It Yourself!

Want to experience Maya’s spatial awareness in your own living room? You can download the APK via the link below and sideload it directly to your Quest 3 to test her out in your own space.

:backhand_index_pointing_right: Download the Quest 3 APK Here

:link: Resources & Deep Dive

To learn more about how we built this and the technologies powering Maya, check out our latest blog post and documentation:

We would love to hear about your experiences testing Maya. Feel free to share your thoughts, videos, or ask any questions in the replies below!

Happy developing!