Vision Based Conversational AI In Smart Glasses and XR Headsets | Convai Live API MR Demo

Hello everyone!

We are excited to share a showcase demonstrating the capabilities of our New Unity Beta Package in a Mixed Reality (MR) environment.

In this demo, we push the boundaries of how AI characters interact with the real world. You will see a character that is not just “present” but is fully aware of its surroundings and the user.

:fire: Key Highlights in the Video

  • Vision Capabilities: The character sees what you see. It recognizes the environment and reacts to the physical world around you.
  • Hands-Free Interaction: No buttons, no “push-to-talk.” Just a natural, fluid conversation flow.
  • Ultra-Low Latency: The response time is incredibly fast, making the interaction feel real and immersive.

:hammer_and_wrench: Want to build this yourself?

We have also released a full step-by-step tutorial on how to set this up in your own projects using the new Beta package. Check out the tutorial here: