# Build Vision based Conversational AI Characters | Convai Unity Tutorial

**URL:** <https://forum.convai.com/t/build-vision-based-conversational-ai-characters-convai-unity-tutorial/5481>\
**Category:** Guides & Tutorials\
**Tags:** tutorials, featured, unity\
**Created:** [November 22, 2025, 4:24pm UTC](https://forum.convai.com/t/build-vision-based-conversational-ai-characters-convai-unity-tutorial/5481 "2025-11-22T16:24:28Z")\
**Posts on this page:** 1\
**Page:** 1

<div class="post-metadata">

**Author:** ![K3](https://yyz2.discourse-cdn.com/flex004/user_avatar/forum.convai.com/k3/32/2611_2.png) [@K3](https://forum.convai.com/u/K3)\
**Post date:** [November 22, 2025, 4:24pm UTC](https://forum.convai.com/t/build-vision-based-conversational-ai-characters-convai-unity-tutorial/5481/1 "2025-11-22T16:24:29Z")

</div>

Hello everyone,

As seen in our **[Showcase Video](https://youtu.be/BCe5p52sBoQ)**, the new Convai Unity Beta Package brings powerful capabilities to Mixed Reality development. In this video, we walk you through **how to set up this package on a fresh project from scratch.**

We show you exactly how to achieve that seamless XR interaction where the character sees the environment and speaks naturally without push-to-talk.

### ✨ What’s New in This Beta?

This Beta introduces improvements designed to make AI character integration smoother and more natural:

- **Hands-Free Conversations:** Enjoy uninterrupted, natural dialogue without manual push-to-talk inputs.
- **Vision Support:** The character is fully aware of the environment (Vision) and sees what the user sees.
- **Low Response Time:** Experience significantly reduced latency for fluid exchanges.
- **Voice Activity Detection (VAD):** Automatically detects when a user is speaking.
- **Lightweight Package:** Optimized architecture that fetches cloud resources dynamically.

### 🛠 The Guide

In the video, we demonstrate the installation on a new project. There are no complex steps—you can get your project ready and running in an MR environment very quickly.

> **⚠ Important Note:** This Beta package is currently designed with a focus on **MR projects**. Features such as _LipSync_ are not supported in this specific version but will be added in upcoming updates.

[![](https://canada1.discourse-cdn.com/flex004/uploads/convai/original/2X/d/dd22e5dc54bcf38c834b38241bd60da942ab19d0.jpeg "Build Vision based Conversational AI Characters | Convai Unity Tutorial") ](https://www.youtube.com/watch?v=cEctYXc5Pe8)

### 🔗 Resources

- **Documentation:** [Unity Plugin Beta Overview](https://docs.convai.com/api-docs/plugins-and-integrations/unity-plugin-beta-overview)
- **Blog Post:** [Unity Vision AI Character Tutorial](https://convai.com/blog/unity-vision-ai-character-tutorial)