# AI Characters with Streaming Vision Input and Handsfree Interactions | Convai Unreal Engine Tutorial

**URL:** <https://forum.convai.com/t/ai-characters-with-streaming-vision-input-and-handsfree-interactions-convai-unreal-engine-tutorial/5503>\
**Category:** Guides & Tutorials\
**Tags:** tutorials, featured, unreal-engine\
**Created:** [November 25, 2025, 4:09pm UTC](https://forum.convai.com/t/ai-characters-with-streaming-vision-input-and-handsfree-interactions-convai-unreal-engine-tutorial/5503 "2025-11-25T16:09:41Z")\
**Posts on this page:** 1\
**Page:** 1

<div class="post-metadata">

**Author:** ![K3](https://yyz2.discourse-cdn.com/flex004/user_avatar/forum.convai.com/k3/32/2611_2.png) [@K3](https://forum.convai.com/u/K3)\
**Post date:** [November 25, 2025, 4:09pm UTC](https://forum.convai.com/t/ai-characters-with-streaming-vision-input-and-handsfree-interactions-convai-unreal-engine-tutorial/5503/1 "2025-11-25T16:09:41Z")

</div>

Hello everyone,

We are thrilled to introduce the **New Convai Unreal Engine Plugin** , powered by Convai’s latest **Live Character API**.

Built on the **WebRTC protocol** , this update represents a massive leap forward in AI character interaction. It enables ultra-low latency, real-time engagement, and unlocks powerful new capabilities that allow your AI characters to see, remember, and understand their world like never before.

In this video, we take you to a Mars World Demo to showcase these features live in action!

### ✨ Key Features in This Update

- **⚡ WebRTC Powered:** Experience significantly reduced latency for seamless, real-time conversations.

- **👁 Real-Time Vision:** Characters can now “see” dynamic events and objects in the environment and react to them instantly.

- **🧠 Long-Term Memory:** Characters remember past interactions and context, making conversations deeper and more meaningful over time.

- **📚 Multimodal Knowledge:** AI that understands context beyond just text, integrating visual cues into its knowledge base.

- **🗣 Hands-Free Conversation:** Fluid dialogue without the need for push-to-talk inputs.

### 🛠 Step-by-Step Setup Guide

This video is also a complete tutorial. We guide you through the entire process:

1. **Installation:** How to download the new Beta plugin from our **[GitHub Releases](https://github.com/Conv-AI/Convai-UnrealEngine-SDK-V4/releases)** page.

2. **Importing:** Properly importing the plugin into your Unreal Engine project.

3. **Activation:** How to enable the new **Vision** and **Hands-Free** features within the Mars Demo Level.

[![](https://canada1.discourse-cdn.com/flex004/uploads/convai/original/2X/4/4056d9412bd0377454e701e8762cc5a80475c8b4.jpeg "AI Characters with Streaming Vision Input and Handsfree Interactions | Convai Unreal Engine Tutorial") ](https://www.youtube.com/watch?v=HCgVlCKpDvg)

### 🔗 Resources & Download

You can test these features yourself! Download the sample project and the beta plugin from our documentation below:

- **Download & Setup Guide:** [Unreal Engine Plugin Beta Installation and Setup](https://docs.convai.com/api-docs/plugins-and-integrations/unreal-engine-plugin-beta-overview/installation-and-setup)

We are excited to see how you utilize Vision and Memory in your Unreal Engine projects. Let us know your feedback!

Happy developing!