# Guides & Tutorials

**URL:** https://forum.convai.com/c/community/tutorials/72.md

[Latest](https://forum.convai.com/latest.md) · [Categories](https://forum.convai.com/categories.md) · [Tags](https://forum.convai.com/tags.md)

---

## [Automatically Annotate, Tag & Describe 3D Worlds with Convai Scene Tagger | Unreal Engine Tutorial](https://forum.convai.com/t/automatically-annotate-tag-describe-3d-worlds-with-convai-scene-tagger-unreal-engine-tutorial/6571)

<div class="topic-metadata">

**Author:** [@K3](https://forum.convai.com/u/K3)\
**Replies:** 0\
**Last updated:** [September 17, 2026, 8:57pm UTC](https://forum.convai.com/t/automatically-annotate-tag-describe-3d-worlds-with-convai-scene-tagger-unreal-engine-tutorial/6571 "2026-09-17T20:57:46Z")

</div>

Hello everyone, Building rich, interactive AI experiences means your characters need to understand the world around them. But manually naming, tagging, and describing hundreds of objects across a massive 3D environment …

---

## [How to Set Up Multiple AI Characters in One Unity Session - Part 1 | Convai Multi-Character Tutorial](https://forum.convai.com/t/how-to-set-up-multiple-ai-characters-in-one-unity-session-part-1-convai-multi-character-tutorial/6562)

<div class="topic-metadata">

**Author:** [@K3](https://forum.convai.com/u/K3)\
**Replies:** 0\
**Last updated:** [September 10, 2026, 9:48am UTC](https://forum.convai.com/t/how-to-set-up-multiple-ai-characters-in-one-unity-session-part-1-convai-multi-character-tutorial/6562 "2026-09-10T09:48:35Z")

</div>

Hello everyone, Populating your world with multiple AI characters brings 3D environments to life, but driving seamless, intent-aware voice interaction across a shared scene requires precise targeting. In Part 1 of our …

---

## [Create an AI Player That Talks, Acts & Uses Game State (Part 2 - Custom Actions)](https://forum.convai.com/t/create-an-ai-player-that-talks-acts-uses-game-state-part-2-custom-actions/6537)

<div class="topic-metadata">

**Author:** [@K3](https://forum.convai.com/u/K3)\
**Replies:** 0\
**Last updated:** [September 2, 2026, 9:39am UTC](https://forum.convai.com/t/create-an-ai-player-that-talks-acts-uses-game-state-part-2-custom-actions/6537 "2026-09-02T09:39:42Z")

</div>

Hello everyone, Following up on Part 1, we are excited to release Part 2 of our AI Teammate tutorial series in Unreal Engine! In this continuation, we extend our Stack-O-Bot AI companion with Custom Convai Actions so it…

---

## [Create Interactive AI Characters in Unity with Convai Actions | Unity 6 AI Tutorial](https://forum.convai.com/t/create-interactive-ai-characters-in-unity-with-convai-actions-unity-6-ai-tutorial/6495)

<div class="topic-metadata">

**Author:** [@K3](https://forum.convai.com/u/K3)\
**Replies:** 0\
**Last updated:** [August 17, 2026, 10:28am UTC](https://forum.convai.com/t/create-interactive-ai-characters-in-unity-with-convai-actions-unity-6-ai-tutorial/6495 "2026-08-17T10:28:26Z")

</div>

Hello everyone, Want your AI characters to do more than just talk? We are excited to release a brand-new tutorial showing you how to set up Convai Actions in Unity 6, enabling your AI avatars to navigate physical space,…

---

## [Convai Dynamic Context in Unreal Engine: Build AI Characters with Live Game State & Scene Awareness](https://forum.convai.com/t/convai-dynamic-context-in-unreal-engine-build-ai-characters-with-live-game-state-scene-awareness/6482)

<div class="topic-metadata">

**Author:** [@K3](https://forum.convai.com/u/K3)\
**Replies:** 0\
**Last updated:** [August 11, 2026, 3:33pm UTC](https://forum.convai.com/t/convai-dynamic-context-in-unreal-engine-build-ai-characters-with-live-game-state-scene-awareness/6482 "2026-08-11T15:33:52Z")

</div>

Hello everyone, We are excited to share a comprehensive step-by-step tutorial on Convai Dynamic Context in Unreal Engine! In this video, we build a shooting-range AI instructor in UE5 that reacts to player actions in r…

---

## [How to Add an AI Player That Reads Live Game State with Convai (Part 1) | Unreal Engine Tutorial](https://forum.convai.com/t/how-to-add-an-ai-player-that-reads-live-game-state-with-convai-part-1-unreal-engine-tutorial/6465)

<div class="topic-metadata">

**Author:** [@K3](https://forum.convai.com/u/K3)\
**Replies:** 0\
**Last updated:** [August 6, 2026, 11:04am UTC](https://forum.convai.com/t/how-to-add-an-ai-player-that-reads-live-game-state-with-convai-part-1-unreal-engine-tutorial/6465 "2026-08-06T11:04:55Z")

</div>

Hello everyone, Ever wanted to build a game state-aware AI companion that can work alongside human players to solve complex puzzles? We are excited to release Part 1 of our two-part tutorial series on how to integrate a…

---

## [Conversational AI Characters for Web Browser With Convai Web SDK, Claude Code and React Three Fiber](https://forum.convai.com/t/conversational-ai-characters-for-web-browser-with-convai-web-sdk-claude-code-and-react-three-fiber/6464)

<div class="topic-metadata">

**Author:** [@K3](https://forum.convai.com/u/K3)\
**Replies:** 0\
**Last updated:** [August 6, 2026, 11:03am UTC](https://forum.convai.com/t/conversational-ai-characters-for-web-browser-with-convai-web-sdk-claude-code-and-react-three-fiber/6464 "2026-08-06T11:03:12Z")

</div>

Hello everyone, Bringing lightweight, interactive 3D AI characters to web browsers without heavy game engine builds is now easier than ever! We are excited to release a brand-new tutorial showing you how to build browse…

---

## [Bring AI Characters to Your Mixed Reality Projects in Meta Quest | Convai Unity 6 XR Tutorial](https://forum.convai.com/t/bring-ai-characters-to-your-mixed-reality-projects-in-meta-quest-convai-unity-6-xr-tutorial/6463)

<div class="topic-metadata">

**Author:** [@K3](https://forum.convai.com/u/K3)\
**Replies:** 0\
**Last updated:** [August 6, 2026, 11:01am UTC](https://forum.convai.com/t/bring-ai-characters-to-your-mixed-reality-projects-in-meta-quest-convai-unity-6-xr-tutorial/6463 "2026-08-06T11:01:34Z")

</div>

Hello everyone, Ever wanted to bring an AI avatar into your physical living room—one that can converse with you, navigate around your actual furniture, and describe details in your real environment? We are excited to s…

---

## [Use Codex, Claude Code, or Cursor to Bring AI Characters in Unity with Convai MCP](https://forum.convai.com/t/use-codex-claude-code-or-cursor-to-bring-ai-characters-in-unity-with-convai-mcp/6462)

<div class="topic-metadata">

**Author:** [@K3](https://forum.convai.com/u/K3)\
**Replies:** 0\
**Last updated:** [August 6, 2026, 10:58am UTC](https://forum.convai.com/t/use-codex-claude-code-or-cursor-to-bring-ai-characters-in-unity-with-convai-mcp/6462 "2026-08-06T10:58:08Z")

</div>

Hello everyone, Prototyping AI characters in Unity just got much faster! We are excited to share a brand-new tutorial showing how to use Convai MCP (Model Context Protocol) to integrate conversational AI avatars into Un…

---

## [How to Add AI Characters to Unity 6 VR Projects (Meta Quest & PCVR) | Convai Unity VR Tutorial](https://forum.convai.com/t/how-to-add-ai-characters-to-unity-6-vr-projects-meta-quest-pcvr-convai-unity-vr-tutorial/6461)

<div class="topic-metadata">

**Author:** [@K3](https://forum.convai.com/u/K3)\
**Replies:** 0\
**Last updated:** [August 6, 2026, 10:56am UTC](https://forum.convai.com/t/how-to-add-ai-characters-to-unity-6-vr-projects-meta-quest-pcvr-convai-unity-vr-tutorial/6461 "2026-08-06T10:56:39Z")

</div>

Hello everyone, Looking to bring interactive 3D AI avatars into Virtual Reality without dealing with rigid dialogue trees? We are excited to share a brand-new tutorial showing you how to add a fully conversational AI ch…

---

## [Bring Conversational AI Avatars to Your Unity Web Projects with Convai](https://forum.convai.com/t/bring-conversational-ai-avatars-to-your-unity-web-projects-with-convai/6460)

<div class="topic-metadata">

**Author:** [@K3](https://forum.convai.com/u/K3)\
**Replies:** 0\
**Last updated:** [August 6, 2026, 10:55am UTC](https://forum.convai.com/t/bring-conversational-ai-avatars-to-your-unity-web-projects-with-convai/6460 "2026-08-06T10:55:11Z")

</div>

Hello everyone, Bringing interactive 3D AI characters to browser-based experiences just became much simpler! We are excited to share our latest tutorial showing you how to set up a Convai-powered Unity Web project (form…

---

## [Use Codex and Claude Code to integrate Embodied AI Agents in Unreal Engine 5.8](https://forum.convai.com/t/use-codex-and-claude-code-to-integrate-embodied-ai-agents-in-unreal-engine-5-8/6459)

<div class="topic-metadata">

**Author:** [@K3](https://forum.convai.com/u/K3)\
**Replies:** 0\
**Last updated:** [August 6, 2026, 10:53am UTC](https://forum.convai.com/t/use-codex-and-claude-code-to-integrate-embodied-ai-agents-in-unreal-engine-5-8/6459 "2026-08-06T10:53:42Z")

</div>

Hello everyone, What if you could build and configure conversational AI characters in Unreal Engine just by prompting an AI coding agent? We are excited to share a brand-new tutorial showing you how to do exactly that u…

---

## [AI Characters That Understand What Users Look At | Convai Object in Attention UE 5.8 Tutorial](https://forum.convai.com/t/ai-characters-that-understand-what-users-look-at-convai-object-in-attention-ue-5-8-tutorial/6458)

<div class="topic-metadata">

**Author:** [@K3](https://forum.convai.com/u/K3)\
**Replies:** 0\
**Last updated:** [August 6, 2026, 10:52am UTC](https://forum.convai.com/t/ai-characters-that-understand-what-users-look-at-convai-object-in-attention-ue-5-8-tutorial/6458 "2026-08-06T10:52:02Z")

</div>

Hello everyone, We are excited to share a brand-new Unreal Engine tutorial introducing Object in Attention! When talking to real people in 3D environments, we rarely name every item explicitly—we say things like “How m…

---

## [Bring AI-Powered 3D Avatars To Your Unreal Engine Virtual Reality Projects | Convai UE5 VR Tutorial](https://forum.convai.com/t/bring-ai-powered-3d-avatars-to-your-unreal-engine-virtual-reality-projects-convai-ue5-vr-tutorial/6457)

<div class="topic-metadata">

**Author:** [@K3](https://forum.convai.com/u/K3)\
**Replies:** 0\
**Last updated:** [August 6, 2026, 10:50am UTC](https://forum.convai.com/t/bring-ai-powered-3d-avatars-to-your-unreal-engine-virtual-reality-projects-convai-ue5-vr-tutorial/6457 "2026-08-06T10:50:06Z")

</div>

Hello everyone, Virtual Reality is transforming hard-skills training, digital twin scenarios, onboarding, and immersive 3D experiences. Today, we are excited to release a step-by-step tutorial on how to bring Convai-pow…

---

## [From Dialogue to Action: Create Scene-Aware AI Characters That Act AND React | Convai Unreal Engine](https://forum.convai.com/t/from-dialogue-to-action-create-scene-aware-ai-characters-that-act-and-react-convai-unreal-engine/6456)

<div class="topic-metadata">

**Author:** [@K3](https://forum.convai.com/u/K3)\
**Replies:** 0\
**Last updated:** [August 6, 2026, 10:48am UTC](https://forum.convai.com/t/from-dialogue-to-action-create-scene-aware-ai-characters-that-act-and-react-convai-unreal-engine/6456 "2026-08-06T10:48:20Z")

</div>

Hello everyone, We are excited to share an updated guide in our Convai Actions series for Unreal Engine 5! In this tutorial, we show you how to enable Convai Actions specifically for MetaHuman avatars, taking them beyon…

---

## [Set Up Convai Analytics MCP with AI Agents Like Claude in Under 60 Seconds](https://forum.convai.com/t/set-up-convai-analytics-mcp-with-ai-agents-like-claude-in-under-60-seconds/6194)

<div class="topic-metadata">

**Author:** [@K3](https://forum.convai.com/u/K3)\
**Replies:** 2\
**Last updated:** [June 12, 2026, 10:08am UTC](https://forum.convai.com/t/set-up-convai-analytics-mcp-with-ai-agents-like-claude-in-under-60-seconds/6194 "2026-06-12T10:08:15Z")

</div>

Hello everyone, Managing and analyzing your AI character interactions just got a whole lot easier! We are excited to introduce the Convai Analytics MCP (Model Context Protocol). In this quick video, we show you how to …

---

## [Trigger Parameterized Actions with Voice Commands in Unreal Engine | Convai Tutorial](https://forum.convai.com/t/trigger-parameterized-actions-with-voice-commands-in-unreal-engine-convai-tutorial/6240)

<div class="topic-metadata">

**Author:** [@K3](https://forum.convai.com/u/K3)\
**Replies:** 0\
**Last updated:** [May 25, 2026, 10:16pm UTC](https://forum.convai.com/t/trigger-parameterized-actions-with-voice-commands-in-unreal-engine-convai-tutorial/6240 "2026-05-25T22:16:33Z")

</div>

Hello everyone, We are excited to release Phase 2 of our Convai Actions tutorial for Unreal Engine! Building on the foundation of our first Actions tutorial, this video dives deeper into creating custom and parameteriz…

---

## [Low-Latency 3D AI Characters in Unity with Real-Time Lip Sync | Convai Unity Tutorial](https://forum.convai.com/t/low-latency-3d-ai-characters-in-unity-with-real-time-lip-sync-convai-unity-tutorial/6192)

<div class="topic-metadata">

**Author:** [@K3](https://forum.convai.com/u/K3)\
**Replies:** 0\
**Last updated:** [May 15, 2026, 11:16am UTC](https://forum.convai.com/t/low-latency-3d-ai-characters-in-unity-with-real-time-lip-sync-convai-unity-tutorial/6192 "2026-05-15T11:16:30Z")

</div>

Hello everyone, We are back with a comprehensive new tutorial for our Unity developers! If you are looking to build fully interactive AI characters with lifelike facial animation and incredibly low latency, this step-by…

---

## [Demo: It Sees, Navigates, Converses & Acts: Spatially Aware AI NPC Demo in XR | Powered by Convai](https://forum.convai.com/t/demo-it-sees-navigates-converses-acts-spatially-aware-ai-npc-demo-in-xr-powered-by-convai/6190)

<div class="topic-metadata">

**Author:** [@K3](https://forum.convai.com/u/K3)\
**Replies:** 0\
**Last updated:** [May 15, 2026, 11:11am UTC](https://forum.convai.com/t/demo-it-sees-navigates-converses-acts-spatially-aware-ai-npc-demo-in-xr-powered-by-convai/6190 "2026-05-15T11:11:21Z")

</div>

Hello everyone, We are incredibly excited to share our latest Mixed Reality showcase featuring Maya, a 3D AI avatar powered by Convai on the Meta Quest 3. This isn’t a scripted experience—it’s a live demonstration of h…

---

## [From Dialogue to Action: Create Scene-Aware AI Characters That Act AND React | Convai Unreal Engine](https://forum.convai.com/t/from-dialogue-to-action-create-scene-aware-ai-characters-that-act-and-react-convai-unreal-engine/6189)

<div class="topic-metadata">

**Author:** [@K3](https://forum.convai.com/u/K3)\
**Replies:** 0\
**Last updated:** [May 15, 2026, 11:04am UTC](https://forum.convai.com/t/from-dialogue-to-action-create-scene-aware-ai-characters-that-act-and-react-convai-unreal-engine/6189 "2026-05-15T11:04:58Z")

</div>

Hello everyone, We are excited to share our latest Unreal Engine tutorial! It is time to move beyond just conversations and bridge the gap between dialogue and gameplay mechanics. In this video, we show you how to crea…

---

## [Convai’s Dynamic Context in UE: Build AI Characters That React To Virtual World Events in Real-Time](https://forum.convai.com/t/convai-s-dynamic-context-in-ue-build-ai-characters-that-react-to-virtual-world-events-in-real-time/6188)

<div class="topic-metadata">

**Author:** [@K3](https://forum.convai.com/u/K3)\
**Replies:** 0\
**Last updated:** [May 15, 2026, 10:56am UTC](https://forum.convai.com/t/convai-s-dynamic-context-in-ue-build-ai-characters-that-react-to-virtual-world-events-in-real-time/6188 "2026-05-15T10:56:42Z")

</div>

Hello everyone, We are incredibly excited to share our latest Unreal Engine 5 tutorial! If you want your AI characters to break free from static scripts and genuinely react to what is happening in your game, this guide …

---

## [Demo: Real-Time Lip Sync & AI Voice Interaction for 3D Avatars (Unity)](https://forum.convai.com/t/demo-real-time-lip-sync-ai-voice-interaction-for-3d-avatars-unity/6040)

<div class="topic-metadata">

**Author:** [@K3](https://forum.convai.com/u/K3)\
**Replies:** 0\
**Last updated:** [April 8, 2026, 5:31pm UTC](https://forum.convai.com/t/demo-real-time-lip-sync-ai-voice-interaction-for-3d-avatars-unity/6040 "2026-04-08T17:31:18Z")

</div>

Hello everyone, We are excited to share a new demo showcasing the power of Convai in Unity! In this video, we feature Susan, a high-fidelity Reallusion CC4 avatar, engaging in a natural, hands-free voice conversation. T…

---

## [Reallusion Avatars with Conversational AI, Real-time Lipsync & Facial Animation | Convai UE Tutorial](https://forum.convai.com/t/reallusion-avatars-with-conversational-ai-real-time-lipsync-facial-animation-convai-ue-tutorial/5804)

<div class="topic-metadata">

**Author:** [@K3](https://forum.convai.com/u/K3)\
**Replies:** 0\
**Last updated:** [February 19, 2026, 11:15am UTC](https://forum.convai.com/t/reallusion-avatars-with-conversational-ai-real-time-lipsync-facial-animation-convai-ue-tutorial/5804 "2026-02-19T11:15:37Z")

</div>

Hello everyone, We are thrilled to share our latest Unreal Engine tutorial! If you are working with high-fidelity avatars, this video shows you exactly how to enable real-time lip sync and facial animation for Reallusio…

---

## [MetaHumans with AI powered Conversation, Lip Sync & Facial Animation | Convai Unreal Engine Tutorial](https://forum.convai.com/t/metahumans-with-ai-powered-conversation-lip-sync-facial-animation-convai-unreal-engine-tutorial/5803)

<div class="topic-metadata">

**Author:** [@K3](https://forum.convai.com/u/K3)\
**Replies:** 0\
**Last updated:** [February 19, 2026, 11:06am UTC](https://forum.convai.com/t/metahumans-with-ai-powered-conversation-lip-sync-facial-animation-convai-unreal-engine-tutorial/5803 "2026-02-19T11:06:50Z")

</div>

Hello everyone, We are excited to share a brand-new tutorial showing you how to integrate Convai with MetaHuman avatars in Unreal Engine. If you want to enable natural, real-time conversations with accurate lip sync and…

---

## [AI Characters with Streaming Vision Input and Handsfree Interactions | Convai Unreal Engine Tutorial](https://forum.convai.com/t/ai-characters-with-streaming-vision-input-and-handsfree-interactions-convai-unreal-engine-tutorial/5503)

<div class="topic-metadata">

**Author:** [@K3](https://forum.convai.com/u/K3)\
**Replies:** 0\
**Last updated:** [November 25, 2025, 4:09pm UTC](https://forum.convai.com/t/ai-characters-with-streaming-vision-input-and-handsfree-interactions-convai-unreal-engine-tutorial/5503 "2025-11-25T16:09:41Z")

</div>

Hello everyone, We are thrilled to introduce the New Convai Unreal Engine Plugin, powered by Convai’s latest Live Character API. Built on the WebRTC protocol, this update represents a massive leap forward in AI charact…

---

## [Build Vision based Conversational AI Characters | Convai Unity Tutorial](https://forum.convai.com/t/build-vision-based-conversational-ai-characters-convai-unity-tutorial/5481)

<div class="topic-metadata">

**Author:** [@K3](https://forum.convai.com/u/K3)\
**Replies:** 0\
**Last updated:** [November 22, 2025, 4:24pm UTC](https://forum.convai.com/t/build-vision-based-conversational-ai-characters-convai-unity-tutorial/5481 "2025-11-22T16:24:29Z")

</div>

Hello everyone, As seen in our Showcase Video, the new Convai Unity Beta Package brings powerful capabilities to Mixed Reality development. In this video, we walk you through how to set up this package on a fresh projec…

---

## [Vision Based Conversational AI In Smart Glasses and XR Headsets | Convai Live API MR Demo](https://forum.convai.com/t/vision-based-conversational-ai-in-smart-glasses-and-xr-headsets-convai-live-api-mr-demo/5480)

<div class="topic-metadata">

**Author:** [@K3](https://forum.convai.com/u/K3)\
**Replies:** 0\
**Last updated:** [November 22, 2025, 4:21pm UTC](https://forum.convai.com/t/vision-based-conversational-ai-in-smart-glasses-and-xr-headsets-convai-live-api-mr-demo/5480 "2025-11-22T16:21:56Z")

</div>

Hello everyone! We are excited to share a showcase demonstrating the capabilities of our New Unity Beta Package in a Mixed Reality (MR) environment. In this demo, we push the boundaries of how AI characters interact wi…
