How to Set Up Multiple AI Characters in One Unity Session - Part 1 | Convai Multi-Character Tutorial

Hello everyone,

Populating your world with multiple AI characters brings 3D environments to life, but driving seamless, intent-aware voice interaction across a shared scene requires precise targeting.

In Part 1 of our Multi-Character Sessions tutorial series for Unity, we bring three distinct Convai AI avatars (Sophia, Ethan, and Marcus) into a single scene and demonstrate how to route player dialogue dynamically based on gaze, proximity, and direct targeting.

:sparkles: What We Cover in Part 1

We walk through setting up your scene and configuring character targeting using the Convai Manager:

  • :busts_in_silhouette: Multi-Character Setup: Assign unique Character IDs to multiple AI avatars within a shared Unity scene.

  • :eye: Look At Selection: Automatically route voice input based on where the player is looking in the 3D space.

  • :round_pushpin: Proximity Selection: Dynamically target characters based on their physical distance from the player.

  • :speaking_head: Fluid Conversation Switching: Transition between individual AI characters in real time without dropping conversation state.

(Note: In Part 2, we will expand this workflow to include all-to-all multi-character awareness, allowing AI characters to perceive and react to ambient conversations happening around them!)

:link: Resources & Documentation

Ready to populate your Unity scenes with multiple interactive AI characters? Check out the resources below to get started:

Whether you’re building living RPG worlds, multiplayer lobbies, or high-fidelity training simulations, multi-character sessions deliver true ambient realism. Drop your technical questions or project showcases in the replies below!

Happy developing!