Automatically Annotate, Tag & Describe 3D Worlds with Convai Scene Tagger | Unreal Engine Tutorial

Community Guides & Tutorials
, ,
1

Hello everyone,

Building rich, interactive AI experiences means your characters need to understand the world around them. But manually naming, tagging, and describing hundreds of objects across a massive 3D environment to give your AI semantic context is incredibly tedious and time-consuming.

We are thrilled to introduce the Convai Scene Tagger for Unreal Engine! This powerful tool automates the process of generating scene metadata, allowing you to easily equip your AI characters with deep spatial and contextual awareness.

In this tutorial, we use a museum environment to demonstrate how Scene Tagger analyzes your level, identifies significant objects, captures optimal views, and generates context-aware names and descriptions—drastically speeding up your level preparation workflow.

:sparkles: What We Cover in This Tutorial

We walk you through the complete automated tagging workflow from initial scan to live testing:

  • :magnifying_glass_tilted_left: Automated Level Analysis: Configure your character context, optionally plug in Knowledge Bank data, and let the tool scan your entire 3D environment to identify key interactive elements.

  • :writing_hand: Review & Refine Results: Easily review the AI-generated descriptions, correct inaccurate camera captures, and add manual notes to guide better object identification.

  • :hammer_and_wrench: Apply Semantic Data: Push the approved results directly to your project. Scene Tagger will automatically attach and populate Convai Object components with the generated names and descriptions.

  • :test_tube: Live Testing & Debugging: Jump into the tagged scene with a Convai character and use the debug view to verify object information, spatial relationships, and AI scene awareness in real time.

:link: Resources & Documentation

Whether you are building immersive games, large-scale training simulations, or virtual museum guides, Scene Tagger takes the friction out of environment setup. Check out the links below to get started:

How are you handling object interactions and scene awareness in your large-scale Unreal projects? Drop your thoughts, use cases, or technical questions in the replies below!

Happy developing!

2 Likes