Hello everyone,
We are excited to share a brand-new Unreal Engine tutorial introducing Object in Attention!
When talking to real people in 3D environments, we rarely name every item explicitly—we say things like “How much is that?”, “Tell me about this one”, or “What is the object I’m looking at?”. With Object in Attention, your Convai-powered AI characters can now track user gaze and resolve object context dynamically in real time.
In this tutorial, we demonstrate this feature using a weapon shop scene featuring a Convai MetaHuman avatar. We show the stark contrast between asking questions without attention tracking versus enabling Gaze Attention—where the character immediately understands which object you are focused on and responds accurately.
What You Will Learn in This Video
-
Gaze Attention Tracking: Enable your AI character to know exactly which object in the 3D world the player is looking at. -
Natural Contextual Queries: Allow users to use natural phrasing like “this one”, “that item”, or “how much is that?” without hardcoding named references. -
Unreal Engine 5 Workflow: Step-by-step setup for defining objects, configuring attention components, and connecting them to your Convai MetaHuman. -
Versatile Use Cases: Perfect for developers building retail simulations, digital twins, product showcases, virtual tour guides, training environments, and interactive RPG shopkeepers.
Resources & Documentation
Ready to give your AI characters visual focus? Check out the resources below:
-
Read the Full Blog: Convai Object in Attention: Build AI Players That Know What You’re Looking At -
UE Quick Setup Guide: Watch Convai Unreal Engine Setup Tutorial -
Get the Plugin: Convai Plugin on Fab -
Documentation: Convai Unreal Engine Plugin Overview -
Start Building: Sign up at Convai.com to create interactive AI avatars.
We would love to hear how you plan to use Object in Attention in your virtual worlds! Feel free to share your thoughts or ask technical questions in the replies below.
Happy developing!