Hello everyone,
Most AI NPCs in games are purely reactive—a player speaks, and the character responds based on text, with no awareness of what is actually happening in the game world. We are excited to release a new tutorial showing how to use Convai Dynamic Context in Unreal Engine to give your AI characters real-time awareness of live game state, player actions, and environment changes!
In this tutorial, we demonstrate how to feed live game data (such as score, bullets fired, targets hit, or inventory changes) directly into your character’s reasoning layer so they respond naturally based on actual gameplay events rather than static scripts.
Key Features & Workflow Covered
We break down the core Blueprint functions and setup steps needed to build scene-aware AI characters in Unreal Engine:
-
Proactive Speech (Invoke Speech): Trigger greeting messages or orient players automatically upon scene load or specific triggers. -
Discrete Event Notifications (Add Context Event): Send one-time event updates to your character when key actions occur (e.g., player picks up a weapon). -
Persistent State Tracking (Set Context State): Continuously update and track dynamic game variables over time (e.g., keeping a running tally of targets hit and bullets fired to calculate accuracy). -
Response Modes: Configure when your character speaks immediately (Always), decides when to comment (Auto), or silently records data (Never). -
Dynamic Context + Vision: Combine state tracking with camera vision input so your character possesses both situational memory and visual perception of the environment.
Resources & Documentation
Ready to make your NPCs truly aware of your game world? Check out the deep-dive blog post and documentation below:
-
Read the Detailed Blog Post: How to Use Dynamic Context in Convai to Build AI Characters That React in Real Time -
Unreal Engine Documentation: Dynamic Context Inside Unreal Engine -
Get the Plugin: Convai UE Plugin on Fab Marketplace -
Start Building: Sign up at Convai.com to create interactive AI characters.
We would love to see how you leverage live game state in your games, simulations, or digital twins! Share your progress or ask any setup questions in the replies below.
Happy developing!