Accessing and sending Chatbot states from Unreal

Unreal Engine Questions
1

Original Discord Post by martivalles21 | 2024-10-31 14:00:51

I am designing an interactive art installation with multiple monitors. On one of these monitors, the Convai character will be available for people to interact with. The other monitors will display various videos managed by TouchDesigner, as these videos will also be interactive, and TouchDesigner is the software I’m most comfortable with.

My goal is to send data from interactions with the Convai character to trigger different videos in TouchDesigner. From what I’ve researched, it’s possible to send information from Unreal Engine blueprints to TouchDesigner via OSC. In the Convai documentation, I found that the Convai Chatbot has four state functions: “thinking,” “talking,” “listening,” and “in conversation” (attached image found in Convai Chatbot | Documentation). These states seem ideal for my purpose, but I haven’t been able to locate these functions in the blueprints.

I’m new to Unreal Engine, so this might be a simple fix, but I’d really appreciate any guidance to help bring this idea to life :slightly_smiling_face:

Images:

image.jpg
image.jpg1200×656 136 KB

2

Reply by iranpower | 2024-10-31 14:43:06

hello

3

Reply by iranpower | 2024-10-31 14:45:20

do u know how to connect unreal to touch designer using OSC ?

4

Reply by iranpower | 2024-10-31 14:49:29

this is an example of sending message using OSC

Images:

image.png
image.png1621×793 167 KB

5

Reply by iranpower | 2024-10-31 14:49:54

and this is an example of recieving message using OSC

Images:

image.png
image.png1647×640 93.4 KB

6

Reply by iranpower | 2024-10-31 14:50:45

and for the states

7

Reply by iranpower | 2024-10-31 14:51:00

u can find them inside the NPC BP

Images:

image.png
image.png567×418 56.4 KB

8

Reply by martivalles21 | 2024-10-31 23:55:06

Thank you very much. I cannot find the states through the NPC blueprint, could you show me where exactly you find it?

9

Reply by iranpower | 2024-11-01 05:57:56

soo in the NPC blue print, the Ai that u wanna talk to, im assuming your already assigend the class settings to convai base character

10

Reply by iranpower | 2024-11-01 05:58:26

Images:

image.png
image.png1918×638 93.9 KB

11

Reply by iranpower | 2024-11-01 05:58:48

Images:

image.png
image.png1112×647 58.8 KB

12

Reply by iranpower | 2024-11-01 05:58:52

and you added this too

13

Reply by iranpower | 2024-11-01 05:59:23

if u have these u should be able to access them

14

This conversation happened on the Convai Discord Server, so this post will be closed.