Actions not getting triggered on ConvAI Chatbot

Original Discord Post by kaaliya. | 2023-11-09 07:01:55

Hello,

I followed the tutorial here: https://www.youtube.com/watch?v=EWBglUB6vsA&list=PLn_7tCx0ChioBLQwZQOvYbpwdzqef_MVd&index=2&t=205s till about 5mins.

But the actions do not fire up when i ask it to pick up something.

My Player BP is derived from the Character class and has a ConvaiPlayer actor component attached to it
The NPC BP is derived from the Actor class and has the ConvaiChatbot actor component

Have attached both my Player and NPC blueprints for reference. Do I have to derive my Player blueprint from Convai Base Player ?

Images:


Reply by k3kalinix | 2023-11-09 07:53:45

Hello <@459245634239594506>, Welcome to Convai Community!

Reply by k3kalinix | 2023-11-09 07:53:47

<@&1163218672580575372>

Replying to kaaliya.'s Message

Reply by kaaliya. | 2023-11-09 07:01:55
Hello,

I followed the tutorial here: https://www.youtube.com/watch?v=EWBglUB6vsA&list=PLn_7tCx0ChioBLQwZQOvYbpwdzqef_MVd&index=2&t=205s till about 5mins.

But the actions do not fire up when i ask it to pick up something.

My Player BP is derived from the Character class and has a ConvaiPlayer actor component attached to it
The NPC BP is derived from the Actor class and has the ConvaiChatbot actor component

Have attached both my Player and NPC blueprints for reference. Do I have to derive my Player blueprint from Convai Base Player ?

Reply by freezfast | 2023-11-09 13:55:41

Hello <@459245634239594506>, could you post the output logs after an interaction. Additionally, we have a more updated tutorial here: https://www.youtube.com/watch?v=cR38a5NgXGU, it could give better guidance on the actions system

Embedded Content:
UE Actions Tutorial (BETA)
Link: https://www.youtube.com/watch?v=cR38a5NgXGU

Replying to freezfast’s Message

Reply by freezfast | 2023-11-09 13:55:41
Hello <@459245634239594506>, could you post the output logs after an interaction. Additionally, we have a more updated tutorial here: https://www.youtube.com/watch?v=cR38a5NgXGU, it could give better guidance on the actions system

Reply by kaaliya. | 2023-11-09 14:59:15

thanks Will check the video, below is the log i get. I removed the API key from the logs.

PIE: Play in editor total start time 0.694 seconds.
LogBlueprintUserMessages: [BP_ConvAIPlayer_C_2] Start Talking
ConvaiPlayerLog: Started Talking
ConvaiAudioLog: Using Microphone Array (Creative GestureCam—) as Audio capture device with NumChannels:2 and SampleRate:48000
LogAudioCaptureCore: Display: WasapiCapture AudioFormat SampeRate: 48000, BitDepth: 32-Bit Floating Point
ConvaiSubsystemLog: Warning: gRPC channel not ready yet… Current State: GRPC_CHANNEL_IDLE
ConvaiGRPCLog: GRPC GetResponse stream initialized
ConvaiGRPCLog: request: get_response_config {
character_id: “36720106-3283-11ee-8365-42010a40000b”
api_key: “xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx”
session_id: “-1”
audio_config {
sample_rate_hertz: 16000
}
action_config {
actions: “Pick up ”
actions: “Administer ”
actions: “None”
characters {
name: “Guest”
}
classification: “multistep”
}
speaker: “Guest”
}
ConvaiPlayerLog: Finished Talking
ConvaiGRPCLog: stream_handler->WriteLast
ConvaiGRPCLog: OnStreamWriteDone
ConvaiGRPCLog: NumberOfAudioBytesSent 50016
ConvaiGRPCLog: stream_handler->Finish
ConvaiGRPCLog: GetResponse SequenceString: None
ConvaiGRPCLog: Action: None
LogBlueprintUserMessages: [BP_Hadley_C_1] None
LogBlueprintUserMessages: [BP_Hadley_C_1] 1 Actions processed,
ConvaiGRPCLog: Debug log:

Reply by kaaliya. | 2023-11-09 16:10:19

Hello, I got it work by setting up the “Environment” variable in Start Talking node

Reply by k3kalinix | 2023-11-09 16:12:30

<@&1163218672580575372> Could you check?

Reply by k3kalinix | 2023-11-10 08:13:57

<@&1163218672580575372>

Reply by k3kalinix | 2023-11-10 11:29:14

<@808164597050638367>

Replying to kaaliya.'s Message

Reply by kaaliya. | 2023-11-09 14:59:15
thanks Will check the video, below is the log i get. I removed the API key from the logs.

PIE: Play in editor total start time 0.694 seconds.
LogBlueprintUserMessages: [BP_ConvAIPlayer_C_2] Start Talking
ConvaiPlayerLog: Started Talking
ConvaiAudioLog: Using Microphone Array (Creative GestureCam—) as Audio capture device with NumChannels:2 and SampleRate:48000
LogAudioCaptureCore: Display: WasapiCapture AudioFormat SampeRate: 48000, BitDepth: 32-Bit Floating Point
ConvaiSubsystemLog: Warning: gRPC channel not ready yet… Current State: GRPC_CHANNEL_IDLE
ConvaiGRPCLog: GRPC GetResponse stream initialized
ConvaiGRPCLog: request: get_response_config {
character_id: “36720106-3283-11ee-8365-42010a40000b”
api_key: “xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx”
session_id: “-1”
audio_config {
sample_rate_hertz: 16000
}
action_config {
actions: “Pick up ”
actions: “Administer ”
actions: “None”
characters {
name: “Guest”
}
classification: “multistep”
}
speaker: “Guest”
}
ConvaiPlayerLog: Finished Talking
ConvaiGRPCLog: stream_handler->WriteLast
ConvaiGRPCLog: OnStreamWriteDone
ConvaiGRPCLog: NumberOfAudioBytesSent 50016
ConvaiGRPCLog: stream_handler->Finish
ConvaiGRPCLog: GetResponse SequenceString: None
ConvaiGRPCLog: Action: None
LogBlueprintUserMessages: [BP_Hadley_C_1] None
LogBlueprintUserMessages: [BP_Hadley_C_1] 1 Actions processed,
ConvaiGRPCLog: Debug log:

Reply by freezfast | 2023-11-10 12:33:21

I don’t see any actions being fired by the AI, try changing the naming and description for the actions, also try with more simple actions such as moves to and follows to see if there are actions coming

This conversation happened on the Convai Discord Server, so this post will be closed.