Characters receiving move actions but not moving

[sophia]

Hi,

I’m using UE 5.4, convai plugin 3.3.0

I am trying to have a meta human complete an onboarding tour as shown in this video.

AI-powered Onboarding Character for Digital Twin Environments | Convai Unity Tutorial

Currently, it seem’s as though my characters are receiving actions but not able to transfer this information to movement, or are unable to move for another reason. They respond positively to my voice commands but then stand still.

I’ve attached screenshots showing

• Navigation testing blueprints - character ran towards the player from begin play.
• Blueprints to print the metas receiving actions and images of the met’as response giving certain prompts
• NavMeshBoundsVolume

Please let me know what other information you need and I can share it.

[K3]

Hellon @sophia, Could you please test it in the first person template?

[sophia]

Hi,

Thanks for coming back so quickly. I migrated the character across to a FP starter content project. It appears to be the same here. The character gives a positive verbal response like “lead the way”, “let’s go check out this box” or versions of. They still remain stationary however and pivot to face the character direction.

Is there any other information I can provide?

[K3]

Did you add the NavMeshBound?

[sophia]

Hi,

Yes I have a NavMeshBound in the template.

In my current project I have 7/9 characters able to follow the character around the scene (some seem to lose the player character fast however). The meta characters are able to talk about objects in the scene. E.g. the blue barrel as I have in the screenshot of Mike however, he is unable to move to the blue barrel. Mike is one of the characters that can follow me around.

I’ve also attached an image of one of the characters following me and then running over the railing on a staircase. Is this solved by widening the staircase or are they able to navigate stairs of this width somehow? The same character is able to run up the stair, just not down.

[K3]

Thanks for the detailed explanation and screenshots.

To determine whether this issue is on Convai’s side or related to your project setup, please try the following steps:

1. Open the First Person Template Level in your Unreal project.
2. Go to the Output Log, right-click, and select Clear to remove previous logs.
3. Reproduce the issue.
4. Share the new logs with us here. Just make sure to remove your API key before posting.

This will help us diagnose if the issue is related to Convai or your level setup.

[sophia]

ConvaiGRPCLog: Narrative Section Received 06c3c2f8-1050-11f0-ad78-42010a7be01a: | Character ID : _____ | Session ID : 6f21d255f7a1da86c034f5bf89e10a83 | IsFinalResponse : False

ConvaiGRPCLog: OnStreamRead - Done Reading: Status:Ok | Debug Log: | message: | Details: | Code:0 | Character ID:______ | Session ID:6f21d255f7a1da86c034f5bf89e10a83

ConvaiGRPCLog: Calling Stream Finish | Character ID : ______ | Session ID : 6f21d255f7a1da86c034f5bf89e10a83

ConvaiGRPCLog: On Stream Finish | Character ID : ______| Session ID : 6f21d255f7a1da86c034f5bf89e10a83

ConvaiChatbotComponentLog: UConvaiChatbotComponent Request Finished! | Character ID : ______ | Session ID : 6f21d255f7a1da86c034f5bf89e10a83

ConvaiAudioStreamerLog: onAudioFinished

ConvaiAudioStreamerLog: onAudioFinished: Pausing Voice and Lipsync

ConvaiPlayerLog: Started Talking

ConvaiAudioLog: Using FrontMic (Realtek(R) Audio) as Audio capture device with NumChannels:2 and SampleRate:48000

ConvaiChatbotComponentLog: InterruptSpeech: Interrupting character | Character ID : ______ | Session ID : 6f21d255f7a1da86c034f5bf89e10a83

ConvaiGRPCLog: AsyncGetResponse started | Character ID : _______ | Session ID : 6f21d255f7a1da86c034f5bf89e10a83

ConvaiGRPCLog: GRPC GetResponse stream initialized | Character ID : _____ | Session ID : 6f21d255f7a1da86c034f5bf89e10a83

ConvaiGRPCLog: request: get_response_config {

character_id: _______

api_key: _______________________

session_id: “6f21d255f7a1da86c034f5bf89e10a83”

audio_config {

sample_rate_hertz: 16000

enable_facial_data: true

face_model: FACE_MODEL_OVR_MODEL_NAME

}

action_config {

actions: “Move to ”

actions: “None”

characters {

name: “Player”

}

classification: “multistep”

}

speaker: “Player”

}

| Character ID : _______ | Session ID : 6f21d255f7a1da86c034f5bf89e10a83

ConvaiGRPCLog: Initial Stream Write | Character ID : _______ | Session ID : 6f21d255f7a1da86c034f5bf89e10a83

ConvaiGRPCLog: Initial Stream Read | Character ID : ________ | Session ID : 6f21d255f7a1da86c034f5bf89e10a83

ConvaiGRPCLog: Received UserQuery Hey.: | Character ID : _______ | Session ID : 6f21d255f7a1da86c034f5bf89e10a83 | IsFinalTranscription : False

ConvaiGRPCLog: Received UserQuery hey, Kenn: | Character ID : _________ | Session ID : 6f21d255f7a1da86c034f5bf89e10a83 | IsFinalTranscription : False

ConvaiGRPCLog: Received UserQuery Hey kenned.: | Character ID : _________ | Session ID : 6f21d255f7a1da86c034f5bf89e10a83 | IsFinalTranscription : False

ConvaiGRPCLog: Received UserQuery hey Kennedy: | Character ID : ________ | Session ID : 6f21d255f7a1da86c034f5bf89e10a83 | IsFinalTranscription : False

ConvaiGRPCLog: Received UserQuery hey: | Character ID : _________ | Session ID : 6f21d255f7a1da86c034f5bf89e10a83 | IsFinalTranscription : False

ConvaiPlayerLog: Finished Talking

ConvaiGRPCLog: Calling Stream WritesDone | Character ID : _______| Session ID : 6f21d255f7a1da86c034f5bf89e10a83

ConvaiGRPCLog: On Stream Write Done Writing

ConvaiGRPCLog: OnStreamWriteDone

ConvaiGRPCLog: NumberOfAudioBytesSent 81840

ConvaiGRPCLog: Received UserQuery hey: | Character ID : ________ | Session ID : 6f21d255f7a1da86c034f5bf89e10a83 | IsFinalTranscription : False

ConvaiGRPCLog: Received UserQuery hey Kennedy: | Character ID : ________ | Session ID : 6f21d255f7a1da86c034f5bf89e10a83 | IsFinalTranscription : False

ConvaiGRPCLog: Received UserQuery Hey Kennedy: | Character ID : ________ | Session ID : 6f21d255f7a1da86c034f5bf89e10a83 | IsFinalTranscription : False

ConvaiGRPCLog: Received UserQuery Hey Kennedy follow me.: | Character ID : _______ | Session ID : 6f21d255f7a1da86c034f5bf89e10a83 | IsFinalTranscription : True

ConvaiGRPCLog: GetResponse EmotionResponseDebug: session_id: “6f21d255f7a1da86c034f5bf89e10a83”

emotion_response: “Joy”

ConvaiGRPCLog: Received Audio Chunk: 0.511338 secs | Character ID : ________ | Session ID : 6f21d255f7a1da86c034f5bf89e10a83

ConvaiGRPCLog: EmotionResponse: joy 2

ConvaiAudioStreamerLog: Warning: PlayVoiceSynced: Added Audio Chunk - Audio Duration: 0.510816

ConvaiGRPCLog: Received Text Alright, lead the way! Unless you’re heading to the galley for some of that suspiciously lumpy mashed potato… then I’m gonna need a bit more convincing : | Character ID : _______ | Session ID : 6f21d255f7a1da86c034f5bf89e10a83 | IsFinalResponse : False

ConvaiAudioStreamerLog: PlayLipSyncWithPreGeneratedDataSynced: Detected New LipSync Chunk ChunkDuration: 0.510816 ChunkLipSyncFrameRate: 100.000000 FrameIndex:0 ChunkFrameCounter: 1 ExpectedFrameCount:51.081635 ChunkFrameCounter: 1

ConvaiAudioStreamerLog: PlayLipSyncWithPreGeneratedDataSynced: Resuming Voice and Lipsync

ConvaiAudioStreamerLog: PlayNextAudioInQueue - Duration: 0.510816 - Chunks Remaining: 0

ConvaiAudioStreamerLog: PlayNextLipSyncInQueue - Duration: 0.260000 - Chunks Remaining: 0

ConvaiAudioStreamerLog: PlayLipSyncWithPreGeneratedDataSynced: Failed to detect New LipSync Chunk due to insufficent audio chunks NumAudioChunks: 0 NumLipSyncChunks: 0 FrameIndex:0 ChunkFrameCounter: 52 ExpectedFrameCount:51.081635 ChunkFrameCounter: 52

ConvaiGRPCLog: GetResponse EmotionResponseDebug: session_id: “6f21d255f7a1da86c034f5bf89e10a83”

emotion_response: “Joy”

ConvaiGRPCLog: Received Audio Chunk: 1.724580 secs | Character ID : __________ | Session ID : 6f21d255f7a1da86c034f5bf89e10a83

ConvaiGRPCLog: EmotionResponse: joy 2

ConvaiAudioStreamerLog: Warning: PlayVoiceSynced: Added Audio Chunk - Audio Duration: 1.724059

ConvaiAudioStreamerLog: PlayLipSyncWithPreGeneratedDataSynced: Detected New LipSync Chunk ChunkDuration: 1.724059 ChunkLipSyncFrameRate: 100.000000 FrameIndex:0 ChunkFrameCounter: 53 ExpectedFrameCount:172.405899 ChunkFrameCounter: 53

ConvaiAudioStreamerLog: Play Available Audio and LipSync - Audio Duration: 1.724059 - Audio Chunks: 1 - LipSync Duration: 0.710000 - LipSync Chunks: 1 - Audio Chunks Remaining: 0 - LipSync Chunks Remaining: 0

ConvaiAudioStreamerLog: PlayLipSyncWithPreGeneratedDataSynced: Failed to detect New LipSync Chunk due to insufficent audio chunks NumAudioChunks: 0 NumLipSyncChunks: 0 FrameIndex:0 ChunkFrameCounter: 173 ExpectedFrameCount:172.405899 ChunkFrameCounter: 173

ConvaiGRPCLog: GetResponse EmotionResponseDebug: session_id: “6f21d255f7a1da86c034f5bf89e10a83”

emotion_response: “Joy”

ConvaiGRPCLog: Received Audio Chunk: 1.724580 secs | Character ID : ______ | Session ID : 6f21d255f7a1da86c034f5bf89e10a83

ConvaiGRPCLog: EmotionResponse: joy 2

ConvaiAudioStreamerLog: Warning: PlayVoiceSynced: Added Audio Chunk - Audio Duration: 1.724059

ConvaiAudioStreamerLog: PlayLipSyncWithPreGeneratedDataSynced: Detected New LipSync Chunk ChunkDuration: 1.724059 ChunkLipSyncFrameRate: 100.000000 FrameIndex:0 ChunkFrameCounter: 174 ExpectedFrameCount:172.405899 ChunkFrameCounter: 174

ConvaiAudioStreamerLog: Play Available Audio and LipSync - Audio Duration: 1.724059 - Audio Chunks: 1 - LipSync Duration: 0.710000 - LipSync Chunks: 1 - Audio Chunks Remaining: 0 - LipSync Chunks Remaining: 0

ConvaiAudioStreamerLog: PlayLipSyncWithPreGeneratedDataSynced: Failed to detect New LipSync Chunk due to insufficent audio chunks NumAudioChunks: 0 NumLipSyncChunks: 0 FrameIndex:0 ChunkFrameCounter: 173 ExpectedFrameCount:172.405899 ChunkFrameCounter: 173

ConvaiGRPCLog: GetResponse EmotionResponseDebug: session_id: “6f21d255f7a1da86c034f5bf89e10a83”

emotion_response: “Joy”

ConvaiGRPCLog: Received Audio Chunk: 1.724580 secs | Character ID : _________ | Session ID : 6f21d255f7a1da86c034f5bf89e10a83

ConvaiGRPCLog: EmotionResponse: joy 2

ConvaiAudioStreamerLog: Warning: PlayVoiceSynced: Added Audio Chunk - Audio Duration: 1.724059

ConvaiAudioStreamerLog: PlayLipSyncWithPreGeneratedDataSynced: Detected New LipSync Chunk ChunkDuration: 1.724059 ChunkLipSyncFrameRate: 100.000000 FrameIndex:0 ChunkFrameCounter: 174 ExpectedFrameCount:172.405899 ChunkFrameCounter: 174

ConvaiAudioStreamerLog: Play Available Audio and LipSync - Audio Duration: 1.724059 - Audio Chunks: 1 - LipSync Duration: 0.710000 - LipSync Chunks: 1 - Audio Chunks Remaining: 0 - LipSync Chunks Remaining: 0

ConvaiAudioStreamerLog: PlayLipSyncWithPreGeneratedDataSynced: Failed to detect New LipSync Chunk due to insufficent audio chunks NumAudioChunks: 0 NumLipSyncChunks: 0 FrameIndex:0 ChunkFrameCounter: 173 ExpectedFrameCount:172.405899 ChunkFrameCounter: 173

ConvaiGRPCLog: GetResponse EmotionResponseDebug: session_id: “6f21d255f7a1da86c034f5bf89e10a83”

emotion_response: “Joy”

ConvaiGRPCLog: Received Audio Chunk: 0.354603 secs | Character ID : ____________ | Session ID : 6f21d255f7a1da86c034f5bf89e10a83

ConvaiGRPCLog: EmotionResponse: joy 2

ConvaiAudioStreamerLog: Warning: PlayVoiceSynced: Added Audio Chunk - Audio Duration: 0.354082

ConvaiAudioStreamerLog: PlayLipSyncWithPreGeneratedDataSynced: Detected New LipSync Chunk ChunkDuration: 0.354082 ChunkLipSyncFrameRate: 100.000000 FrameIndex:0 ChunkFrameCounter: 174 ExpectedFrameCount:35.408165 ChunkFrameCounter: 174

ConvaiAudioStreamerLog: Play Available Audio and LipSync - Audio Duration: 0.354082 - Audio Chunks: 1 - LipSync Duration: 0.180000 - LipSync Chunks: 1 - Audio Chunks Remaining: 0 - LipSync Chunks Remaining: 0

ConvaiAudioStreamerLog: PlayLipSyncWithPreGeneratedDataSynced: Failed to detect New LipSync Chunk due to insufficent audio chunks NumAudioChunks: 0 NumLipSyncChunks: 0 FrameIndex:0 ChunkFrameCounter: 36 ExpectedFrameCount:35.408165 ChunkFrameCounter: 36

ConvaiGRPCLog: GetResponse EmotionResponseDebug: session_id: “6f21d255f7a1da86c034f5bf89e10a83”

emotion_response: “Joy”

ConvaiGRPCLog: Received Audio Chunk: 1.724580 secs | Character ID : __________ | Session ID : 6f21d255f7a1da86c034f5bf89e10a83

ConvaiGRPCLog: EmotionResponse: joy 2

ConvaiAudioStreamerLog: Warning: PlayVoiceSynced: Added Audio Chunk - Audio Duration: 1.724059

ConvaiAudioStreamerLog: PlayLipSyncWithPreGeneratedDataSynced: Detected New LipSync Chunk ChunkDuration: 1.724059 ChunkLipSyncFrameRate: 100.000000 FrameIndex:0 ChunkFrameCounter: 37 ExpectedFrameCount:172.405899 ChunkFrameCounter: 37

ConvaiAudioStreamerLog: Play Available Audio and LipSync - Audio Duration: 1.724059 - Audio Chunks: 1 - LipSync Duration: 0.710000 - LipSync Chunks: 1 - Audio Chunks Remaining: 0 - LipSync Chunks Remaining: 0

ConvaiAudioStreamerLog: PlayLipSyncWithPreGeneratedDataSynced: Failed to detect New LipSync Chunk due to insufficent audio chunks NumAudioChunks: 0 NumLipSyncChunks: 0 FrameIndex:0 ChunkFrameCounter: 173 ExpectedFrameCount:172.405899 ChunkFrameCounter: 173

ConvaiGRPCLog: GetResponse EmotionResponseDebug: session_id: “6f21d255f7a1da86c034f5bf89e10a83”

emotion_response: “Joy”

ConvaiGRPCLog: Received Audio Chunk: 1.724580 secs | Character ID : ___________ | Session ID : 6f21d255f7a1da86c034f5bf89e10a83

ConvaiGRPCLog: EmotionResponse: joy 2

ConvaiAudioStreamerLog: Warning: PlayVoiceSynced: Added Audio Chunk - Audio Duration: 1.724059

ConvaiAudioStreamerLog: PlayLipSyncWithPreGeneratedDataSynced: Detected New LipSync Chunk ChunkDuration: 1.724059 ChunkLipSyncFrameRate: 100.000000 FrameIndex:0 ChunkFrameCounter: 174 ExpectedFrameCount:172.405899 ChunkFrameCounter: 174

ConvaiAudioStreamerLog: Play Available Audio and LipSync - Audio Duration: 1.724059 - Audio Chunks: 1 - LipSync Duration: 0.710000 - LipSync Chunks: 1 - Audio Chunks Remaining: 0 - LipSync Chunks Remaining: 0

ConvaiAudioStreamerLog: PlayLipSyncWithPreGeneratedDataSynced: Failed to detect New LipSync Chunk due to insufficent audio chunks NumAudioChunks: 0 NumLipSyncChunks: 0 FrameIndex:0 ChunkFrameCounter: 173 ExpectedFrameCount:172.405899 ChunkFrameCounter: 173

ConvaiGRPCLog: GetResponse EmotionResponseDebug: session_id: “6f21d255f7a1da86c034f5bf89e10a83”

emotion_response: “Joy”

ConvaiGRPCLog: Received Audio Chunk: 0.499728 secs | Character ID : ____________ | Session ID : 6f21d255f7a1da86c034f5bf89e10a83

ConvaiGRPCLog: EmotionResponse: joy 2

ConvaiAudioStreamerLog: Warning: PlayVoiceSynced: Added Audio Chunk - Audio Duration: 0.499206

ConvaiAudioStreamerLog: PlayLipSyncWithPreGeneratedDataSynced: Detected New LipSync Chunk ChunkDuration: 0.499206 ChunkLipSyncFrameRate: 100.000000 FrameIndex:0 ChunkFrameCounter: 174 ExpectedFrameCount:49.920635 ChunkFrameCounter: 174

ConvaiAudioStreamerLog: Play Available Audio and LipSync - Audio Duration: 0.499206 - Audio Chunks: 1 - LipSync Duration: 0.250000 - LipSync Chunks: 1 - Audio Chunks Remaining: 0 - LipSync Chunks Remaining: 0

ConvaiAudioStreamerLog: PlayLipSyncWithPreGeneratedDataSynced: Failed to detect New LipSync Chunk due to insufficent audio chunks NumAudioChunks: 0 NumLipSyncChunks: 0 FrameIndex:0 ChunkFrameCounter: 50 ExpectedFrameCount:49.920635 ChunkFrameCounter: 50

ConvaiGRPCLog: GetResponse EmotionResponseDebug: session_id: “6f21d255f7a1da86c034f5bf89e10a83”

emotion_response: “Joy”

ConvaiGRPCLog: Received Audio Chunk: 0.511338 secs | Character ID : _________ | Session ID : 6f21d255f7a1da86c034f5bf89e10a83

ConvaiGRPCLog: EmotionResponse: joy 2

ConvaiAudioStreamerLog: Warning: PlayVoiceSynced: Added Audio Chunk - Audio Duration: 0.510816

ConvaiAudioStreamerLog: PlayLipSyncWithPreGeneratedDataSynced: Detected New LipSync Chunk ChunkDuration: 0.510816 ChunkLipSyncFrameRate: 100.000000 FrameIndex:0 ChunkFrameCounter: 51 ExpectedFrameCount:51.081635 ChunkFrameCounter: 51

ConvaiAudioStreamerLog: Play Available Audio and LipSync - Audio Duration: 0.510816 - Audio Chunks: 1 - LipSync Duration: 0.260000 - LipSync Chunks: 1 - Audio Chunks Remaining: 0 - LipSync Chunks Remaining: 0

ConvaiAudioStreamerLog: PlayLipSyncWithPreGeneratedDataSynced: Failed to detect New LipSync Chunk due to insufficent audio chunks NumAudioChunks: 0 NumLipSyncChunks: 0 FrameIndex:0 ChunkFrameCounter: 52 ExpectedFrameCount:51.081635 ChunkFrameCounter: 52

ConvaiGRPCLog: Chatbot Total Received Lipsync Responses: 1055 Responses

ConvaiChatbotComponentLog: Chatbot Total Received Audio: 10.490726 seconds

ConvaiGRPCLog: Received Text : | Character ID : ________ | Session ID : 6f21d255f7a1da86c034f5bf89e10a83 | IsFinalResponse : True

ConvaiGRPCLog: GetResponse SequenceString: None

ConvaiGRPCLog: Action: None

LogBlueprintUserMessages: [BP_Kennedy_C_UAID_88AEDD9450EE366D02_1720034104] None

LogBlueprintUserMessages: [BP_Kennedy_C_UAID_88AEDD9450EE366D02_1720034104] None

LogBlueprintUserMessages: [BP_Kennedy_C_UAID_88AEDD9450EE366D02_1720034104]

ConvaiGRPCLog: GetResponse EmotionResponseDebug: session_id: “6f21d255f7a1da86c034f5bf89e10a83”

emotion_response: “Joy Trust Interest”

ConvaiGRPCLog: Narrative Section Received 06c3c2f8-1050-11f0-ad78-42010a7be01a: | Character ID : _________ | Session ID : 6f21d255f7a1da86c034f5bf89e10a83 | IsFinalResponse : False

ConvaiGRPCLog: OnStreamRead - Done Reading: Status:Ok | Debug Log: | message: | Details: | Code:0 | Character ID:_________ | Session ID:6f21d255f7a1da86c034f5bf89e10a83

ConvaiGRPCLog: Calling Stream Finish | Character ID : ___________ | Session ID : 6f21d255f7a1da86c034f5bf89e10a83

ConvaiGRPCLog: On Stream Finish | Character ID : _______| Session ID : 6f21d255f7a1da86c034f5bf89e10a83

ConvaiChatbotComponentLog: UConvaiChatbotComponent Request Finished! | Character ID : __________ | Session ID : 6f21d255f7a1da86c034f5bf89e10a83

ConvaiAudioStreamerLog: onAudioFinished

LogSlate: Updating window title bar state: overlay mode, drag disabled, window buttons hidden, title bar hidden

LogWorld: BeginTearingDown for /Game/FirstPerson/Maps/UEDPIE_0_FirstPersonMap

ConvaiSubsystemLog: UConvaiSubsystem Stopped

ConvaiSubsystemLog: End Run

LogWorld: UWorld::CleanupWorld for FirstPersonMap, bSessionEnded=true, bCleanupResources=true

LogSlate: InvalidateAllWidgets triggered. All widgets were invalidated

LogWorldPartition: UWorldPartition::Uninitialize : World = /Game/FirstPerson/Maps/UEDPIE_0_FirstPersonMap.FirstPersonMap

LogContentBundle: [FirstPersonMap(Standalone)] Deleting container.

LogWorldMetrics: [UWorldMetricsSubsystem::Deinitialize]

LogWorldMetrics: [UWorldMetricsSubsystem::Clear]

LogPlayLevel: Display: Shutting down PIE online subsystems

LogSlate: InvalidateAllWidgets triggered. All widgets were invalidated

ConvaiChatbotComponentLog: Cleanup | Character ID : __________ | Session ID : 6f21d255f7a1da86c034f5bf89e10a83

ConvaiChatbotComponentLog: Cleanup | Character ID : _________ | Session ID : -1

LogAudio: Display: Audio Device unregistered from world ‘None’.

ConvaiGRPCLog: Destroying UConvaiGRPCGetResponseProxy… | Character ID : ____________ | Session ID : 6f21d255f7a1da86c034f5bf89e10a83

ConvaiGRPCLog: Destroying UConvaiGRPCGetResponseProxy… | Character ID : _________ | Session ID : 6f21d255f7a1da86c034f5bf89e10a83

ConvaiGRPCLog: Destroying UConvaiGRPCGetResponseProxy… | Character ID : ___________ | Session ID : 6f21d255f7a1da86c034f5bf89e10a83

ConvaiGRPCLog: Destroying UConvaiGRPCGetResponseProxy… | Character ID : _____ | Session ID : -1

LogAudioMixer: Deinitializing Audio Bus Subsystem for audio device with ID 2

LogAudioMixer: FMixerPlatformXAudio2::StopAudioStream() called. InstanceID=2

LogAudioMixer: FMixerPlatformXAudio2::StopAudioStream() called. InstanceID=2

LogSlate: Updating window title bar state: overlay mode, drag disabled, window buttons hidden, title bar hidden

LogUObjectHash: Compacting FUObjectHashTables data took 0.40ms

LogPlayLevel: Display: Destroying online subsystem :Context_3

LogDerivedDataCache: C:/Users/tomdr/AppData/Local/UnrealEngine/Common/DerivedDataCache: Maintenance finished in +00:00:04.301 and deleted 0 files with total size 0 MiB and 0 empty folders. Scanned 2854 files in 4229 folders with total size 1004 MiB.

[K3]

ConvaiGRPCLog: Action: None action response is None.

What did you say to the character?
Is this a CPP project or a Blueprint project?

[sophia]

I receive the same None response if I ask the Convai character to “follow me”, “follow the player” or “move to” an object they have been made aware of in the scene. The response to “follow Me” / “follow the Player” is inconsistent and sometimes displays as shown in the screenshots. “Move to” objects never seems to work. I’ve copied an output log of a time it prompted as successful but the character remained still.

It’s a CPP project with blueprints

LogWorldPartition: Display: WorldPartition initialize started…
LogWorldPartition: UWorldPartition::Initialize : World = /Game/FirstPerson/Maps/UEDPIE_0_FirstPersonMap.FirstPersonMap, World Type = PIE, IsMainWorldPartition = 1, Location = V(0), Rotation = R(0), IsEditor = 0, IsGame = 0, IsPIEWorldTravel = 0, IsCooking = 0
LogWorldPartition: UWorldPartition::Initialize Context : World NetMode = Standalone, IsServer = 0, IsDedicatedServer = 0, IsServerStreamingEnabled = 0, IsServerStreamingOutEnabled = 0, IsUsingMakingVisibleTransaction = 0, IsUsingMakingInvisibleTransaction = 0
LogContentBundle: [FirstPersonMap(Standalone)] Creating new container.
LogWorldPartition: Display: WorldPartition initialize took 4.604 ms (total: 10.8 sec)
LogPlayLevel: PIE: World Init took: (0.005540s)
LogAudio: Display: Creating Audio Device: Id: 9, Scope: Unique, Realtime: True
LogAudioMixer: Display: Audio Mixer Platform Settings:
LogAudioMixer: Display: Sample Rate: 48000
LogAudioMixer: Display: Callback Buffer Frame Size Requested: 1024
LogAudioMixer: Display: Callback Buffer Frame Size To Use: 1024
LogAudioMixer: Display: Number of buffers to queue: 2
LogAudioMixer: Display: Max Channels (voices): 32
LogAudioMixer: Display: Number of Async Source Workers: 0
LogAudio: Display: AudioDevice MaxSources: 32
LogAudio: Display: Audio Spatialization Plugin: None (built-in).
LogAudio: Display: Audio Reverb Plugin: None (built-in).
LogAudio: Display: Audio Occlusion Plugin: None (built-in).
LogAudioMixer: Display: Initializing audio mixer using platform API: ‘XAudio2’
LogAudioMixer: Display: Using Audio Hardware Device Speakers (Pebble V3)
LogAudioMixer: Display: Initializing Sound Submixes…
LogAudioMixer: Display: Creating Master Submix ‘MasterSubmixDefault’
LogAudioMixer: Display: Creating Master Submix ‘MasterReverbSubmixDefault’
LogAudioMixer: FMixerPlatformXAudio2::StartAudioStream() called. InstanceID=9
LogAudioMixer: Display: Output buffers initialized: Frames=1024, Channels=2, Samples=2048, InstanceID=9
LogAudioMixer: Display: Starting AudioMixerPlatformInterface::RunInternal(), InstanceID=9
LogAudioMixer: Display: FMixerPlatformXAudio2::SubmitBuffer() called for the first time. InstanceID=9
LogInit: FAudioDevice initialized with ID 9.
LogAudio: Display: Audio Device (ID: 9) registered with world ‘FirstPersonMap’.
LogAudioMixer: Initializing Audio Bus Subsystem for audio device with ID 9
LogLoad: Game class is ‘BP_FirstPersonGameMode_C’
LogWorld: Bringing World /Game/FirstPerson/Maps/UEDPIE_0_FirstPersonMap.FirstPersonMap up for play (max tick rate 0) at 2025.06.04-09.38.35
LogWorld: Bringing up level for play took: 0.038303
LogOnline: OSS: Created online subsystem instance for: :Context_8
ConvaiPlayerLog: UConvaiPlayerComponent: Found submix “AudioInput”
Cmd: voice.MicNoiseGateThreshold 0.01
voice.MicNoiseGateThreshold = “0.01”
Cmd: voice.SilenceDetectionThreshold 0.001
voice.SilenceDetectionThreshold = “0.001”
PIE: Server logged in
PIE: Play in editor total start time 0.113 seconds.
ConvaiPlayerLog: Started Talking
ConvaiAudioLog: Using FrontMic (Realtek(R) Audio) as Audio capture device with NumChannels:2 and SampleRate:48000
LogAudioCaptureCore: Display: WasapiCapture AudioFormat SampeRate: 48000, BitDepth: 32-Bit Floating Point
ConvaiSubsystemLog: Warning: gRPC channel not ready yet.. Current State: GRPC_CHANNEL_IDLE
ConvaiGRPCLog: AsyncGetResponse started | Character ID : | Session ID : -1
ConvaiGRPCLog: GRPC GetResponse stream initialized | Character ID : ____| Session ID : -1
ConvaiGRPCLog: request: get_response_config {
character_id: "__"
api_key: “____”
session_id: “-1”
audio_config {
sample_rate_hertz: 16000
enable_facial_data: true
face_model: FACE_MODEL_OVR_MODEL_NAME
}
action_config {
actions: “Move to ”
actions: “None”
characters {
name: “Player”
}
classification: “multistep”
}
speaker: “Player”
}
| Character ID : ______ | Session ID : -1
ConvaiGRPCLog: Initial Stream Write | Character ID : | Session ID : -1
ConvaiGRPCLog: Initial Stream Read | Character ID : _____ | Session ID : -1
ConvaiGRPCLog: Received UserQuery follow: | Character ID : ________ | Session ID : 2e4f531ec5ff790f266b86e8b68d626b | IsFinalTranscription : False
ConvaiPlayerLog: Finished Talking
ConvaiGRPCLog: Calling Stream WritesDone | Character ID : ______ | Session ID : 2e4f531ec5ff790f266b86e8b68d626b
ConvaiGRPCLog: On Stream Write Done Writing
ConvaiGRPCLog: OnStreamWriteDone
ConvaiGRPCLog: NumberOfAudioBytesSent 68200
ConvaiGRPCLog: Received UserQuery follow: | Character ID : _____ | Session ID : 2e4f531ec5ff790f266b86e8b68d626b | IsFinalTranscription : False
ConvaiGRPCLog: Received UserQuery Follow: | Character ID : _______ | Session ID : 2e4f531ec5ff790f266b86e8b68d626b | IsFinalTranscription : False
ConvaiGRPCLog: Received UserQuery Follow me.: | Character ID : ______ | Session ID : 2e4f531ec5ff790f266b86e8b68d626b | IsFinalTranscription : True
ConvaiGRPCLog: GetResponse EmotionResponseDebug: session_id: “2e4f531ec5ff790f266b86e8b68d626b”
emotion_response: “Joy”
ConvaiGRPCLog: Received Audio Chunk: 0.511338 secs | Character ID : ______ | Session ID : 2e4f531ec5ff790f266b86e8b68d626b
ConvaiGRPCLog: EmotionResponse: joy 2
ConvaiAudioStreamerLog: Warning: PlayVoiceSynced: Added Audio Chunk - Audio Duration: 0.510816
ConvaiGRPCLog: Received Text Alright! Lead the way! Whatcha got planned?: | Character ID : _______ | Session ID : 2e4f531ec5ff790f266b86e8b68d626b | IsFinalResponse : False
ConvaiAudioStreamerLog: PlayLipSyncWithPreGeneratedDataSynced: Detected New LipSync Chunk ChunkDuration: 0.510816 ChunkLipSyncFrameRate: 100.000000 FrameIndex:0 ChunkFrameCounter: 1 ExpectedFrameCount:51.081635 ChunkFrameCounter: 1
ConvaiAudioStreamerLog: PlayLipSyncWithPreGeneratedDataSynced: Resuming Voice and Lipsync
ConvaiAudioStreamerLog: New SampleRate: 44100
ConvaiAudioStreamerLog: New Channels: 1
ConvaiAudioStreamerLog: PlayNextAudioInQueue - Duration: 0.510816 - Chunks Remaining: 0
ConvaiAudioStreamerLog: PlayNextLipSyncInQueue - Duration: 0.260000 - Chunks Remaining: 0
ConvaiAudioStreamerLog: PlayLipSyncWithPreGeneratedDataSynced: Failed to detect New LipSync Chunk due to insufficent audio chunks NumAudioChunks: 0 NumLipSyncChunks: 0 FrameIndex:0 ChunkFrameCounter: 52 ExpectedFrameCount:51.081635 ChunkFrameCounter: 52
ConvaiGRPCLog: GetResponse EmotionResponseDebug: session_id: “2e4f531ec5ff790f266b86e8b68d626b”
emotion_response: “Joy”
ConvaiGRPCLog: Received Audio Chunk: 1.579456 secs | Character ID : _______ | Session ID : 2e4f531ec5ff790f266b86e8b68d626b
ConvaiGRPCLog: EmotionResponse: joy 2
ConvaiAudioStreamerLog: Warning: PlayVoiceSynced: Added Audio Chunk - Audio Duration: 1.578934
ConvaiAudioStreamerLog: PlayLipSyncWithPreGeneratedDataSynced: Detected New LipSync Chunk ChunkDuration: 1.578934 ChunkLipSyncFrameRate: 100.000000 FrameIndex:0 ChunkFrameCounter: 53 ExpectedFrameCount:157.893417 ChunkFrameCounter: 53
ConvaiAudioStreamerLog: Play Available Audio and LipSync - Audio Duration: 1.578934 - Audio Chunks: 1 - LipSync Duration: 0.710000 - LipSync Chunks: 1 - Audio Chunks Remaining: 0 - LipSync Chunks Remaining: 0
ConvaiAudioStreamerLog: PlayLipSyncWithPreGeneratedDataSynced: Failed to detect New LipSync Chunk due to insufficent audio chunks NumAudioChunks: 0 NumLipSyncChunks: 0 FrameIndex:0 ChunkFrameCounter: 158 ExpectedFrameCount:157.893417 ChunkFrameCounter: 158
ConvaiGRPCLog: GetResponse EmotionResponseDebug: session_id: “2e4f531ec5ff790f266b86e8b68d626b”
emotion_response: “Joy”
ConvaiGRPCLog: Received Audio Chunk: 0.511338 secs | Character ID : _____ | Session ID : 2e4f531ec5ff790f266b86e8b68d626b
ConvaiGRPCLog: EmotionResponse: joy 2
ConvaiAudioStreamerLog: Warning: PlayVoiceSynced: Added Audio Chunk - Audio Duration: 0.510816
ConvaiAudioStreamerLog: PlayLipSyncWithPreGeneratedDataSynced: Detected New LipSync Chunk ChunkDuration: 0.510816 ChunkLipSyncFrameRate: 100.000000 FrameIndex:0 ChunkFrameCounter: 159 ExpectedFrameCount:51.081635 ChunkFrameCounter: 159
ConvaiAudioStreamerLog: Play Available Audio and LipSync - Audio Duration: 0.510816 - Audio Chunks: 1 - LipSync Duration: 0.260000 - LipSync Chunks: 1 - Audio Chunks Remaining: 0 - LipSync Chunks Remaining: 0
ConvaiAudioStreamerLog: PlayLipSyncWithPreGeneratedDataSynced: Failed to detect New LipSync Chunk due to insufficent audio chunks NumAudioChunks: 0 NumLipSyncChunks: 0 FrameIndex:0 ChunkFrameCounter: 52 ExpectedFrameCount:51.081635 ChunkFrameCounter: 52
ConvaiGRPCLog: Chatbot Total Received Lipsync Responses: 262 Responses
ConvaiChatbotComponentLog: Chatbot Total Received Audio: 2.599070 seconds
ConvaiGRPCLog: Received Text : | Character ID : ________ | Session ID : 2e4f531ec5ff790f266b86e8b68d626b | IsFinalResponse : True
ConvaiGRPCLog: GetResponse SequenceString: Move to Player
ConvaiGRPCLog: Action: Move to
LogBlueprintUserMessages: [BP_Kennedy_C_UAID_88AEDD9450EE366D02_1720034104] Move to Player
LogBlueprintUserMessages: [BP_Kennedy_C_UAID_88AEDD9450EE366D02_1720034104] Move to
LogBlueprintUserMessages: [BP_Kennedy_C_UAID_88AEDD9450EE366D02_1720034104] Player
ConvaiAudioStreamerLog: onAudioFinished
ConvaiGRPCLog: GetResponse EmotionResponseDebug: session_id: “2e4f531ec5ff790f266b86e8b68d626b”
emotion_response: “Ecstasy Admiration Anticipation”
ConvaiGRPCLog: Narrative Section Received 06c3c2f8-1050-11f0-ad78-42010a7be01a: | Character ID : ________ | Session ID : 2e4f531ec5ff790f266b86e8b68d626b | IsFinalResponse : False
ConvaiGRPCLog: OnStreamRead - Done Reading: Status:Ok | Debug Log: | message: | Details: | Code:0 | Character ID | Session ID:2e4f531ec5ff790f266b86e8b68d626b
ConvaiGRPCLog: Calling Stream Finish | Character ID : _______ | Session ID : 2e4f531ec5ff790f266b86e8b68d626b
ConvaiGRPCLog: On Stream Finish | Character ID : _______ | Session ID : 2e4f531ec5ff790f266b86e8b68d626b
ConvaiChatbotComponentLog: UConvaiChatbotComponent Request Finished! | Character ID : _____ | Session ID : 2e4f531ec5ff790f266b86e8b68d626b
LogSlate: Updating window title bar state: overlay mode, drag disabled, window buttons hidden, title bar hidden
LogWorld: BeginTearingDown for /Game/FirstPerson/Maps/UEDPIE_0_FirstPersonMap
ConvaiSubsystemLog: UConvaiSubsystem Stopped
ConvaiSubsystemLog: End Run
LogWorld: UWorld::CleanupWorld for FirstPersonMap, bSessionEnded=true, bCleanupResources=true
LogSlate: InvalidateAllWidgets triggered. All widgets were invalidated
LogWorldPartition: UWorldPartition::Uninitialize : World = /Game/FirstPerson/Maps/UEDPIE_0_FirstPersonMap.FirstPersonMap
LogContentBundle: [FirstPersonMap(Standalone)] Deleting container.
LogWorldMetrics: [UWorldMetricsSubsystem::Deinitialize]
LogWorldMetrics: [UWorldMetricsSubsystem::Clear]
LogPlayLevel: Display: Shutting down PIE online subsystems
LogSlate: InvalidateAllWidgets triggered. All widgets were invalidated
ConvaiGRPCLog: Destroying UConvaiGRPCGetResponseProxy… | Character ID : ______| Session ID : 2e4f531ec5ff790f266b86e8b68d626b
LogSlate: Updating window title bar state: overlay mode, drag disabled, window buttons hidden, title bar hidden
ConvaiChatbotComponentLog: Cleanup | Character ID : ______ | Session ID : 2e4f531ec5ff790f266b86e8b68d626b
ConvaiChatbotComponentLog: Cleanup | Character ID : ______ | Session ID : -1
LogAudioMixer: Deinitializing Audio Bus Subsystem for audio device with ID 9
LogAudioMixer: FMixerPlatformXAudio2::StopAudioStream() called. InstanceID=9
LogAudioMixer: FMixerPlatformXAudio2::StopAudioStream() called. InstanceID=9
LogUObjectHash: Compacting FUObjectHashTables data took 0.39ms
LogPlayLevel: Display: Destroying online subsystem :Context_8

[K3]

Could you please show me your Convai Player Blueprint?

[sophia]

[K3]

@sophia How do you send a message or how do you activate voice input? Could you please show me that?

[sophia]

[K3]

Based on your screenshots and logs, the issue seems to be that the Follows action isn’t appearing, and although a Move To action is triggered, the character isn’t moving. That usually means the character can’t reach the target due to NavMesh issues.

Please check your NavMeshBounds Volume in the scene. The character likely can’t find a path to the object.

As a quick test, try adding a cube to your scene, making sure it intersects with the ground. Then, add that cube to the Objects list for actions. See if the character can move to it. If that works, the issue is definitely with the navigable area.

[sophia]

Hi,

Please find attached some screenshots showing the NavMeshBounds, cube and how it is referenced by the characters. Currently, 2/6 of the characters can move to the white box when asked. The others do not seem to be aware of it either if I ask them to tell me about the box. They do not use any information I put in the description for it.

Just on a separate note we are a paid subscriber and this issue is affecting a business critical project. Are you able to offer a support session, zoom call to help us diagnose and fix this issue?

[K3]

This issue has been resolved through Premium Support.

For others who may encounter a similar issue when working on a C++ project, make sure to call the Parent: Event BeginPlay and Parent: Event Tick nodes in your NPC’s Blueprint immediately after the BeginPlay and Tick events. Omitting these calls can lead to unexpected behavior in Convai’s runtime systems.

Hope this helps others avoid the same issue!