Convai Character Not Responding to Text or Voice Input in UE 5.6 VR Project

[Project_Account]

We are developing a VR mock interview system in Unreal Engine 5.6 using the VR Template and MetaHuman characters.
We added the Convai plugin and connected a character using Character ID:
1298e5ce-543b-11f1-a860-42010a7be02e
Initially the character worked properly for both text and microphone input, but after reopening the project the character stopped responding completely.
Current issues:

• Typed messages disappear after pressing Enter

• No response from character

• Microphone input also does not work

• No AI reply is generated

• Convai UI appears but no interaction happens

• We also arent getting any lipsync animation when the character spoke in our initial test phase.
  We already checked:

• API key

• Character ID

• Plugin enabled

• Internet connection
  Engine Version:
  Unreal Engine 5.6
  Plugin:
  Convai Unreal Engine Plugin
  Please help us identify the issue asap.

OUTPUT LOG -
Cmd: voice.MicNoiseGateThreshold 0.01
voice.MicNoiseGateThreshold = “0.01”
Cmd: voice.SilenceDetectionThreshold 0.001
voice.SilenceDetectionThreshold = “0.001”
ConvaiPlayerLog: Registered with ConvaiSubsystem and bound to server connection state changes
PIE: Server logged in
PIE: Play in editor total start time 0.151 seconds.
ConvaiSubsystemLog: OnConnectedToServer called
ConvaiReferenceAudioThread: ConvaiReferenceAudioThread created with chunk size: 480
ConvaiReferenceAudioThread: ConvaiReferenceAudioThread initialized
ConvaiReferenceAudioThread: ConvaiReferenceAudioThread started running
ConvaiReferenceAudioThread: Reference audio capture started
ConvaiSubsystemLog: Started reference audio capture thread
ConvaiPlayerLog: Server connection state changed: 2
ConvaiPlayerLog: Server connected and auto-initialize enabled - starting session
ConvaiPlayerLog: Started Streaming Audio
ConvaiAudioLog: Using Microphone (3- High Definition Audio Device) as Audio capture device with NumChannels:2 and SampleRate:44100
LogAudioCaptureCore: Display: WasapiCapture AudioFormat SampeRate: 44100, BitDepth: 32-Bit Floating Point
ConvaiPlayerLog: Started default audio capture
ConvaiChatbotComponentLog: OnConnectedToServer
ConvaiSubsystemLog: Attendee connected: convai-bot
ConvaiChatbotComponentLog: OnAttendeeConnected
LogViewport: Display: Viewport MouseLockMode Changed, LockOnCapture → LockAlways
LogViewport: Display: Viewport HideCursorDuringCapture Changed, False → True
LogViewport: Display: Viewport MouseCaptureMode Changed, CapturePermanently_IncludingInitialMouseDown → CaptureDuringMouseDown
ConvaiSubsystemLog: Attendee ID: convai-bot, Data: {“data”:{“about”:{“library”:“pipecat-ai”,“library_version”:“1.1.0”},“version”:“1.2.0”},“id”:“”,“label”:“rtvi-ai”,“type”:“bot-ready”}
ConvaiSubsystemLog: Attendee ID: convai-bot, Data: {“data”:{“animation”:“neurosync”,“llm_model”:“gemini-3.1-flash-lite”,“llm_provider”:“gemini”,“stt”:“SONIOX”,“tts”:“ConvaiGoogleHttpTTSService”,“type”:“session-config”},“label”:“rtvi-ai”,“type”:“server-message”}
ConvaiSubsystemLog: Warning: OnDataPacketReceived: Unknown server type ‘session-config’.
LogViewport: Display: Viewport MouseLockMode Changed, LockAlways → LockOnCapture
LogViewport: Display: Viewport MouseCaptureMode Changed, CaptureDuringMouseDown → CapturePermanently
ConvaiFaceSyncLog: ConvaiStopLipSync: Stopping lipsync - bIsPlaying: false, bIsPaused: false, TotalFrames: 0, FramesRemaining: 0, TotalDuration: 0.000, TimePlayed: 0.000, TimeRemaining: 0.000, TotalPausedDuration: 0.000
ConvaiChatbotComponentLog: Character interrupted by user speaking
LogViewport: Display: Viewport MouseLockMode Changed, LockOnCapture → LockAlways
LogViewport: Display: Viewport MouseCaptureMode Changed, CapturePermanently → CaptureDuringMouseDown
LogViewport: Display: Viewport MouseLockMode Changed, LockAlways → LockOnCapture
LogViewport: Display: Viewport MouseCaptureMode Changed, CaptureDuringMouseDown → CapturePermanently
ConvaiFaceSyncLog: ConvaiStopLipSync: Stopping lipsync - bIsPlaying: false, bIsPaused: false, TotalFrames: 0, FramesRemaining: 0, TotalDuration: 0.000, TimePlayed: 0.000, TimeRemaining: 0.000, TotalPausedDuration: 0.000
ConvaiChatbotComponentLog: Character interrupted by user speaking
LogSlate: Updating window title bar state: overlay mode, drag disabled, window buttons hidden, title bar hidden
LogWorld: BeginTearingDown for /Game/VRTemplate/Maps/UEDPIE_0_VRTemplateMap
LogCrowdFollowing: Warning: Unable to find RecastNavMesh instance while trying to create UCrowdManager instance
ConvaiFaceSyncLog: ConvaiStopLipSync: Stopping lipsync - bIsPlaying: false, bIsPaused: false, TotalFrames: 0, FramesRemaining: 0, TotalDuration: 0.000, TimePlayed: 0.000, TimeRemaining: 0.000, TotalPausedDuration: 0.000
ConvaiConnectionManagerLog: Character [1298e5ce-543b-11f1-a860-42010a7be02e]: Connection released — TTL is 0, disconnecting immediately
ConvaiSubsystemLog: Attendee disconnected via session disconnect: convai-bot
ConvaiSubsystemLog: Disconnecting character session
ConvaiChatbotComponentLog: Session stopped for character ID: 1298e5ce-543b-11f1-a860-42010a7be02e
ConvaiPlayerLog: Stopped Streaming Audio
ConvaiSubsystemLog: Disconnecting player session
ConvaiReferenceAudioThread: Stopped recording reference audio
ConvaiReferenceAudioThread: Reference audio capture stopped
ConvaiReferenceAudioThread: Warning: Reference audio capture not active
ConvaiReferenceAudioThread: ConvaiReferenceAudioThread stop requested
ConvaiReferenceAudioThread: ConvaiReferenceAudioThread stopped running
ConvaiReferenceAudioThread: ConvaiReferenceAudioThread exiting
ConvaiReferenceAudioThread: Warning: Reference audio capture not active
ConvaiReferenceAudioThread: ConvaiReferenceAudioThread stop requested
ConvaiReferenceAudioThread: ConvaiReferenceAudioThread destroyed
ConvaiSubsystemLog: Stopped and cleaned up reference audio capture thread
LogWorld: UWorld::CleanupWorld for VRTemplateMap, bSessionEnded=true, bCleanupResources=true
LogSlate: InvalidateAllWidgets triggered. All widgets were invalidated
LogPlayLevel: Display: Shutting down PIE online subsystems
LogSlate: InvalidateAllWidgets triggered. All widgets were invalidated
LogScript: Warning: Script Msg: No world was found for object (/Game/VRTemplate/Maps/UEDPIE_0_VRTemplateMap.VRTemplateMap:PersistentLevel.VRPawn_C_1.BP_ConvaiPlayerComponent.ConvaiConnectionSessionProxy_0) passed in to UEngine::GetWorldFromContextObject().
ConvaiUtilsLog: Warning: Could not get pointer to a GameInstance
LogScript: Warning: Script Msg: No world was found for object (/Engine/Transient.UnrealEdEngine_0:GameInstance_14.ConvaiSubsystem_0.ConvaiConnectionSessionProxy_0) passed in to UEngine::GetWorldFromContextObject().
ConvaiUtilsLog: Warning: Could not get pointer to a GameInstance
LogSlate: Updating window title bar state: overlay mode, drag disabled, window buttons hidden, title bar hidden
LogScript: Warning: Script Msg: No world was found for object (/Game/VRTemplate/Maps/UEDPIE_0_VRTemplateMap.VRTemplateMap:PersistentLevel.VRPawn_C_1.BP_ConvaiPlayerComponent) passed in to UEngine::GetWorldFromContextObject().
ConvaiUtilsLog: Warning: Could not get pointer to a GameInstance
LogAudioMixer: Deinitializing Audio Bus Subsystem for audio device with ID 16
LogAudioMixer: Display: FMixerPlatformXAudio2::StopAudioStream() called. InstanceID=16, StreamState=4
LogAudioMixer: Display: FMixerPlatformXAudio2::StopAudioStream() called. InstanceID=16, StreamState=2
LogUObjectHash: Compacting FUObjectHashTables data took 1.09ms
LogActorComponent: ReregisterComponent: (/Game/VRTemplate/Maps/VRTemplateMap.VRTemplateMap:PersistentLevel.REINST_VRPawn_C_0.TRASH_AudioComponent_1) Not currently registered. Aborting.
LogActorComponent: ReregisterComponent: (/Game/VRTemplate/Maps/VRTemplateMap.VRTemplateMap:PersistentLevel.REINST_VRPawn_C_0.TRASH_ConvaiAudioCaptureComponent_0.AudioComponent_0) Not currently registered. Aborting.
LogActorComponent: ReregisterComponent: (/Game/VRTemplate/Maps/VRTemplateMap.VRTemplateMap:PersistentLevel.REINST_VRPawn_C_0.TRASH_AudioComponent_2) Not currently registered. Aborting.
LogActorComponent: ReregisterComponent: (/Game/VRTemplate/Maps/VRTemplateMap.VRTemplateMap:PersistentLevel.REINST_VRPawn_C_0.TRASH_ConvaiAudioCaptureComponent_1.AudioComponent_1) Not currently registered. Aborting.
LogActorComponent: ReregisterComponent: (/Game/VRTemplate/Maps/VRTemplateMap.VRTemplateMap:PersistentLevel.REINST_VRPawn_C_1.TRASH_AudioComponent_0) Not currently registered. Aborting.
LogActorComponent: ReregisterComponent: (/Game/VRTemplate/Maps/VRTemplateMap.VRTemplateMap:PersistentLevel.REINST_VRPawn_C_0.TRASH_AudioComponent_0) Not currently registered. Aborting.
LogActorComponent: ReregisterComponent: (/Game/VRTemplate/Maps/VRTemplateMap.VRTemplateMap:PersistentLevel.REINST_VRPawn_C_1.TRASH_ConvaiAudioCaptureComponent_42.AudioComponent_1) Not currently registered. Aborting.
LogActorComponent: ReregisterComponent: (/Game/VRTemplate/Maps/VRTemplateMap.VRTemplateMap:PersistentLevel.REINST_VRPawn_C_1.TRASH_ConvaiAudioCaptureComponent_44.AudioComponent_1) Not currently registered. Aborting.
LogActorComponent: ReregisterComponent: (/Game/VRTemplate/Maps/VRTemplateMap.VRTemplateMap:PersistentLevel.REINST_VRPawn_C_1.TRASH_ConvaiAudioCaptureComponent_43.AudioComponent_1) Not currently registered. Aborting.
LogActorComponent: ReregisterComponent: (/Game/VRTemplate/Maps/VRTemplateMap.VRTemplateMap:PersistentLevel.REINST_VRPawn_C_2.TRASH_ConvaiAudioCaptureComponent_8.AudioComponent_1) Not currently registered. Aborting.
LogActorComponent: ReregisterComponent: (/Game/VRTemplate/Maps/VRTemplateMap.VRTemplateMap:PersistentLevel.REINST_VRPawn_C_2.TRASH_ConvaiAudioCaptureComponent_9.AudioComponent_1) Not currently registered. Aborting.
LogActorComponent: ReregisterComponent: (/Game/VRTemplate/Maps/VRTemplateMap.VRTemplateMap:PersistentLevel.REINST_VRPawn_C_4.TRASH_ConvaiAudioCaptureComponent_0.AudioComponent_0) Not currently registered. Aborting.
LogActorComponent: ReregisterComponent: (/Game/VRTemplate/Maps/VRTemplateMap.VRTemplateMap:PersistentLevel.REINST_VRPawn_C_3.TRASH_ConvaiAudioCaptureComponent_7.AudioComponent_1) Not currently registered. Aborting.
LogActorComponent: ReregisterComponent: (/Game/VRTemplate/Maps/VRTemplateMap.VRTemplateMap:PersistentLevel.REINST_VRPawn_C_3.TRASH_ConvaiAudioCaptureComponent_6.AudioComponent_1) Not currently registered. Aborting.
LogActorComponent: ReregisterComponent: (/Game/VRTemplate/Maps/VRTemplateMap.VRTemplateMap:PersistentLevel.REINST_VRPawn_C_4.TRASH_ConvaiAudioCaptureComponent_1.AudioComponent_1) Not currently registered. Aborting.
LogActorComponent: ReregisterComponent: (/Game/VRTemplate/Maps/VRTemplateMap.VRTemplateMap:PersistentLevel.REINST_VRPawn_C_4.TRASH_ConvaiAudioCaptureComponent_2.AudioComponent_1) Not currently registered. Aborting.
LogPlayLevel: Display: Destroying online subsystem :Context_47

[K3]

I tested this on my side, and it appears to be working correctly.

Could you please share the full logs so we can review the issue in more detail?

[Project_Account]

The character is working on website but not on unreal engine 5.6 , like we posted in the video previously
here are the output logs-
LogStatsconvai.pdf (376.4 KB)

[K3]

I couldn’t see the issue clearly in the video. The video ends right after you send the message.

Also, based on the logs, it does not look like any interaction is being made with the character.

Could you please try sending a message to the character through the chatbox and share the result?

[Project_Account]

As you can see the character is not taking any inputs, neither audio nor text input, also after sometime it automatically got disconnected.

We have checked the character ID and correct API key, why are the inputs not being taken? And maybe that’s why it is not appearing in the output log as well .

Also , as you can see in the image no sessions are being recorded , whereas when initially it had worked, every session entry was recorded on the website in character’s memory section.

Please kindly look into it. Thank you

[K3]

Could you please share the logs from the Convai Editor UI?

You can export them by going to: Convai Editor → Settings → Export Logs

[Project_Account]

The Convai logs and Engine logs file were empty, we have shared all the rest of the files to you.
Please kindly look into it. Thank you.

[K3]

The most important logs appear to be missing or empty, so we are not able to fully investigate the issue yet.

Could you please let us know which version of the Convai plugin you are using?

[Project_Account]

MyProject56_20260521_112127_Default.log (972 Bytes)
MyProject56_20260521_112559_Default.log (358 Bytes)
MyProject56_20260521_112953_Default.log (174.9 KB)
MyProject56_20260521_130638_Default.log (14.4 KB)
MyProject56_20260521_135131_Default.log (14.3 KB)
MyProject56_20260521_140423_Default.log (26.2 KB)
MyProject56_20260521_152106_Default.log (76.9 KB)

We found this another Convai logs folder , please check if these are the missing ones. Also the version we are using is 4.00-beta.15 . Thank you

[K3]

Which Convai account does the API key you are using belong to?

[Project_Account]

vr22project2526@gmail.com

this is the email of the convai account who’s API key we are using in project

[K3]

I tested this character using your API key, and it is working correctly on my side.

My recommendation is to create a new project and test it there. In your project directory, create a Plugins folder, then download the latest version from the link below. After downloading, move the Convai folder from the downloaded files into your project’s Plugins folder and test again.

Releases · Conv-AI/Convai-UnrealEngine-SDK-V4

[Project_Account]

As you can see, its still not working.
We followed this exact steps:-
1.Downloaded the Convai plugn 5.6 on github link you provided.

2.Created a new project in Virtual Reality Template (since we are working on VR project). And in plugins we added the convai plugin and connected it with our account.

3. Downloaded metahuman preset and added it to scene and made changes in blueprints like adding chatbot component and facesync component and convai animation to body and face.

Changed the class to pawn because it gave warning if we kept it as Convai Base Character.

4. Added a VRpawn component from vrtemplate and added the BP convai player .
   

   

5. Then we started the play button, and tried giving text input but as you can see in the video it is not working.

Output log:-
LogStatsconvai2.pdf (406.3 KB)
Mockverse_20260522_110226_Default.log (358 Bytes)
Mockverse_20260522_111213_Default.log (358 Bytes)
Mockverse_20260522_112722_Default.log (43.4 KB)
Mockverse_20260522_123258_Default.log (911 Bytes)
Mockverse_20260522_123407_Default.log (127.9 KB)
Mockverse_20260522_124835_Default.log (29.6 KB)
Mockverse.log (171.1 KB)
Manifest.json (1011 Bytes)
SystemInfo.json (5.7 KB)
ConvaiEditorSettings.pdf (216.0 KB)
DefaultEngine.pdf (243.4 KB)
DefaultGame.pdf (206.9 KB)

Can you please kindly look into it and tell where are we going wrong ? It will be very helpful if you could guide us how you made the project as you said it is working on your side. Thank you .

[K3]

The issue is clearer now.

Please follow the steps shown in this video and apply them exactly as demonstrated:

Real-Time AI Conversations & Facial Animation for MetaHumans | Convai Unreal Engine Tutorial

For now, please do not add or configure anything related to VR. First, confirm that the basic setup works correctly. Once that is working, you can move on to the VR-specific setup.

[Project_Account]

We had tried the exact steps as shown in the video you provided , without any VR components / steps, but it still hadnt worked.
Can you please guide what can we do? Thank you.

[K3]

Did you create a new project?

[Project_Account]

Yes we had created an entire new project, still it wasnt working. What do we do, please guide us, thank you.

[Project_Account]

Our project is finally responding to input
Problem: Character was not responding to inputs and also the text was disappearing from the chat UI. All the settings was done correctly but still issue sustained.

Solution: finally we tried a different internet connection, shifted from ethernet to mobile hotspot and this resolved the issue.

Thanks a lot Convai forum and @K3 for your throughout support and guidance.