Pixel stream audio not working with convai

I followed every step here.
Except Audioinput Sound submixer isn’t present in my pc, i.e., UE5.4, so I left it blank in convaiPlayer details which attached in My BP_camera which inherits from ConvaiBasePlayer.

When I disable ‘use pixel stream mic’ it works with the editor or pc mic.

Is there something I am missing here?

Hello @Harman_Singh,

Welcome to the Convai Developer Forum!

It seems you might have overlooked the BaseSubmix field in your setup. Please double-check that you are configuring the BaseSubmix field in the correct location. It’s possible you may have mistakenly checked the Source Effect Chain instead.

If you confirm that the BaseSubmix field is correctly set but the issue persists, let me know, and we’ll investigate further! :blush:

I haven’t changed anything in source effect chain. I believe AudioInput Sound submix isn’t showing might be the causing this.

Can you please tell which submix should i check from the list below, but all submixes are giving the same issue.

I’ve also pasted the output log I’m getting.


ConvaiGRPCLog: Initial Stream Write | Character ID : 484799fe-d264-11ef-b8c7-42010a7be016 | Session ID : -1
ConvaiGRPCLog: Initial Stream Read | Character ID : 484799fe-d264-11ef-b8c7-42010a7be016 | Session ID : -1
ConvaiChatbotComponentLog: Warning: Player timed out | Character ID : 484799fe-d264-11ef-b8c7-42010a7be016 | Session ID : -1
ConvaiGRPCLog: Calling Stream WritesDone | Character ID : 484799fe-d264-11ef-b8c7-42010a7be016 | Session ID : -1
ConvaiGRPCLog: On Stream Write Done Writing
ConvaiGRPCLog: OnStreamWriteDone
ConvaiGRPCLog: NumberOfAudioBytesSent 0
ConvaiGRPCLog: OnStreamRead - Done Reading: Status:Ok | Debug Log: | message: | Details: | Code:0 | Character ID:484799fe-d264-11ef-b8c7-42010a7be016 | Session ID:-1
ConvaiGRPCLog: Calling Stream Finish | Character ID : 484799fe-d264-11ef-b8c7-42010a7be016 | Session ID : -1
ConvaiGRPCLog: Warning: OnStreamFinish: Status:Not Ok | Debug Log: | Error message:No audio data received. Please check your audio input device / microphone. | Error Details: | Error Code:9 | Character ID:484799fe-d264-11ef-b8c7-42010a7be016 | Session ID:-1
ConvaiChatbotComponentLog: Warning: UConvaiChatbotComponent Get Response Failed! | Character ID : 484799fe-d264-11ef-b8c7-42010a7be016 | Session ID : -1
ConvaiChatbotComponentLog: UConvaiChatbotComponent Request Finished! | Character ID : 484799fe-d264-11ef-b8c7-42010a7be016 | Session ID : -1
ConvaiPlayerLog: Finished Talking
LogSlate: Updating window title bar state: overlay mode, drag disabled, window buttons hidden, title bar hidden
LogWorld: BeginTearingDown for /Game/Deftsoft/Levels/UEDPIE_0_Main
LogSlate: Window 'FiveFourLifeLikeAI Preview [NetMode: Standalone 0]  (64-bit/PC D3D SM6)' being destroyed
ConvaiSubsystemLog: UConvaiSubsystem Stopped
ConvaiSubsystemLog: End Run
LogWorld: UWorld::CleanupWorld for Main, bSessionEnded=true, bCleanupResources=true
LogSlate: InvalidateAllWidgets triggered.  All widgets were invalidated
LogWorldMetrics: [UWorldMetricsSubsystem::Deinitialize]
LogWorldMetrics: [UWorldMetricsSubsystem::Clear]
LogPlayLevel: Display: Shutting down PIE online subsystems
LogSlate: InvalidateAllWidgets triggered.  All widgets were invalidated
ConvaiGRPCLog: Destroying UConvaiGRPCGetResponseProxy... | Character ID : 484799fe-d264-11ef-b8c7-42010a7be016 | Session ID : -1
LogAudioMixer: Display: Unregistering submix buffer listener 'PixelStreamingEditorListener' from submix 'MasterSubmixDefault'
LogAudioMixer: Deinitializing Audio Bus Subsystem for audio device with ID 16
LogAudioMixer: FMixerPlatformXAudio2::StopAudioStream() called. InstanceID=16
LogAudioMixer: FMixerPlatformXAudio2::StopAudioStream() called. InstanceID=16
ConvaiChatbotComponentLog: Cleanup | Character ID : 484799fe-d264-11ef-b8c7-42010a7be016 | Session ID : -1
LogUObjectHash: Compacting FUObjectHashTables data took   2.05ms
LogActorComponent: ReregisterComponent: (/Game/Deftsoft/Levels/Main.Main:PersistentLevel.REINST_BP_CameraPawn_C_0.TRASH_AudioComponent_3) Not currently registered. Aborting.
LogActorComponent: ReregisterComponent: (/Game/Deftsoft/Levels/Main.Main:PersistentLevel.REINST_BP_CameraPawn_C_0.TRASH_AudioComponent_8) Not currently registered. Aborting.
LogActorComponent: ReregisterComponent: (/Game/Deftsoft/Levels/Main.Main:PersistentLevel.REINST_BP_CameraPawn_C_5.TRASH_AudioComponent_3) Not currently registered. Aborting.
LogActorComponent: ReregisterComponent: (/Game/Deftsoft/Levels/Main.Main:PersistentLevel.REINST_BP_CameraPawn_C_3.TRASH_AudioComponent_8) Not currently registered. Aborting.
LogActorComponent: ReregisterComponent: (/Game/Deftsoft/Levels/Main.Main:PersistentLevel.REINST_BP_CameraPawn_C_1.TRASH_AudioComponent_3) Not currently registered. Aborting.
LogActorComponent: ReregisterComponent: (/Game/Deftsoft/Levels/Main.Main:PersistentLevel.REINST_BP_CameraPawn_C_1.TRASH_ConvaiAudioCaptureComponent_27.AudioComponent_1) Not currently registered. Aborting.
LogActorComponent: ReregisterComponent: (/Game/Deftsoft/Levels/Main.Main:PersistentLevel.REINST_BP_CameraPawn_C_1.PixelStreamingAudio_REMOVED_0DD656E04C2C291B3439E2A6423F0387.AudioComponent_1) Not currently registered. Aborting.
LogActorComponent: ReregisterComponent: (/Game/Deftsoft/Levels/Main.Main:PersistentLevel.REINST_BP_CameraPawn_C_1.TRASH_PixelStreamingAudioComponent_25.AudioComponent_1) Not currently registered. Aborting.
LogActorComponent: ReregisterComponent: (/Game/Deftsoft/Levels/Main.Main:PersistentLevel.REINST_BP_CameraPawn_C_1.TRASH_AudioComponent_8) Not currently registered. Aborting.
LogActorComponent: ReregisterComponent: (/Game/Deftsoft/Levels/Main.Main:PersistentLevel.REINST_BP_CameraPawn_C_1.TRASH_ConvaiAudioCaptureComponent_33.AudioComponent_1) Not currently registered. Aborting.
LogActorComponent: ReregisterComponent: (/Game/Deftsoft/Levels/Main.Main:PersistentLevel.REINST_BP_CameraPawn_C_2.TRASH_AudioComponent_3) Not currently registered. Aborting.
LogActorComponent: ReregisterComponent: (/Game/Deftsoft/Levels/Main.Main:PersistentLevel.REINST_BP_CameraPawn_C_2.TRASH_AudioComponent_8) Not currently registered. Aborting.
LogActorComponent: ReregisterComponent: (/Game/Deftsoft/Levels/Main.Main:PersistentLevel.REINST_BP_CameraPawn_C_3.TRASH_AudioComponent_3) Not currently registered. Aborting.
LogActorComponent: ReregisterComponent: (/Game/Deftsoft/Levels/Main.Main:PersistentLevel.REINST_BP_CameraPawn_C_4.TRASH_AudioComponent_3) Not currently registered. Aborting.
LogActorComponent: ReregisterComponent: (/Game/Deftsoft/Levels/Main.Main:PersistentLevel.REINST_BP_CameraPawn_C_4.TRASH_AudioComponent_8) Not currently registered. Aborting.
LogActorComponent: ReregisterComponent: (/Game/Deftsoft/Levels/Main.Main:PersistentLevel.REINST_BP_CameraPawn_C_4.TRASH_AudioComponent_17) Not currently registered. Aborting.
LogActorComponent: ReregisterComponent: (/Game/Deftsoft/Levels/Main.Main:PersistentLevel.REINST_BP_CameraPawn_C_5.TRASH_AudioComponent_8) Not currently registered. Aborting.
LogActorComponent: ReregisterComponent: (/Game/Deftsoft/Levels/Main.Main:PersistentLevel.REINST_BP_CameraPawn_C_7.TRASH_AudioComponent_9) Not currently registered. Aborting.
LogActorComponent: ReregisterComponent: (/Game/Deftsoft/Levels/Main.Main:PersistentLevel.REINST_BP_CameraPawn_C_5.TRASH_AudioComponent_17) Not currently registered. Aborting.
LogActorComponent: ReregisterComponent: (/Game/Deftsoft/Levels/Main.Main:PersistentLevel.REINST_BP_CameraPawn_C_7.TRASH_AudioComponent_4) Not currently registered. Aborting.
LogActorComponent: ReregisterComponent: (/Game/Deftsoft/Levels/Main.Main:PersistentLevel.REINST_BP_CameraPawn_C_7.TRASH_AudioComponent_17) Not currently registered. Aborting.
LogActorComponent: ReregisterComponent: (/Game/Deftsoft/Levels/Main.Main:PersistentLevel.REINST_BP_CameraPawn_C_9.TRASH_AudioComponent_7) Not currently registered. Aborting.
LogActorComponent: ReregisterComponent: (/Game/Deftsoft/Levels/Main.Main:PersistentLevel.REINST_BP_CameraPawn_C_9.TRASH_AudioComponent_1) Not currently registered. Aborting.
LogActorComponent: ReregisterComponent: (/Game/Deftsoft/Levels/Main.Main:PersistentLevel.REINST_BP_CameraPawn_C_9.TRASH_PixelStreamingAudioComponent_25.AudioComponent_1) Not currently registered. Aborting.
LogActorComponent: ReregisterComponent: (/Game/Deftsoft/Levels/Main.Main:PersistentLevel.REINST_BP_CameraPawn_C_9.TRASH_ConvaiAudioCaptureComponent_27.AudioComponent_1) Not currently registered. Aborting.

Thank you

Could you please navigate to the following directory in Unreal Engine:

Engine/Plugins/ConvAI/Submixes

Before doing so, ensure that Show Engine Content is enabled in the Content Browser Settings to make this directory visible.

Could you list the Submixes you see in this directory? This will help us verify if the correct ones are present. Let us know if you need assistance! :blush:

This topic was automatically closed 3 days after the last reply. New replies are no longer allowed.