Hi,
I am new to Convai, I am trying to build an unreal project in Windows for linux shipping and run it on linux. But Convai cannot detect any audio devices in it.
I saw a similar post in Nov 2024 but it did not have any solution for this.
Is there a recommended distro for Convai where everything is tested and runs?
Hello,
Welcome to the Convai Developer Forum!
Could you please share the logs?
ConvaiTest_20251010_164447_Default.log (6.0 KB)
In these logs I just opened the project held [T] tried speaking but the AI said that I was not speaking how can I help all that
I am using Corsair Headphones for both input and output audio. They work perfectly fine and my linux system also detects it
Funny thing is the project is giving me audio as the Avatar speaks
Please do not share your API Key and share all logs.
[16:16:10] ConvaiSubsystemLog : Log : gRPC Creating Channel…
[16:16:10] ConvaiSubsystemLog : Log : Start Run
[16:16:10] ConvaiSubsystemLog : Log : UConvaiSubsystem Started
[16:16:10] ConvaiPlayerLog : Log : UConvaiPlayerComponent: Found submix “AudioInput”
[16:16:10] ConvaiSubsystemLog : Verbose : Registered player component: ConvaiPlayer
[16:16:10] ConvaiSubsystemLog : Verbose : Registered player component: ConvaiPlayer
[16:16:23] ConvaiSubsystemLog : Warning : gRPC channel not ready yet.. Current State: GRPC_CHANNEL_IDLE
[16:16:23] ConvaiGRPCLog : Log : AsyncGetResponse started | Character ID : 1d0a37ce-c9a4-11ef-a59e-42010a7be016 | Session ID : -1
[16:16:24] ConvaiGRPCLog : Log : GRPC GetResponse stream initialized | Character ID : 1d0a37ce-c9a4-11ef-a59e-42010a7be016 | Session ID : -1
[16:16:24] ConvaiGRPCLog : Log : request: character_id: “1d0a37ce-c9a4-11ef-a59e-42010a7be016”
session_id: “-1”
audio_config {
sample_rate_hertz: 16000
enable_facial_data: true
face_model: FACE_MODEL_OVR_MODEL_NAME
}
action_config {
actions: “Moves To”
actions: “Follows”
actions: “None”
actions: “Stops”
actions: “Waits for ”
characters {
name: “Emma Wilson”
}
characters {
name: “Guest”
}
characters {
name: “Player”
}
classification: “multistep”
}
speaker: “Player”
dynamic_info_config {
}
| Character ID : 1d0a37ce-c9a4-11ef-a59e-42010a7be016 | Session ID : -1
[16:16:24] ConvaiGRPCLog : Log : Initial Stream Write | Character ID : 1d0a37ce-c9a4-11ef-a59e-42010a7be016 | Session ID : -1
[16:16:24] ConvaiGRPCLog : Log : Initial Stream Read | Character ID : 1d0a37ce-c9a4-11ef-a59e-42010a7be016 | Session ID : -1
[16:16:24] ConvaiGRPCLog : Log : Sent UserQuery hello how are you just tell me your name only: | Character ID : 1d0a37ce-c9a4-11ef-a59e-42010a7be016 | Session ID : -1
[16:16:24] ConvaiGRPCLog : Log : Calling Stream WriteLast | Character ID : 1d0a37ce-c9a4-11ef-a59e-42010a7be016 | Session ID : -1
[16:16:24] ConvaiGRPCLog : Log : OnStreamWriteDone
[16:16:24] ConvaiGRPCLog : Log : NumberOfAudioBytesSent 0
[16:16:29] ConvaiGRPCLog : Log : GetResponse EmotionResponseDebug: session_id: “1c83a3b7b94ad4f3ca6721300409a8fe”
emotion_response: “Joy”
[16:16:30] ConvaiGRPCLog : Log : Received Audio Chunk: 1.338005 secs | Character ID : 1d0a37ce-c9a4-11ef-a59e-42010a7be016 | Session ID : 1c83a3b7b94ad4f3ca6721300409a8fe
[16:16:30] ConvaiGRPCLog : Log : EmotionResponse: joy 2
[16:16:30] ConvaiAudioStreamerLog : Log : State transition: Stopped → WaitingOnLipSync
[16:16:30] ConvaiGRPCLog : Log : Received Text Emily Wilson! : | Character ID : 1d0a37ce-c9a4-11ef-a59e-42010a7be016 | Session ID : 1c83a3b7b94ad4f3ca6721300409a8fe | ReceivedFinalResponse : False
[16:16:30] ConvaiAudioStreamerLog : Log : New SampleRate: 44100
[16:16:30] ConvaiAudioStreamerLog : Log : New Channels: 1
[16:16:30] ConvaiAudioStreamerLog : Log : State transition: WaitingOnLipSync → Playing
[16:16:30] ConvaiAudioStreamerLog : Log : State transition: Playing → WaitingOnAudio
[16:16:30] ConvaiGRPCLog : Log : GetResponse EmotionResponseDebug: session_id: “1c83a3b7b94ad4f3ca6721300409a8fe”
emotion_response: “Joy”
[16:16:30] ConvaiGRPCLog : Log : Received Audio Chunk: 1.888005 secs | Character ID : 1d0a37ce-c9a4-11ef-a59e-42010a7be016 | Session ID : 1c83a3b7b94ad4f3ca6721300409a8fe
[16:16:30] ConvaiGRPCLog : Log : EmotionResponse: joy 2
[16:16:30] ConvaiAudioStreamerLog : Log : State transition: WaitingOnAudio → Playing
[16:16:30] ConvaiGRPCLog : Log : Received Text flashes a confident grin Ask and you shall receive.: | Character ID : 1d0a37ce-c9a4-11ef-a59e-42010a7be016 | Session ID : 1c83a3b7b94ad4f3ca6721300409a8fe | ReceivedFinalResponse : False
[16:16:30] ConvaiAudioStreamerLog : Log : State transition: Playing → WaitingOnAudio
[16:16:30] ConvaiGRPCLog : Log : Chatbot Total Received Lipsync Responses: 323 Responses
[16:16:30] ConvaiChatbotComponentLog : Log : Chatbot Total Received Audio: 3.223968 seconds
[16:16:30] ConvaiGRPCLog : Log : Received Text : | Character ID : 1d0a37ce-c9a4-11ef-a59e-42010a7be016 | Session ID : 1c83a3b7b94ad4f3ca6721300409a8fe | ReceivedFinalResponse : True
[16:16:30] ConvaiGRPCLog : Log : GetResponse SequenceString: None
[16:16:30] ConvaiGRPCLog : Log : Action: None
[16:16:30] ConvaiGRPCLog : Log : GetResponse EmotionResponseDebug: session_id: “1c83a3b7b94ad4f3ca6721300409a8fe”
emotion_response: “Ecstasy Admiration Anticipation”
[16:16:31] ConvaiGRPCLog : Log : No more data to read after 3 attempts. Calling Finish…
[16:16:31] ConvaiGRPCLog : Log : Calling Stream Finish | Character ID : 1d0a37ce-c9a4-11ef-a59e-42010a7be016 | Session ID : 1c83a3b7b94ad4f3ca6721300409a8fe
[16:16:31] ConvaiGRPCLog : Log : On Stream Finish | Character ID : 1d0a37ce-c9a4-11ef-a59e-42010a7be016 | Session ID : 1c83a3b7b94ad4f3ca6721300409a8fe
[16:16:31] ConvaiChatbotComponentLog : Log : UConvaiChatbotComponent Request Finished! | Character ID : 1d0a37ce-c9a4-11ef-a59e-42010a7be016 | Session ID : 1c83a3b7b94ad4f3ca6721300409a8fe
[16:16:31] ConvaiAudioStreamerLog : Log : State transition: WaitingOnAudio → Playing
[16:16:33] ConvaiAudioStreamerLog : Log : onAudioFinished
[16:16:44] ConvaiPlayerLog : Log : Started Talking
[16:16:44] ConvaiAudioLog : Log : Using as Audio capture device with NumChannels:51 and SampleRate:0
[16:16:44] ConvaiAudioStreamerLog : Log : State transition: Playing → Stopped
[16:16:44] ConvaiGRPCLog : Log : AsyncGetResponse started | Character ID : 1d0a37ce-c9a4-11ef-a59e-42010a7be016 | Session ID : 1c83a3b7b94ad4f3ca6721300409a8fe
[16:16:44] ConvaiGRPCLog : Log : GRPC GetResponse stream initialized | Character ID : 1d0a37ce-c9a4-11ef-a59e-42010a7be016 | Session ID : 1c83a3b7b94ad4f3ca6721300409a8fe
[16:16:44] ConvaiGRPCLog : Log : request: character_id: “1d0a37ce-c9a4-11ef-a59e-42010a7be016”
session_id: “1c83a3b7b94ad4f3ca6721300409a8fe”
audio_config {
sample_rate_hertz: 16000
enable_facial_data: true
face_model: FACE_MODEL_OVR_MODEL_NAME
}
action_config {
actions: “Moves To”
actions: “Follows”
actions: “None”
actions: “Stops”
actions: “Waits for ”
characters {
name: “Emma Wilson”
}
characters {
name: “Guest”
}
characters {
name: “Player”
}
classification: “multistep”
}
speaker: “Player”
dynamic_info_config {
}
| Character ID : 1d0a37ce-c9a4-11ef-a59e-42010a7be016 | Session ID : 1c83a3b7b94ad4f3ca6721300409a8fe
[16:16:44] ConvaiGRPCLog : Log : Initial Stream Write | Character ID : 1d0a37ce-c9a4-11ef-a59e-42010a7be016 | Session ID : 1c83a3b7b94ad4f3ca6721300409a8fe
[16:16:44] ConvaiGRPCLog : Log : Initial Stream Read | Character ID : 1d0a37ce-c9a4-11ef-a59e-42010a7be016 | Session ID : 1c83a3b7b94ad4f3ca6721300409a8fe
[16:16:45] ConvaiPlayerLog : Warning : StartTalking: already talking!
[16:16:46] ConvaiPlayerLog : Log : FinishTalking calling FinishGetResponseStream
[16:16:46] ConvaiGRPCLog : Log : Finish Writing to audio data buffer
[16:16:46] ConvaiGRPCLog : Log : FinishWriting:: Informing On Data Received
[16:16:46] ConvaiGRPCLog : Log : Calling Stream WritesDone | LastWriteReceived : True | AudioBuffer.Num() : 0 | Character ID : 1d0a37ce-c9a4-11ef-a59e-42010a7be016 | Session ID : 1c83a3b7b94ad4f3ca6721300409a8fe
[16:16:46] ConvaiGRPCLog : Log : On Stream Write Done Writing
[16:16:46] ConvaiPlayerLog : Log : Finished Talking
[16:16:46] ConvaiGRPCLog : Log : OnStreamWriteDone
[16:16:46] ConvaiGRPCLog : Log : NumberOfAudioBytesSent 57288
[16:16:46] ConvaiPlayerLog : Log : Started Talking
[16:16:46] ConvaiAudioLog : Log : Using as Audio capture device with NumChannels:51 and SampleRate:0
[16:16:46] ConvaiChatbotComponentLog : Log : InterruptSpeech: Interrupting character | Character ID : 1d0a37ce-c9a4-11ef-a59e-42010a7be016 | Session ID : 1c83a3b7b94ad4f3ca6721300409a8fe
[16:16:46] ConvaiChatbotComponentLog : Log : UConvaiChatbotComponent Request Finished! | Character ID : 1d0a37ce-c9a4-11ef-a59e-42010a7be016 | Session ID : 1c83a3b7b94ad4f3ca6721300409a8fe
[16:16:46] ConvaiChatbotComponentLog : Log : Chatbot Total Received Audio: 0.000000 seconds
[16:16:46] ConvaiGRPCLog : Log : AsyncGetResponse started | Character ID : 1d0a37ce-c9a4-11ef-a59e-42010a7be016 | Session ID : 1c83a3b7b94ad4f3ca6721300409a8fe
[16:16:46] ConvaiGRPCLog : Log : GRPC GetResponse stream initialized | Character ID : 1d0a37ce-c9a4-11ef-a59e-42010a7be016 | Session ID : 1c83a3b7b94ad4f3ca6721300409a8fe
[16:16:46] ConvaiGRPCLog : Log : request: character_id: “1d0a37ce-c9a4-11ef-a59e-42010a7be016”
session_id: “1c83a3b7b94ad4f3ca6721300409a8fe”
audio_config {
sample_rate_hertz: 16000
enable_facial_data: true
face_model: FACE_MODEL_OVR_MODEL_NAME
}
action_config {
actions: “Moves To”
actions: “Follows”
actions: “None”
actions: “Stops”
actions: “Waits for ”
characters {
name: “Emma Wilson”
}
characters {
name: “Guest”
}
characters {
name: “Player”
}
classification: “multistep”
}
speaker: “Player”
dynamic_info_config {
}
| Character ID : 1d0a37ce-c9a4-11ef-a59e-42010a7be016 | Session ID : 1c83a3b7b94ad4f3ca6721300409a8fe
[16:16:46] ConvaiGRPCLog : Log : Initial Stream Write | Character ID : 1d0a37ce-c9a4-11ef-a59e-42010a7be016 | Session ID : 1c83a3b7b94ad4f3ca6721300409a8fe
[16:16:46] ConvaiGRPCLog : Log : Initial Stream Read | Character ID : 1d0a37ce-c9a4-11ef-a59e-42010a7be016 | Session ID : 1c83a3b7b94ad4f3ca6721300409a8fe
[16:16:47] ConvaiPlayerLog : Log : FinishTalking calling FinishGetResponseStream
[16:16:47] ConvaiGRPCLog : Log : Finish Writing to audio data buffer
[16:16:47] ConvaiGRPCLog : Log : FinishWriting:: Informing On Data Received
[16:16:47] ConvaiGRPCLog : Log : Calling Stream WritesDone | LastWriteReceived : True | AudioBuffer.Num() : 0 | Character ID : 1d0a37ce-c9a4-11ef-a59e-42010a7be016 | Session ID : 1c83a3b7b94ad4f3ca6721300409a8fe
[16:16:47] ConvaiGRPCLog : Log : On Stream Write Done Writing
[16:16:47] ConvaiPlayerLog : Log : Finished Talking
[16:16:47] ConvaiGRPCLog : Log : OnStreamWriteDone
[16:16:47] ConvaiGRPCLog : Log : NumberOfAudioBytesSent 17732
[16:16:49] ConvaiSubsystemLog : Verbose : Unregistered player component: ConvaiPlayer
[16:16:49] ConvaiSubsystemLog : Verbose : Unregistered player component: ConvaiPlayer
[16:16:49] ConvaiSubsystemLog : Log : UConvaiSubsystem Stopped
[16:16:49] ConvaiChatbotComponentLog : Log : Cleanup | Character ID : | Session ID : -1
[16:16:49] ConvaiGRPCLog : Log : Destroying UConvaiGRPCGetResponseProxy… | Character ID : | Session ID :
[16:16:49] ConvaiGRPCFeedBackLog : Log : On Stream Finish | Interaction ID : | Feedback Text : | ThumbsUp: False
[16:16:49] ConvaiChatbotComponentLog : Log : Cleanup | Character ID : | Session ID : -1
[16:16:49] ConvaiChatbotComponentLog : Log : Cleanup | Character ID : 1d0a37ce-c9a4-11ef-a59e-42010a7be016 | Session ID : 1c83a3b7b94ad4f3ca6721300409a8fe
[16:16:49] ConvaiGRPCLog : Log : Destroying UConvaiGRPCGetResponseProxy… | Character ID : 1d0a37ce-c9a4-11ef-a59e-42010a7be016 | Session ID : 1c83a3b7b94ad4f3ca6721300409a8fe
[16:16:49] ConvaiSubsystemLog : Log : Could not run gRPC delegate due to thread closing down
[16:16:49] ConvaiSubsystemLog : Log : End Run
[16:16:49] ConvaiGRPCLog : Log : Destroying UConvaiGRPCGetResponseProxy… | Character ID : 1d0a37ce-c9a4-11ef-a59e-42010a7be016 | Session ID : 1c83a3b7b94ad4f3ca6721300409a8fe
[16:16:49] ConvaiGRPCLog : Log : Destroying UConvaiGRPCGetResponseProxy… | Character ID : 1d0a37ce-c9a4-11ef-a59e-42010a7be016 | Session ID : 1c83a3b7b94ad4f3ca6721300409a8fe
Sorry for that Also I shared the complete logs last time. Here are some logs for a larger conversation I had. Faced the same issue text input was working but audio input was not working
Joining the thread as paying customer. We are on the same team . We are keen to hear about the solutions. [16:16:46] ConvaiChatbotComponentLog : Log : Chatbot Total Received Audio: 0.000000 seconds The microphone appears absent in the codebase.
Hello,
Thanks for reaching out and for bringing this up.
I checked with our Unreal Engine team, and currently microphone input is not supported on Linux builds.
Linux support within Convai is primarily intended for dedicated server deployments or Pixel Streaming setups, rather than full client-side interaction.
If your use case involves direct user voice input, we recommend building and running the project on Windows or macOS for now.
We understand this limitation can be inconvenient, and we’ll share any updates if Linux audio input becomes officially supported in the future.
We have built on windows previously and currently building dedicated server deployment including pixel streaming on Linux. Upon looking at the code we believe we should be able to get it running given access to sdk and update the plugin. It took us forever to get the package running on Linux and now we are stuck on the microphone. Does it have anything to do with unreal ? I hope there will be a solution very soon. Can you assist any further ? There might be a work around.
When using Pixel Streaming, the microphone input is handled directly through the browser, so there’s no additional setup required on your end for that part.
This topic was automatically closed 30 days after the last reply. New replies are no longer allowed.
