Can't get audio input working on Linux

Original Discord Post by robertbjarnason | 2024-09-06 04:53:36

The character talks and the correct model comes from your server as ReadyPlayerMe avatars. If I hold down the T then it send audio, I can see the logs but nothing is detected from it, so always get a response like I added an empty string. If I type in a message everything works 100%.

Any ideas?

Images:

Reply by robertbjarnason | 2024-09-06 04:54:22

Nothing comes in there, I’ve tried to look at Blueprints what to fix there but not 100% how it works in relation to the audio input.

Reply by k3kalinix | 2024-09-06 07:40:31

<@797205920216121355> it looks like you don’t have an input device.

Reply by robertbjarnason | 2024-09-06 15:53:43

It work in my browser to your website fine so no physical problem.

Reply by robertbjarnason | 2024-09-06 15:53:45

Images:

Reply by robertbjarnason | 2024-09-06 15:54:12

First time using Unreal Engine, just getting the hang of blueprints but it all seems to be there and it works, it send an audio file to your server, I can see taht in the logs

Reply by robertbjarnason | 2024-09-06 15:55:19

Images:

Reply by robertbjarnason | 2024-09-06 15:55:22

Here is the log

Reply by robertbjarnason | 2024-09-06 15:56:37

and from above maybe more relevant

Reply by robertbjarnason | 2024-09-06 15:56:40

Images:

Reply by robertbjarnason | 2024-09-06 15:56:58

Probably just sending silence to your API

Reply by robertbjarnason | 2024-09-06 15:57:18

If I press T and say Hello, the NPC answers me but can’t hear what I say

Replying to robertbjarnason’s Message

Reply by robertbjarnason | 2024-09-06 15:53:45

Reply by k3kalinix | 2024-09-06 16:10:09

Please check microphone permissions for Unreal Engine.

Reply by robertbjarnason | 2024-09-06 18:38:21

I can see from pavucontrol that unreal is not getting connected to the mic, but as it’s a native app it should not need special permissions to use the mic. Any leads on where I could check?

Images:

Reply by k3kalinix | 2024-09-06 19:18:49

<@&1163218672580575372>

Reply by freezfast | 2024-09-06 22:16:27

it seems it is having a hard time recognizing Linux audio input devices

Reply by freezfast | 2024-09-06 22:17:15

Linux is meant for building dedicated servers with no mic input, we might need to rework the audio input system on the plugin to be more compatible with Linux

Reply by freezfast | 2024-09-06 22:17:53

so please if you’re looking to develop the actual app, you can consider Windows, Mac or Android, but for building dedicated servers and such Linux can be used

Reply by freezfast | 2024-09-06 22:18:56

I can see this line in the logs, which indicates Unreal is not able to recognize audio capture properly

Images:
image.png

Reply by robertbjarnason | 2024-09-07 11:20:53

Thanks. I want to be able to develop on Linux, I don’t have Windows box with a 3D card. But will look into the general “No Audio Capture” problem; the phrase “You might have to build your own” did come up during perplexity searches yesterday a couple of time, but hopefully someone has already done so for Linux, will look into it more and report back.