UE5.8: No audio Detection

What do you need help with?

Question

Installation method

FAB

Issue area

Microphone / Voice Input

Impact

Major - a core flow is broken

Unreal Engine version

5.8

Convai Unreal Engine Plugin version

4.0.0-beta.24

Character ID

bae217ea-cb98-11f0-b519-42010a7be027

Project setup

Blueprint

Target platform

Unreal Editor

Where does it happen?

Custom project

Short summary

The Convai character is unable to detect voice input

What happened?

I followed one of the more recent Convai tutorials titled Real-Time AI Conversations & Facial Animation for MetaHumans to set up a Convai character in the sample FirstPerson project.

Once I finished setting everything up, I tested the voice interaction via Push To Talk, and nothing happened. I also tested the feature where you type to communicate with the Chatbot, and it did respond to that.

I checked, and I selected the proper input. Also, the Unreal Engine Editor is has allowed microphone access.

I have another project in UE5.7 with the Convai-3.6.9-hotfix-2 version, and the chatbot is responsive there, with the same microphone.

One thing I also noticed in the new version was that the Test button for the Mic is not visible in the Settings Widget, which I technically fixed by setting the Size box (where TestMicRecord_btn_1 is located) to be Visible. But now when I test any mic, I get the warnings:

ConvaiPlayerLog: Warning: StartRecording: already talking!
ConvaiPlayerLog: Warning: FinishRecording: did not start recording

On my other Convai version it returns that it recorded for a certain number of seconds.

I didn’t change the BPs much, I only added some prints to check whether the Start Talking and Finish Talking get triggered, and whether the Muted variable is indeed toggled.

Also, I do make sure that I release the T key a few seconds after I am finished talking.

Screenshots, recording, logs, or minimal repro

Push-To-Talk-And-Mic-Test-Logs.txt (25.8 KB)

Type-Message-Logs.txt (47.1 KB)

I checked the relevant documentation, resources, and similar forum posts before posting.

on

I confirm that I did not include API keys, tokens, passwords, secrets, private character data, private conversation logs, or customer data.

on