Set mobile chat UI as default part 2

Unreal Engine Questions
1

Original Discord Post by meijestic | 2024-09-05 19:10:07

Hello I have asked in this post how the creation of a mobile chat UI could look like.

The UI is ready and works within the Unreal Engine. But as soon as I put the whole thing into pixel streaming (arcanemirage), it takes about 15-20 seconds until the microphone reacts to a voice input. Do you have any idea why this might be?

I would also like to know what the two events from my first post are for?

  • On Transcription Received
  • On Text Received
    Are they necessary for pixel streaming? Could this be the reason?

The setupt of the UI + Mic BTN looks like this.

Thank for any tipps

Images:

image.png
image.png2152×1134 290 KB

image.png
image.png2150×1295 71.9 KB

2

Reply by freezfast | 2024-09-05 22:09:16

Hi <@639037679136407563>, make sure to follow this guide to ensure microphone works with PixelStreaming

Embedded Content:
Integration with Pixel Streaming | API Docs
This mini-guide provides instructions for setting up Convai with pixel streaming in Unreal Engine
Link: Integration with Pixel Streaming | Documentation

Thumbnail
Thumbnail1200×630 88.7 KB

3

Reply by freezfast | 2024-09-05 22:10:41

The following events are used to fetch the received text from the character or player, but are of no direct use in PixelStreaming

  • On Transcription Received
  • On Text Received

You can have more info about them here: Convai Chatbot | Documentation

Embedded Content:
Convai Chatbot | API Docs
Actor component for the AI character
Link: Convai Chatbot | Documentation

Thumbnail
Thumbnail1200×630 69 KB

4

Reply by 888fps | 2024-09-06 06:23:41

Try vagon.io

5

Reply by meijestic | 2024-09-09 21:24:35

vagon.io has a nice UI and very well Settings possibilities but its not fast enough and very expensive.

6

This conversation happened on the Convai Discord Server, so this post will be closed.