Need help with voice input while pixel streaming in unreal

Original Discord Post by caddydave728 | 2024-10-12 00:19:03

Have the plug-in working great inside of unreal lawlessly have my whole project setup I’m ready to package but I can’t replicate the voice input from any device that’s connected to my local area network and I don’t want to package this before I see that work and someone please help me I have put the pixel streaming blueprint in am I missing something there’s not really a pipeline that I can find that takes you straight through unreal to the web

Reply by k3kalinix | 2024-10-12 00:23:37

Hello <@994298636735369297> :wave:t2:

Reply by k3kalinix | 2024-10-12 00:23:39

Embedded Content:
Integration with Pixel Streaming | Documentation
This mini-guide provides instructions for setting up Convai with pixel streaming in Unreal Engine
Link: Integration with Pixel Streaming | Documentation

Reply by k3kalinix | 2024-10-12 00:23:49

Did you follow this documentation?

Reply by caddydave728 | 2024-10-12 00:27:10

Yeah I got the picture streaming blueprint in there and I checked the streaming on the convai player. I have set up pixel streaming on a local area network. When I connect to my server I definitely have my editor appearing there and it will play sound. Fron the npc if I don’t have the pixel streaming checked but when I do check pixel streaming I cannot get my device to take the voice input I have added the web RTC extension to Chrome and when I check enable Mike and the settings on the picture streaming window and definitely says that the mic is active but I’m trying it it a few different ways. From a Macbook in the Chrome browser from my phone but with no success so obviously I’m missing something

Reply by caddydave728 | 2024-10-12 00:28:40

Images:

Reply by k3kalinix | 2024-10-12 00:34:53

<@365628745886859267>

Reply by caddydave728 | 2024-10-12 00:39:39

Anywhere it says picture I clearly mean for it to say pixel I’ve just gotten so attached to this voice I don’t want to type sorry for the voice typos I’m remaining calm. I’ve only been working on this 2 weeks and I reached into my patience copilot literally didn’t have any waste 19 hours today but I still remain optimistic cuz I know it’s going to work out cuz some way I always figure out where to work out I pondered going other routes like that were more established on your videos but I’m so invested in unreal

Reply by caddydave728 | 2024-10-12 00:40:47

I mean I have my domain I plan on Pixel streaming from AWS I just have to see this plug-in function properly before I package this project if not that’s just a waste of a package

Reply by caddydave728 | 2024-10-12 00:41:54

Im clearly missing something because I don’t even have a user interface for the chatbot once I start pixel streaming

Reply by caddydave728 | 2024-10-12 00:44:40

This is me pixel streaming

Images:

Reply by caddydave728 | 2024-10-12 00:47:17

Says mic is enabled

Images:

Reply by caddydave728 | 2024-10-12 00:49:33

Attachments:

Reply by caddydave728 | 2024-10-12 00:52:45

Do I need to add the blueprint for mapping t to talk or pixel streaming. because I typed this with a keyboard connected to my phone so voice works I have mapped a screen touch interaction to a t press and even used a Bluetooth keyboard

Reply by freezfast | 2024-10-12 13:23:00

Hi <@994298636735369297>, you need to host with https enabled for mic input

Reply by caddydave728 | 2024-10-12 13:24:36

It’s that simple I knew it was going to be something that simple is that in the documentation cuz I don’t remember seeing it

Reply by freezfast | 2024-10-12 14:27:28

no we do not offer documentation on how to host pixel streaming, only how to connect it with Convai

Reply by freezfast | 2024-10-12 14:27:57

There’re plenty of documentation online, and each version of Unreal is different

This conversation happened on the Convai Discord Server, so this post will be closed.