Custom UI issues

Original Discord Post by imdoldoli | 2024-08-28 23:51:11

Hi <@&1163218672580575372> I am using a custom convai blueprint(duplicated base player blueprint and modified) for the base player. I have set up a custom UI widget on a separate screen using C++ and when a mic button is pressed I want the player’s voice input to start (talk).

However when I press the button the following warning appears:
ConvaiChatbotComponentLog: Warning: StartGetResponseStream: ConvaiActions: The Environment object does not have any actions added, please add some actions using “Add Action” or “Add Actions” function

What should be added so that the convai chat works properly.

Images:


Reply by mighty_brute | 2024-08-29 05:25:04

Hello <@469160795406860298>,
To implement a custom UI widget for your project, I recommend checking out the setup of the Chat Widget’s collapsed graph in ConvaiBasePlayer blueprint. Additionally, for updating the UI and displaying new messages, there are two key delegates you should focus on:

  1. OnTextReceived
  2. OnTranscriptionReceived

These delegates will provide you with the necessary messages, which you can then use to populate your UI.

For further assistance, please take a look at this tutorial : https://www.youtube.com/watch?v=Up0Ria9PaFI&list=PLn_7tCx0ChiogfggG1AVo6IkELQSLt6o3&index=3
This should help in making your Convai chat work properly. Let me know if you need any more help!

Embedded Content:
Add Live Transcriptions and Events for AI NPCs in Unreal Engine | C…
After having set up conversation capabilities for your AI Characters in Unreal Engine 5, we dive into Part 2 of this tutorial series where we set up the Convai UE plugin for live AI transcriptions and events.

Full Playlist here: https://www.youtube.com/playlist?list=PLn_7tCx0ChiogfggG1AVo6IkELQSLt6o3

Tutorial Project: https://drive.google.com/
Link: https://www.youtube.com/watch?v=Up0Ria9PaFI

Reply by imdoldoli | 2024-08-29 05:42:35

<@1216254232957685765> could simply adding another key (other than T button) using UI buttons would still work? (please have a look at the first image I have shared)

Reply by mighty_brute | 2024-08-29 05:53:51

It should work. You can refer to the screenshots I shared—I’ve used a custom event and triggered it from the widget using the Button Pressed and Released events.

Images:


This conversation happened on the Convai Discord Server, so this post will be closed.