Text to speech + lipsync

Original Discord Post by samuelr.1924 | 2024-07-23 07:12:29

Hello, I’m trying to use the Convai Text to Speech but i don’t know how to connect it with InvokeSpeech so the character say exactly what is written in the Text to Speech. Any help please ?

Images:

Reply by samuelr.1924 | 2024-07-23 07:29:24

I tried this also, but it answer : " I’m not sure what you mean. "

Reply by samuelr.1924 | 2024-07-23 08:49:30

this is too random

Reply by k3kalinix | 2024-07-23 09:16:14

Hello <@1042701712554741830>,

Reply by k3kalinix | 2024-07-23 09:16:15

Embedded Content:
Event-Aware Convai Characters | Documentation
This document explains how to make characters respond to events happening in their surroundings with a small example.
Link: Event-Aware Convai Characters | Documentation

Reply by k3kalinix | 2024-07-23 09:16:20

Could you please check this documentation?

Replying to k3kalinix’s Message

Reply by k3kalinix | 2024-07-23 09:16:20
Could you please check this documentation?

Reply by samuelr.1924 | 2024-07-23 09:18:04

Hi ! I did check already, and i tried what is recommended from previous support, to add “Please say the following: " Put your text here”.
But sometimes the AI answer " I’m not sure what you mean. " this is too random.

Reply by k3kalinix | 2024-07-23 09:19:16

<@&1163218672580575372>

Reply by samuelr.1924 | 2024-07-24 09:17:46

?

Reply by k3kalinix | 2024-07-24 09:43:38

<@1216254232957685765>

Reply by freezfast | 2024-07-24 10:31:14

The only solution in that case is to use Narrative Design, create a narrative design trigger and write inside it the following write what you want the character to say, then invoke that trigger from Unreal

Reply by freezfast | 2024-07-24 10:33:56

This is how to create and invoke triggers: Narrative Design Trigger | Documentation

Embedded Content:
Narrative Design Trigger | API Docs
Use Convai’s Narrative Design Triggers in Unreal Engine to enhance your game stories.
Link: Narrative Design Trigger | Documentation

Reply by freezfast | 2024-07-24 10:36:08

Here are more information about the syntax used for speaking sentences: Narrative Design | Documentation

Embedded Content:
Narrative Design | API Docs
Master narrative design with Convai’s character creator tool. Create engaging AI-driven stories.
Link: Narrative Design | Documentation

Reply by samuelr.1924 | 2024-07-24 11:04:57

i cannot use the text tospeech to trigger the ovr module directly ?

Reply by freezfast | 2024-07-24 12:26:33

You mean the Convai Text To Speech function? No unfortunately the only way to use lipsync that we support is via interacting with the character or invoking speech/trigger

This conversation happened on the Convai Discord Server, so this post will be closed.