Getting Viseme Data from API Request?

Unity Questions
,
1

Original Discord Post by tomizawa0909 | 2024-10-10 05:28:56

Hello.
I apologize that It seems to be hard to read my question because I am Japanese developer.

I’m creating the application with Unity using Convai SDK.
I want to get Viseme Data from HTTP API request.
However, referring the documentation, Character Interaction API provides only audio data, but Convai Unity-plugin get viseme data from native jslib code.

Could you tell me the way how to get viseme data from API request if it’s supported?

2

Reply by tomizawa0909 | 2024-10-10 05:29:45

Hello.
I apologize that It seems to be hard to read my question because I am Japanese developer.

I’m creating the application with Unity using Convai SDK.
I want to get Viseme Data from HTTP API request.
However, referring the documentation, Character Interaction API provides only audio data, but Convai Unity-plugin get viseme data from native jslib code.

Could you tell me the way how to get viseme data from API request if it’s supported?

3

Reply by k3kalinix | 2024-10-10 07:44:45

Hello <@267940451137486852> :wave:t2:

4

Reply by tomizawa0909 | 2024-10-10 07:45:53

Hello.

5

Reply by k3kalinix | 2024-10-10 07:50:30

Are you using Core SDK or WebGL SDK?

6

Reply by tomizawa0909 | 2024-10-10 08:56:25

I use WebGL SDK.

7

Reply by k3kalinix | 2024-10-10 09:07:46

Viseme Data comes with Audio Data.
So there is no way to request it separately.

8

Reply by tomizawa0909 | 2024-10-10 09:18:04

Is threre the way to send Viseme data to NPC Lipsync component except ConvaiGRPCWebAPI?

9

Reply by k3kalinix | 2024-10-10 09:18:28

Why?

10

Reply by k3kalinix | 2024-10-10 09:19:03

What exactly are you trying to do?

11

Reply by tomizawa0909 | 2024-10-10 09:22:48

ConvaiGRPCWebAPI accesses ChatUI component when recieved the data.
I want to imprement the application with custom UI.

12

Reply by k3kalinix | 2024-10-10 09:26:53

Yes, you can create a new custom UI. It is not related to Visemes.

Please check this documentation.

Embedded Content:
Transcript UI System | Documentation
Transcript UI System - Integrate transcript UI with Convai’s Unity plugin.
Link: Transcript UI System | Documentation

Thumbnail
Thumbnail1200×630 77.4 KB

13

Reply by tomizawa0909 | 2024-10-10 09:33:31

So, you say the way to Create custom chat application is that using those prefabs?
I thought connection/lipsync/custermize UI have to write scripts connect with API.
I was satisfied so this thread will be able to change status solved.

14

Reply by tomizawa0909 | 2024-10-10 09:33:37

Thank you.

15

Reply by k3kalinix | 2024-10-10 09:40:06

Yes, you don’t need to change any code.

16

Reply by k3kalinix | 2024-10-10 09:40:24

Just follow the documentation.

17

This conversation happened on the Convai Discord Server, so this post will be closed.