Convai SDK with Voice Deployment NodeJS

Original Discord Post by kyu.168 | 2024-08-21 00:27:19

One of our clients is working with us to use Convai Web SDK to create a personality for a robot. We’re able to deploy the node js app but are having challenges with voice working correctly on a server or local unit. We’re using this project build: GitHub - Conv-AI/Convai-JS-SDK-Alpha from this tutorial: https://youtu.be/ERPlEmYdFng?si=SG0-0EZDdkQxVZ2y as the baseline for our project. Are there any other non-avatar Convai web sdk builds with voice we can look at for our deployment?

Embedded Content:
GitHub - Conv-AI/Convai-JS-SDK-Alpha
Contribute to Conv-AI/Convai-JS-SDK-Alpha development by creating an account on GitHub.
Link: GitHub - Conv-AI/Convai-JS-SDK-Alpha


Interact with AI Characters in 3D from your Browser with Convai’s J…
Get ready to interact with virtual characters right within the browser using Convai’s JavaScript SDK! In this tutorial, we’ll guide you through the process of installing and running the SDK, including how to interact with the characters in both a 2D chat window and a 3D scene in WebGL. By the end of this video, you’ll be ready to try out Convai’…
Link: https://www.youtube.com/watch?v=ERPlEmYdFng

Reply by k3kalinix | 2024-08-21 00:35:19

Hello <@961499420199890944> :wave:t2:,

Welcome to Convai Community!

<@368669084952428554>

Reply by saurav0037 | 2024-08-22 17:46:10

<@961499420199890944> I’ll try sharing a better example. But for now you can take this as reference: GitHub - Conv-AI/RPM-Lipsync.
This has a Chat folder and useConvaiClient hook which you can use directly.
Also while initialising you can use this config:
new ConvaiClient({ apiKey: apiKey, characterId: characterId, enableAudio: true, })

Reply by kyu.168 | 2024-08-23 03:57:17

thanks Saurav. I’ll try it out now

Reply by kyu.168 | 2024-08-23 09:37:05

Hi <@368669084952428554> I’m having challenges getting the microphone component to work on AWS for this project. Do I need a reverse proxy setup or to edit any of the config files for a cloud server deployment? I’m not too familiar with what React/Vite setup looks like for AWS. If you can point me to some resources it will be helpful

Replying to kyu.168’s Message

Reply by kyu.168 | 2024-08-23 09:37:05
Hi <@368669084952428554> I’m having challenges getting the microphone component to work on AWS for this project. Do I need a reverse proxy setup or to edit any of the config files for a cloud server deployment? I’m not too familiar with what React/Vite setup looks like for AWS. If you can point me to some resources it will be helpful

Reply by saurav0037 | 2024-08-26 15:13:34

I did not try AWS deployment yet. We generally use g cloud or vercel. Will look into it

This conversation happened on the Convai Discord Server, so this post will be closed.