Is there any way of accelerating the latency between question and anwser ? thanks

Original Discord Post by hadrien6847 | 2024-07-31 08:35:19

thanks

Reply by k3kalinix | 2024-07-31 08:47:32

Hello <@171751358347739136>,

This depends on the voice you choose, the information you upload to the character and your internet connection.

Reply by hadrien6847 | 2024-07-31 08:48:49

Oh ok thanks you mean the longer the information the worse the latency ? my internet is 300mb/s so it’s not that but the voice is french… could it be related? and do u think using open AI api straight in engine would change anythiung? thanks

Reply by k3kalinix | 2024-07-31 08:52:20

ElevenLabs voices are big in size and can increase latency.

How many seconds on average do you get an answer?

Reply by hadrien6847 | 2024-07-31 09:01:27

ok thanks

Reply by hadrien6847 | 2024-07-31 09:01:31

around 3 sec i’d say

Reply by k3kalinix | 2024-07-31 09:49:07

<@365628745886859267> Could you please confirm the average response time?

Reply by samuelr.1924 | 2024-07-31 10:57:40

facing same issue, I have around 5 to 6 seconds using Azure voices.
Could be nice to know which voices are fastest to generate

Reply by freezfast | 2024-07-31 11:05:33

it depends on the voice selected and geographical location, Convai voices are the fastest, Elevenlabs are the slowest to generate and Azure is moderate, 5-6 seconds latency is way too much, there might another reasons, do you get 5-6 seconds consistently or sometimes slow sometimes fast?

Reply by freezfast | 2024-07-31 11:05:42

do you also get it only on first response?

Reply by hadrien6847 | 2024-07-31 11:09:37

ok thanks yeah i wish i would know which voices are fasterd

Reply by hadrien6847 | 2024-07-31 11:09:44

im’ using french at the moment

Replying to freezfast’s Message

Reply by freezfast | 2024-07-31 11:05:42
do you also get it only on first response?

Reply by samuelr.1924 | 2024-07-31 11:14:12

Everytime it’s 5 to 6 sec using Azure voices.
What do you mean by it depend on geographical location? the quality of convai service is not the same everywhere ?

Reply by nazbee | 2024-07-31 15:40:33

Ive found telling the character to keep responses short between 1-2 sentences keeps response latency much more natural. When it goes off on a long response it can take 5 or more seconds to return the data

Replying to nazbee’s Message

Reply by nazbee | 2024-07-31 15:40:33
Ive found telling the character to keep responses short between 1-2 sentences keeps response latency much more natural. When it goes off on a long response it can take 5 or more seconds to return the data

Reply by samuelr.1924 | 2024-07-31 15:51:28

I’ll try thanks

Reply by samuelr.1924 | 2024-07-31 15:57:43

I’ve try asking short responses, and I’ve tried convai voices, but same issue.

Replying to samuelr.1924’s Message

Reply by samuelr.1924 | 2024-07-31 11:14:12
Everytime it’s 5 to 6 sec using Azure voices.
What do you mean by it depend on geographical location? the quality of convai service is not the same everywhere ?

Reply by freezfast | 2024-07-31 15:59:49

Bandwidth and internet might not be the same everywhere, there might be some security firewall slowing the connection down or even cutting it off

Reply by samuelr.1924 | 2024-07-31 16:00:21

firewall is disabled completely and i have optic fiber connection

Replying to samuelr.1924’s Message

Reply by samuelr.1924 | 2024-07-31 16:00:21
firewall is disabled completely and i have optic fiber connection

Reply by freezfast | 2024-07-31 16:02:32

ok just to test a theory, can you try talking for 6-8 seconds then see if the response comes in faster?

Reply by freezfast | 2024-07-31 16:03:45

and if possible try another network and/or machine, perhaps try using a VPN, my guess is that there’s a lot of handshake going on every request being made, that or the router firewall is being extra cautious