How can I reduce response times?

Hi :slight_smile:

I’m experiencing response times from the avatar of about 10 seconds (counting out loud), please see the video : https://youtu.be/s-nO9zf3v3U

In the Playground the same character (37d2b31c-7cea-11ef-bfad-42010a7be011) responds in 6 to 7 seconds.

I’d like to decrease this but I’m not sure how? My internet is reliable and reasonably fast. What things affect response times? Does the amount of knowledge base info? Size of backstory? I think EL voices increase it, do OpenAI voices increase it also (I use these)? Do the amount of Narrative Design triggers/sections increase it?

I’m not complaining, I really like Convai and their service, I’m just trying to improve aspects of my app.

Hello @Tyke,

Welcome to the Convai Developer Forum!

Thank you for providing detailed information, including the video link. I’ve noted your observations and will inform my team to investigate further.

1 Like

Hi K3, thanks for the reply.

Yeh I don’t think my app is at fault, because the latency in the Playground is still 6 or 7 seconds, I asked a friend who also has a Convai app to test 1 of his characters’ latency in the Playground and it was 1 to 3 seconds, that’s what the latency used to be for me.

Some users are starting to get on my case about it, I’ve told them I’ve informed Convai. If there’s anything I can do while you guys are investigating it please let me know. Thank you.

Hey @Tyke, could you please have two conversations from both playground and your app, with the same messages and character? This will help us investigate the inconsistency. A small conversation, lets say around 5 identical messages would be great!

Hi @ayush I’ve done as you’ve requested. Please see :

(conversation in my app)

and

(conversation in the playground)

In my app when I ask what is the day, it fails because of something in my app, so please ignore that bit.

In these video’s an OpenAI voice is used, I tried a non OpenAI voice and the latency seemed to be reduced, not sure if that is relevant.

If you need anymore info from me please let me know. The character ID used here is 37d2b31c-7cea-11ef-bfad-42010a7be011

EDIT: just for reference, this was the reply time in my app a few months ago, to show it used to be much lower (I recall the Playground reply time being lower too back then) :

The difference is due to :

  • Your app’s request uses actionConfig, but the playground one doesn’t.
  • Your app sends audio that needs to be processed, while you are sending text in the playground.

Let me get back to you on the best voice provider for latency and the other factors you mentioned.

1 Like