Knowledge bank exhaustiveness degrades after a certain point

Original Discord Post by redde81 | 2024-01-17 08:58:21

Hi, I was told to post here for this problem we are facing.
We are building a POC App for our high profile business clients and just until few months ago our Character was replying neatly and exhaustively to all our queries.

This changed since recent times and now we are facing this problem:

  1. When a few knowledge files are connected, our character responds to all of our questions in detail, it knows the correct answers
  2. as soon as we connect another knowledge file the character stops replying to our questions in a reliable way

See attached example video: we have a CMS, it has a name, it is being described in our knowledge.

After a certain “knowledge threshold” (doesn’t matter which file is connected, as long as it’s big enough to trigger this problem), the knowledge about this specific topic degrades and the Character starts replying in a a generic way and “forgets” the details we provided.

We are looking forward to use convai with our clients but this problem has brought our POC to a halt since we cannot reliably guarantee some questions will be answered satisfactorily.

Thanks for your time

Attachments:

Reply by k3kalinix | 2024-01-17 09:08:35

Hello <@267772605434429450>, Welcome to Convai Community!

Reply by k3kalinix | 2024-01-17 09:09:54

<@1118275510926053447> <@1122925292500033637> can you help?

Reply by nyla3206 | 2024-01-17 23:26:39

Hello, sorry for the delay. we are checking the behavior. Can you share you character ID

Reply by redde81 | 2024-01-18 08:28:50

Hi! thanks for checking out. Character ID is 8bac33da-6122-11ee-a555-42010a40000b

Reply by redde81 | 2024-01-18 08:30:34

<@1122925292500033637> I created another one to test if it was character-related (1308f8e2-b3bf-11ee-a5ab-42010a40000f) but the new character exhibits the same behavior

Reply by nyla3206 | 2024-01-18 19:49:28

I see thank you. I will get this triaged by the team soon

Reply by redde81 | 2024-01-22 14:25:11

any update on this? <@1118275510926053447> <@1122925292500033637> ?

Reply by nyla3206 | 2024-01-22 22:36:52

We are checking this, could you provide the session ids of your bad interractions ?

Reply by sconvai | 2024-01-23 08:45:20

We were able to identify issue on our end. We have submitted a fix.

Reply by sconvai | 2024-01-23 08:45:44

The fix should reach our prod by tomorrow. I will update you once it is deployed.

Reply by redde81 | 2024-01-23 16:15:00

Thank you! I’ll let you know if it worked on our side

Reply by sconvai | 2024-01-23 20:13:23

Hey can you please check. We have deployed the fix.

Reply by redde81 | 2024-01-24 12:11:02

we are doing tests but, for now, the situation seems GREATLY improved! ManyThanks

Reply by k3kalinix | 2024-01-24 12:11:18

<@267772605434429450>

Reply by k3kalinix | 2024-01-24 12:11:33

We are very glad that your problem has been solved.

Reply by k3kalinix | 2024-01-24 12:11:48

If you have any other questions, please do not hesitate to ask.

We would be very grateful if you could leave a comment on our store pages with your company name or the name of your project. We value your feedback and comments as they help us improve our services and products.
Asset Store: NPC AI Engine - Dialog, actions, voice and lipsync - Convai | Behavior AI | Unity Asset Store

This conversation happened on the Convai Discord Server, so this post will be closed.