Original Discord Post by jdiego8d | 2024-08-13 13:52:21
We are having lots of problems with lip Sycn which randomly send log messages with:
ConvaiAudioStreamerLog: Warning: Stopping LipSync
Original Discord Post by jdiego8d | 2024-08-13 13:52:21
We are having lots of problems with lip Sycn which randomly send log messages with:
ConvaiAudioStreamerLog: Warning: Stopping LipSync
Reply by k3kalinix | 2024-08-13 14:31:42
<@&1163218672580575372> do you have any ideas?
Replying to jdiego8d’s Message
Reply by jdiego8d | 2024-08-13 13:52:21
We are having lots of problems with lip Sycn which randomly send log messages with:
ConvaiAudioStreamerLog: Warning: Stopping LipSync
Reply by freezfast | 2024-08-13 14:50:29
Hi <@592163175189970944>, the warnings are fine, are you seeing any issues visually?
Reply by jdiego8d | 2024-08-13 14:53:07
Yes, the lips remain static without any movement
also, we dont hear the full text that appear in the visual chat, it give us only a portion of audio
Reply by freezfast | 2024-08-13 14:54:11
I see, this issue seemd to happen before with non-english characters, which language are you using?
Reply by jdiego8d | 2024-08-13 14:55:01
we are usign spanish
Reply by freezfast | 2024-08-13 14:55:29
ok let me check with the backend team and get back to you
Reply by jdiego8d | 2024-08-13 14:55:57
do you need any id character? i think it is visible on the logs adobe
Reply by jdiego8d | 2024-08-13 15:05:23
Also the chatbot remaing in “Isthinking” state
which causes problems with our code, he have some filters to wait until the character is not thinking, and it was working good in the last weeks
the “IsThinking” issue is recent
Reply by jdiego8d | 2024-08-13 15:14:49
Something important is that we have changed the backstory from our character…
This is the current: e4814288-03da-11ef-9539-42010a7be00e
This is a backup: e63e6c40-565a-11ef-a02b-42010a7be011
For some reason, the backup works well, but the changes on backstory info are minimal
But it is enough to bug the lipsycn and the IsThinking parameter
Can you give us some feedback on what we could made wrong is the redaction or anything?
Reply by jdiego8d | 2024-08-13 15:15:33
Both characters share the same narrative design nodes, just a few more sentences in backstory
Reply by jdiego8d | 2024-08-13 15:37:35
Also
Sometimes we get this log
ConvaiGRPCLog: Warning: OnStreamFinish: Status:Not Ok | Debug Log: | Error message:Unable to generate audio response. Please verify that you have a valid voice set for the character. | Error Details: | Error Code:2 | Character ID:e4814288-03da-11ef-9539-42010a7be00e | Session ID:8994ee6dc3efd8c41decfe3cd7d1fa12
We dont know if it is related
Reply by freezfast | 2024-08-13 15:39:23
it is most likely in the Isthinking
state due to it expecting lipsync data to come over and therefore it keeps waiting for the lipsync to come in, could you check if changing to English fixes these issues?
Reply by jdiego8d | 2024-08-13 15:56:05
You are right, changing the language to english solve the “IsThinking” issue
but we are targeting spanish speakers, so it is a problem to us
Reply by jdiego8d | 2024-08-13 15:56:36
changing it, to another spanish voice also have issues related to “Unable to generate audio response.”
Reply by jdiego8d | 2024-08-13 15:57:01
it give us a lot of errors
Reply by freezfast | 2024-08-13 17:23:02
I see, thank you for elaborating.
cc: <@1023671043287699568> to mention the teams in charge of language and voice
Reply by jdiego8d | 2024-08-13 20:45:38
Any update on this?
tomorrow he have an important meeting with a client
Reply by k3kalinix | 2024-08-13 20:52:50
Hello <@592163175189970944>,
Are you asking for the Lipsync or the voice problem?