What do you need help with?
Bug report
Installation method
Unity Asset Store
Issue area
Lip Sync / Facial Animation
Impact
Major - a core flow is broken
Unity version
6.3LTS (6000.3.17f1)
Convai Unity SDK version
4.2.0
Target platform
Android
Where does it happen?
Both sample and custom scene
Short summary
The lipsync cuts off sometimes even in a completely fresh project with only the samplescene this seems to happen.
What happened?
When talking to camilla or any other character the lipsync stops working at the end of sentences. It seems to be worse at the low latency settings (it happens earlier in the audio stream). if you set the streaming and latency to ring buffer cap 10 secs it seems to happen later in the audio stream.
What did you expect?
So a week ago this bug seemed to not exist yet so no idea what happened.
It still happens with a completely fresh new scene with only the sample scene
Tested on various devices and internet connections it seems to happen everywhere.
The log below seems to fire before she is done speaking when the bug happens and after speaking when it does not happen.
Steps to reproduce
- Create empty project.
- Download package from assetstore
- Install lipsync sample.
- Talk to character
Unity Console errors or build logs
16:33:37.686][Info][LipSync]: [LipSync] TurnStats - Server: 536 frames | Received: 536 frames | Match: YES | Audio: 787920 bytes | Turn Duration: 6.15s | Audio Duration: 8.93s | FPS: 60.00
UnityEngine.Debug:Log (object)
Convai.Runtime.Logging.UnityConsoleSink:Write (Convai.Domain.Logging.LogEntry) (at ./Library/PackageCache/com.convai.convai-sdk-for-unity@1c0d01a815cf/SDK/Runtime/Logging/UnityConsoleSink.cs:35)
Convai.Domain.Logging.LogSinkExtensions:WriteIfEnabled (Convai.Domain.Logging.ILogSink,Convai.Domain.Logging.LogEntry&) (at ./Library/PackageCache/com.convai.convai-sdk-for-unity@1c0d01a815cf/SDK/Domain/Logging/ILogSink.cs:52)
Convai.Runtime.Logging.ConvaiLogger:DispatchToSinks (Convai.Domain.Logging.LogEntry&) (at ./Library/PackageCache/com.convai.convai-sdk-for-unity@1c0d01a815cf/SDK/Runtime/Logging/ConvaiLogger.cs:198)
Convai.Runtime.Logging.ConvaiLogger:LogMessageUnchecked (string,Convai.Domain.Logging.LogLevel,Convai.Domain.Logging.LogCategory,System.Exception) (at ./Library/PackageCache/com.convai.convai-sdk-for-unity@1c0d01a815cf/SDK/Runtime/Logging/ConvaiLogger.cs:132)
Convai.Runtime.Logging.ConvaiLogger:LogMessage (string,Convai.Domain.Logging.LogLevel,Convai.Domain.Logging.LogCategory,System.Exception) (at ./Library/PackageCache/com.convai.convai-sdk-for-unity@1c0d01a815cf/SDK/Runtime/Logging/ConvaiLogger.cs:103)
Convai.Runtime.Logging.ConvaiLogger:Info (string,Convai.Domain.Logging.LogCategory) (at ./Library/PackageCache/com.convai.convai-sdk-for-unity@1c0d01a815cf/SDK/Runtime/Logging/ConvaiLogger.cs:348)
Convai.Runtime.Logging.ConvaiLogger:Convai.Domain.Logging.ILogger.Info (string,Convai.Domain.Logging.LogCategory) (at ./Library/PackageCache/com.convai.convai-sdk-for-unity@1c0d01a815cf/SDK/Runtime/Logging/ConvaiLogger.cs:432)
Convai.Infrastructure.Networking.RTVIHandler:HandleBlendshapeTurnStats (Newtonsoft.Json.Linq.JObject,string) (at ./Library/PackageCache/com.convai.convai-sdk-for-unity@1c0d01a815cf/SDK/Runtime/Infrastructure/Networking/Abstractions/RTVIHandler.cs:814)
Convai.Infrastructure.Networking.RTVIHandler:HandleServerMessage (Convai.Infrastructure.Protocol.ProtocolMessage) (at ./Library/PackageCache/com.convai.convai-sdk-for-unity@1c0d01a815cf/SDK/Runtime/Infrastructure/Networking/Abstractions/RTVIHandler.cs:731)
Convai.Infrastructure.Protocol.ProtocolGateway/DelegateMessageHandler:Handle (Convai.Infrastructure.Protocol.ProtocolMessage) (at ./Library/PackageCache/com.convai.convai-sdk-for-unity@1c0d01a815cf/SDK/Runtime/Infra
I checked the relevant documentation, resources, and similar forum posts before posting.
on
I confirm that I did not include API keys, tokens, passwords, secrets, private character data, private conversation logs, or customer data.
on