Hi,
I have a new project with a metahuman,
the metahuman Blueprint is a ConvaiBaseCharacter
I added ConvaiFaceSync component. tried talking to it. body plays correct talking animation. but The lipsync isnt working
There is nothing special in the project. just one metahuman and convai
Here is the log file
Would appreciate any help
Thank you!
Hello @Roy_Livne,
Sorry to hear you’re having trouble with the lipsync functionality.
Could you please confirm which version of the Convai SDK you are currently using? This will help us better understand the issue and guide you accordingly.
Sure! thanks for the quick reply, its 3.5.0
Could you please try with a different voice?
Also please note that I’ve removed your log message because it contained your API key. For your safety, make sure to clear the log before starting the test, and remove any sensitive information like API keys before sharing.
Once you’ve done that, feel free to repost the log, and we’ll be happy to take a closer look to assist you!
Hi
I tried with a different voice and different Character Id which worked before,
so its not the voice or the character
Attached log file without the API key (i replaced it with xxxxxxxxxxx)
I also opened a brand new project, added the metahuman, and ConvaoFaceSync, there is no lipsync…
Please assist
Here is the Log file:
Albert_MH_Export.log (387.9 KB)
Thank you
Roy.
I see in the Log file when its suppose to do the lipsync, this is the messages:
ConvaiGRPCLog: Received Audio Chunk: 0.511338 secs | Character ID : 4bf052da-0f90-11f0-85e4-42010a7be01a | Session ID : 1db14f03be8d77959c57e53ce2d45b1a
ConvaiGRPCLog: EmotionResponse: joy 1
ConvaiAudioStreamerLog: Warning: PlayVoiceSynced: Added Audio Chunk - Audio Duration: 0.510816
ConvaiGRPCLog: Received Text Hi there! It’s great to connect. What can I help you with today?: | Character ID : 4bf052da-0f90-11f0-85e4-42010a7be01a | Session ID : 1db14f03be8d77959c57e53ce2d45b1a | ReceivedFinalResponse : False
ConvaiAudioStreamerLog: PlayLipSyncWithPreGeneratedDataSynced: Detected New LipSync Chunk ChunkDuration: 0.510816 ChunkLipSyncFrameRate: 100.000000 FrameIndex:0 ChunkFrameCounter: 1 ExpectedFrameCount:51.081635 ChunkFrameCounter: 1
LogBlueprintUserMessages: [Convai_MetaHuman_BodyAnim_C_0] false
ConvaiAudioStreamerLog: PlayLipSyncWithPreGeneratedDataSynced: Resuming Voice and Lipsync
ConvaiAudioStreamerLog: New SampleRate: 44100
ConvaiAudioStreamerLog: New Channels: 1
ConvaiAudioStreamerLog: PlayNextAudioInQueue - Duration: 0.510816 - Chunks Remaining: 0
ConvaiAudioStreamerLog: PlayNextLipSyncInQueue - Duration: 0.260000 - Chunks Remaining: 0
LogBlueprintUserMessages: [Convai_MetaHuman_BodyAnim_C_0] true
LogBlueprintUserMessages: [Convai_MetaHuman_BodyAnim_C_0] true
ConvaiAudioStreamerLog: PlayLipSyncWithPreGeneratedDataSynced: Failed to detect New LipSync Chunk due to insufficent audio chunks NumAudioChunks: 0 NumLipSyncChunks: 0 FrameIndex:0 ChunkFrameCounter: 52 ExpectedFrameCount:51.081635 ChunkFrameCounter: 52
ConvaiGRPCLog: GetResponse EmotionResponseDebug: session_id: “1db14f03be8d77959c57e53ce2d45b1a”
emotion_response: “Serenity”
Could you please try with OpenAI voices?
Yes,
Tried now, doesnt work
Its working!
Can confirm, Thanks for the help
It was on our side, wrong face animation blueprint !
Sorry for the hassle
No worries, good to hear you fixed it. Thanks for sharing the solution.