Audio (mp3) input for NPC

Unity Questions
8

Hmm, I’m a bit lost atm with getting lipsync working with my custom text.

Using this shows the text and plays the audio file:

convaiNPC.AudioManager.SetWaitForCharacterLipSync(false);
convaiNPC.AudioManager.AddResponseAudio(new ConvaiNPCAudioManager.ResponseAudio
{
    AudioClip = _introductionRoom.introductionClip,
    AudioTranscript = _introductionRoom.introductionTranscript,
    IsFinal = false
});

But lipSync is not working. I tried to dig through the code, but I’m not sure how to set it up. Also not sure if this can be done and cached somehow.

From what I see ProcessAudioResponse in line 580 of ConvaiGRPCAPI.cs contains the lipSyncBlendFrameQueue which “is the lipsync data”? Can I create this data in my App by giving a audio and/or text (string)?

Thanks