Need guidance in integrating Custom Unreal Avatars with Convai via Pixel Streaming

Unreal Engine Questions
2

Hello @Shubham_Vaidya,

Welcome to the Convai Developer Forum!

Thanks for reaching out and for providing such a detailed overview of your setup and questions!

Here are some clarifications:

  1. You are free to use your own Pixel Streaming setup. If you’d prefer to use Convai’s infrastructure, please schedule a call with our sales team: https://calendly.com/convai-intro/hi

  2. Yes, you will soon be able to upload custom avatars directly into Avatar Studio. This feature is currently in development and will be released shortly.

  3. If you host Pixel Streaming yourself, Unreal Engine’s general documentation and architecture will apply. Convai handles the backend if you use our streaming solution.

  4. Audio and facial animation synchronization is handled automatically by Convai’s SDK. You do not need to trigger animations manually.

  5. If you’re using our Unreal Engine SDK, we’ve already taken care of this part.

  6. Performance requirements will vary depending on your specific deployment and scale.

  7. I don’t understand this question.

  8. Yes, it is possible.

To summarize, for a streamlined setup we highly recommend exploring Avatar Studio and Embed Experience. These allow you to get started within minutes and offer extensive customization options for your character and experience.

If you’re interested in learning more or tailoring a solution to your specific project needs, feel free to schedule a call with our sales team here:
https://calendly.com/convai-intro/hi

You can also watch our overview video on the Embed Experience:
https://youtu.be/8myRcmAe-6o

If you prefer to manage your own Pixel Streaming infrastructure, that is entirely up to you. However, please note that we do not provide technical support for third-party Pixel Streaming deployments. For guidance, we recommend referring to external Unreal Engine resources.

Convai-specific integration details for Pixel Streaming are available here:
https://docs.convai.com/api-docs/plugins-and-integrations/unreal-engine/guides/integration-with-pixel-streaming

Lastly, features like emotion handling, lipsync, and user inputs are fully supported by the Convai Unreal SDK by default, no extra configuration is required.

Let us know if you need any further assistance!