Original Discord Post by tyke_18 | 2024-09-03 07:23:13
Hi I’ve had an app called TykeAI on Patreon since March, it was very basic at first but has developed well since then, it features interactive AI avatars in VR/MR, it used to use Inworld.AI.
I learnt about a week ago I wouldn’t have an Inworld license come September 9th due to them restructuring their licensing. I was told I have been put on a waiting list for when they could support me, but with having an app live on Patreon with paying subscribers, I could not wait.
So I got to work on integrating Convai about 1 week ago, here is the current status of my app using Convai. Voice activated commands via Actions aren’t yet implemented so I’m using the app’s menu.
Loving the multilingual integration and how we can choose the LLM.
I have lots of plans for the app and there’s lots to do, which is no problem as I love working on it! Thanks for reading and watching.
Embedded Content: Quest 3 MR - TykeAI - interactive AI avatars - multilingual ability…
Hi there
Quick vid to show how far I am into integrating a new AI system and showing the new multilingual ability. The main thing that doesn’t work at the moment is voice activation of dancing, exercising etc, but these work fine via the menu. All the features/options work apart from image analysis and the chat bubble, but I will get them wor…
Link: https://www.youtube.com/watch?v=4sFOrHCxx7E
By sliding upwards, I think you mean when the talk animation plays? I need to tweak that, it’s just the animation I selected for talking, I will use a better one for sure.
Reply by tyke_18 | 2024-09-03 08:12:31
By sliding upwards, I think you mean when the talk animation plays? I need to tweak that, it’s just the animation I selected for talking, I will use a better one for sure.
Reply by k3kalinix | 2024-09-03 08:15:54
timestamp 0.50
Reply by tyke_18 | 2024-09-03 08:19:25
Ah, I am adjusting the size/scale of the avatar with buttons Y and X, it’s to accommodate for users of different heights, I am not tall but I appreciate others are so just giving the ability to change the avatars size to suit the user if they wish to do so. In the video I just thought it would be fun to show them really tall, they can be 50 foot tall if you wanted!
Reply by mikefrommalta | 2024-09-05 06:04:12
Was it easy? <@708608540763357234>
Reply by tyke_18 | 2024-09-05 06:11:13
Thanks! If you use the the docs Building for VR | Documentation and select the auto or manual installation it will work ok. I had some issues with this, because my project is Unity BiRP and I think those docs expect your project to be URP. I just dragged in the Convai Essentials prefab from the Convai package, and edited a couple of Convai scripts to allow my own choice of button/trigger press to activate the user being allowed talk without using the Convai Input Manager, and to always have an active NPC nearby as I didn’t need the detection system that Convai uses to activate an NPC to talk to etc. If you want more details just let me know but please be aware if you edit the scripts they may not be compatible with future updates.
Embedded Content: Building for VR | API Docs
Building for VR - Unity Plugin Guide for VR development with Convai.
Link: Building for VR | Documentation
Reply by mikefrommalta | 2024-09-05 06:16:42
Thanks for your great response
Reply by tyke_18 | 2024-09-05 06:20:06
Yep I know, my app is or was live on Patreon with a couple of hundred users, had to stop new members joining last month, bad all round. But hey converting to Convai has been easier than I expected. Give those docs a try, if you get stuck just fire away with some questions, or put a post in the support section as K3 really knows his stuff. If I can help out I will I will be glad to share code etc.
Very pleased to say the relaunch of my app with a new Convai integration is being very well received up to now, not a single negative comment (the image shows some of the comments)
I’ve had an app called TykeAI on Patreon since March, it was very basic at first but has developed well since then, it features interactive AI avatars in VR/MR, it used to use Inworld.AI.
