How to enable hands free convai

I am exploring the use of ai in a fairly specific use case, and I’m wondering if there is a way to have it interrupt the user based on the context of the conversation.

I.e the user is talking about a topic (cars for instance)

Something like this:

User: “I need to get my car fixed, ive noticed the steering wheel pulls to the left while driving. There are a few mechanics near me that could do it, I should call them etc. Etc. “ (The user may not specifically stop talking at this point and may even move on to another topic.)

At some point while the user is still talking, or by waiting for a short pause, the ai would interrupt and make a suggestion like:

Ai: “have you considered checking your tyre air pressure? Higher pressure on one or more wheels could cause this problem. “

In the use case I have in mind, the user would not be actively enabling or disabling their microphone, rather discussing and collaboratively problem solving in a more real time fashion.

Is something like this possible with convai?

This kind of simultaneous listening, thinking and responding in real time by interrupting the user or injecting additional information to a conversation?

My second question is, is it possible to connect convai to the internet for it to find up to date information? For instance if the user was discussing newer technology or current events?

Apologies if the question is a little long-winded, I’m having a tricky time trying to put this initial vision into words…

Hello,

Welcome to the Convai Developer Forum!

What you are describing is very close to our HandsFree conversation feature, which is currently available in beta for some of our SDKs. It allows more natural, continuous speech, where the character can listen and respond without the user manually toggling the microphone each time. I recommend checking our docs for the relevant SDK you are using here:
https://docs.convai.com/api-docs

For your second question: live WebSearch / real time internet access is currently not active in Convai. You can still provide up to date or domain specific knowledge by connecting external data sources (for example via the Knowledge Bank or External API), but Convai itself does not directly browse the web right now.

This topic was automatically closed 30 days after the last reply. New replies are no longer allowed.