Posted by Thomas Ezan – Sr Developer Relation Engineer (@lethargicpanda)
We’re excited to announce Gaze Hyperlink because the winner of the Finest Android App for our Gemini API Developer Competitors!
This progressive app demonstrates the potential of the Gemini API in offering a communication system for people with Amyotrophic lateral sclerosis (ALS) who develop extreme motor and verbal disabilities, enabling them to kind sentences with solely their eyes.
About Gaze Hyperlink
Gaze Hyperlink makes use of Google’s Gemini 1.5 Flash mannequin to foretell the consumer’s meant sentence primarily based on just a few key phrases and the context of the dialog.
For instance if the context is “Is the room temperature okay?” and the consumer replies “scorching AC two” the app will leverage Gemini to generate the total sentence “I’m scorching, are you able to flip the AC down by two levels?”.
The Gaze Hyperlink crew took benefit of Gemini 1.5 Flash multilingual capabilities to let the app generate sentences in English, Spanish and Chinese language, the three languages at the moment supported by the app.
We had been actually impressed by the Gaze Hyperlink app. The crew used the Gemini API mixed with ML Equipment Face Detection to empower people with ALS offering them with a strong communication system that’s each accessible and reasonably priced.
With Gemini 1.5 Flash at the moment supporting 38 languages, it’s doable for Gaze Hyperlink so as to add assist for extra languages sooner or later. As well as, the mannequin’s multimodal talents may allow the crew to reinforce the consumer expertise by integrating picture, audio and video to reinforce the context of the dialog.
Construct with the Gemini API
The results of the combination of the Gemini API in Gaze Hyperlink is inspiring. If you’re engaged on an Android app at this time, we encourage you to be taught concerning the Gemini API capabilities to see how one can efficiently add generative AI to your app and delight your customers.
To get began, go to the Android AI documentation!