Posted by Terence Zhang – Developer Relations Engineer, and Adrien Couque – Software program Engineer
AI can improve the consumer expertise and productiveness of Android apps. In case you’re seeking to construct GenAI options that profit from further knowledge privateness or offline inference, on-device GenAI is an efficient alternative because it processes prompts immediately in your system with none server calls.
Gemini Nano is essentially the most environment friendly mannequin in Google’s Gemini household, and Android’s foundational mannequin for operating on-device GenAI. It is supported by AICore, a system service that works behind the scenes to centralize the mannequin’s runtime, guarantee its secure execution, and defend your privateness. With Gemini Nano, apps can provide extra customized and dependable AI experiences with out sending your knowledge off the system.
On this weblog publish, we’ll present an introductory look into how Gemini Nano and AICore work collectively to ship highly effective on-device AI capabilities whereas prioritizing customers’ privateness and security.
Personal Compute Core (PCC) compliance
At Google I/O 2021, we launched Personal Compute Core (PCC), a safe atmosphere designed to maintain your knowledge non-public. At I/O in 2024, we shared that AICore is PCC compliant, which means that it operates below strict privateness guidelines. It could possibly solely work together with a restricted set of different system packages which can be additionally PCC compliant, and it can not immediately entry the web. Any requests to obtain fashions or different data are routed via a separate, open-source companion APK referred to as Personal Compute Companies.
This framework helps defend your privateness whereas nonetheless permitting apps to profit from the ability of Gemini Nano. Contemplate a keyboard software utilizing Gemini Nano for a reply suggestion characteristic. With out PCC, the keyboard would require direct entry to the dialog context. With PCC, the code that has entry to the dialog runs in a safe sandbox and interacts immediately with Gemini Nano to generate strategies on behalf of the keyboard. This permits the keyboard app to profit from Gemini Nano’s capabilities with out immediately accessing or storing delicate dialog knowledge. Yow will discover out extra about how this works within the PCC Whitepaper.
Defending your privateness via knowledge isolation
AICore is constructed to isolate every request to guard your privateness. This prevents apps from accessing knowledge that doesn’t belong to them. Requests are dealt with independently and processed from a single app at a time to mitigate the chance of information being uncovered to different apps.
Moreover, AICore does not retailer any document of the enter knowledge or the ensuing outputs after processing every request. This design, mixed with the truth that Gemini Nano’s inference occurs immediately in your system, helps guarantee your app’s knowledge stays non-public and safe.
Prioritizing Security in Gemini Nano
We’re dedicated to constructing AI responsibly, and that features ensuring Gemini Nano is secure. We have carried out a number of layers of safety to restrict dangerous or unintended outcomes:
- Native mannequin security: All Gemini fashions, together with Gemini Nano, are educated to be safety-aware out of the field. This implies security issues are constructed into the core of the mannequin, not simply added as an afterthought.
- Security conscious fine-tuning: We use a LoRA fine-tuning block to adapt Gemini Nano for the wants of particular apps. After we practice the LoRA block, we incorporate security knowledge particular to the app’s use case to protect and even improve the mannequin’s security options throughout fine-tuning the place relevant.
- Security filters on enter and output: As a closing safeguard, each the enter immediate and outcomes generated by the Gemini Nano runtime are evaluated towards our security filters earlier than offering the outcomes to the app. This helps forestall unsafe content material from slipping via, with none loss in high quality.
These layers of safety work collectively to make sure that Gemini Nano offers a secure and useful expertise for everybody.
Get began
Study extra about Gemini Nano for app improvement, and attempt it out in your individual app!
Be sure you try the opposite wonderful AI on Android Highlight week content material!