Qualcomm needs its Snapdragon chips to be on the coronary heart of the on-device synthetic intelligence motion, asserting that its latest-generation cell platform can generate a picture utilizing Steady Diffusion in beneath a second.
“We’re getting into the period of AI, and on-device generative AI will play a important function in delivering highly effective, quick, private, environment friendly, safe and extremely optimized experiences,” claims Qualcomm’s chief government officer Cristiano Amon of his firm’s focus. “Snapdragon is uniquely positioned to assist form and capitalize on the on-device AI alternative and you will notice generative AI going nearly in all places that Snapdragon goes.”
Key to the corporate’s hope of driving a future the place giant language fashions (LLMs) and different synthetic intelligence methods run on-device with out counting on cloud computing is the Snapdragon 8 Gen. 3 platform. Boasting “essentially the most highly effective NPU [Neural Processing Unit]” the corporate has but launched, the mobile-centric chip is claimed to “showcase excessive speeds in generative AI duties.”
Precisely what which means varies relying on workload, naturally, however whereas Qualcomm hasn’t shared uncooked specs it does have just a few illustrative examples: a Microsoft Home windows 11 laptop computer or pill based mostly on the Snapdragon 8 Gen. 3 can course of 30 giant language mannequin (LLM) tokens per second to drive a responsive on-device chat assistant, whereas a smartphone can generate photos from textual content prompts utilizing Steady Diffusion in beneath a second.
“Our years of AI growth, together with essentially the most highly effective mixture of CPU, NPU, and GPU accessible in gadgets, and our help of all main fashions operating natively, means we are able to convey the advantages of generative AI to customers worldwide and throughout a number of gadget classes,” claims Amon.
On the similar time, Qualcomm is aiming to knock Intel, AMD, and even Apple off the top-performance PC slots with the Snapdragon X Elite, a tool household which the corporate claims “outpaces competing laptop computer CPUs and units a brand new bar in AI efficiency.” On the software program entrance, the corporate has introduced partnerships with Microsoft, Meta, Google, HP, Stability.ai, Baichuan AI, Baidu, and extra for Snapdragon-powered on-device AI.
events can study extra in regards to the firm’s bulletins at Snapdragon Summit 2023.