Apple's Hardware Is Ready for On-Device AI and PrismML Just Delivered a Real Breakthrough
A small start-up just released a 27-billion-parameter AI model that can be run for free on an iPhone.
Overview
On July 14, a start-up with Caltech roots, PrismML, released Bonsai 27B, a free artificial intelligence (AI) model compressed enough to run locally on an Apple (NASDAQ: AAPL) iPhone 17 Pro. According to the company, it retains roughly 90% of the original model's performance.
A capable AI small enough to run on an iPhone is great news for consumers. PrismML's CEO recently told CNBC that Apple is in "very early" discussions about the technology. In time, free, local, open-weight AI could become an à la carte menu for consumers, and Apple's own silicon was designed to run them.
Details
Source
Originally published at www.fool.com.
Related Articles
Disclaimer: This article is for informational purposes only and does not constitute investment advice. Data may be delayed up to 15 minutes. Past performance is not indicative of future results. Consult a licensed financial advisor before making investment decisions.