Search
Close this search box.
Search
Close this search box.

Apple Launches 8 Compact AI Models for Enhanced On-Device Use

Apple launches ai language models for on-device use

Apple just unveiled these nifty little AI language models called OpenELM. They’re pretty compact, so you can run them right on your smartphone instead of needing some beefy cloud servers.

It’s all part of this growing trend of “small language models” that are gaining traction in the AI world.

OpenELM models are still in the research phase, but they could be the foundation for some seriously cool on-device AI features from Apple down the line. Microsoft’s doing something similar with their Phi-3 models, aiming to pack a punch in terms of language understanding and processing, all while keeping things local.

Some of these OpenELM models are super tiny, ranging from just 270 million to 3 billion parameters. That’s nothing compared to behemoths like Meta’s Llama 3 or OpenAI’s GPT-3, which have billions upon billions of parameters. But here’s the thing: recent research is all about making these smaller models as capable as their larger predecessors.

Apple’s giving us eight different OpenELM models to play with. Four of them are “pretrained,” which is basically the raw, next-token version. The other four are instruction-tuned, making them perfect for building AI assistants and chatbots.

  1. OpenELM-270M
  2. OpenELM-450M
  3. OpenELM-1_1B
  4. OpenELM-3B
  5. OpenELM-270M-Instruct
  6. OpenELM-450M-Instruct
  7. OpenELM-1_1B-Instruct
  8. OpenELM-3B-Instruct

OpenELM models can handle a whopping 2048 tokens at a time, which is pretty impressive. Apple trained them on some seriously massive datasets, like RefinedWeb, a cleaned-up version of PILE, and chunks of RedPajama and Dolma v1.6. All in all, we’re talking about 1.8 trillion tokens of data. That’s a mind-boggling amount of information for these AI models to chew on.

Now, here’s where it gets really interesting. Apple’s using this nifty “layer-wise scaling strategy” for OpenELM. In summary, this clever strategy distributes parameters across each layer of the model, thereby reducing computational resources and enhancing performance. Get this: OpenELM managed to beat Allen AI’s OLMo 1B by 2.36 percent in accuracy, and it only needed half the pre-training tokens to do it. That’s some seriously efficient AI right there.

But wait, there’s more! Apple’s not just giving us the OpenELM models; they’re also sharing the code for CoreNet, the library they used to train these bad boys. Plus, they’ve included step-by-step recipes to recreate the model weights, which is pretty rare for a big tech company. Apple’s all about transparency with this release, aiming to “empower and enrich the open research community.”

Of course, Apple’s not naive. They know that since these models were trained on public datasets, there’s a chance they might spit out some inaccurate, harmful, or biased stuff. But hey, that’s part of the learning process.

We haven’t seen Apple integrate this cutting-edge AI into their devices yet, but rumor has it that iOS 18 might come packed with some nifty on-device AI features. And who knows, maybe they’ll even team up with Google or OpenAI to give Siri a much-needed upgrade.

The Information is Taken from Ars Technica, Times of India and FirstPost


Subscribe to Our Newsletter

Related Articles

Top Trending

jack doherty net worth
Jack Doherty Net Worth: From Flipping Markers To Making Big Bucks
Smart Gadgets For An Eco-Friendly Home
Living With Less, Powered By Tech: 7 Smart Gadgets For An Eco-Friendly Home
Yodayo
Discover The Magic of Yodayo: AI-Powered Anime At Yodayo Tavern
Role of RAID Configurations in VPS Storage
Understanding the Role of RAID Configurations in VPS Storage
How to Stay Updated on the Latest Crypto Trends
How to Stay Updated on the Latest Crypto Trends?

LIFESTYLE

12 Budget-Friendly Activities That Won’t Cost a Penny
12 Fun and Budget-Friendly Activities That Are Completely Free
lovelolablog code
Unlock Exclusive Lovelolablog Code For Discount Deals in 2025
Sustainable Kiwi Beauty Products
10 Sustainable Kiwi Beauty Products You Should Try for a Greener Routine
Best E-Bikes for Seniors
Best E-Bikes for Seniors with Comfort and Safety in Mind
wellhealthorganic.com effective natural beauty tips
Top 5 Well Health Organic Beauty Tips for Glowing Skin

Entertainment

jack doherty net worth
Jack Doherty Net Worth: From Flipping Markers To Making Big Bucks
Yodayo
Discover The Magic of Yodayo: AI-Powered Anime At Yodayo Tavern
netflix 2025 q1 results revenue up 13 percent
Netflix Surpasses Q1 Forecast with 13% Revenue Growth
selena gomez x rated photo background shocks fans
Selena Gomez Leaves Fans Shocked by Risqué Photo Background
xqc net worth
XQc Net Worth Reaches $50 Million By 2025: A Streamer's Success Story

GAMING

Which Skins Do Pro Players Use Most Often
Which Skins Do Pro Players Use Most Often in 2025?
Major Security Risks When Visiting iGaming Platforms
12 Major Security Risks When Visiting iGaming Platforms (And Proper Remedies)
Familiarity with Online Casino Games Builds Gameplay Confidence
How Familiarity with Online Casino Games Builds Gameplay Confidence?
Pixel Art Games
Why Pixel Art Games Are Still Thriving in 2025?
Most Unfair Levels In Gaming History
The Most Unfair Levels In Gaming History

BUSINESS

IRA Rollover vs Transfer
IRA Rollover vs Transfer: Key Differences, Benefits, and Choosing the Right Option
optimizing money6x real estate
Money6x Real Estate: The Power of Real Estate Without the Headaches
Crypto Tax Strategies for Investor
Don't Miss Out: Learn the Top 15 Crypto Tax Strategies for Investors in 2025
Flexible Trailer Leasing
How Flexible Trailer Leasing Supports Seasonal Demand and Inventory Surges?
Importance Of Continuous Compliance Monitoring
Understanding The Importance Of Continuous Compliance Monitoring

TECHNOLOGY

Smart Gadgets For An Eco-Friendly Home
Living With Less, Powered By Tech: 7 Smart Gadgets For An Eco-Friendly Home
Beta Character ai
What Makes Beta Character AI Such a Promising AI Platform?
Google Ads Safety report 2024
Google Ads Crackdown 2024: 5.1B Blocked, 39M Accounts Suspended
katy perry bezos fiancee not real astronauts
Trump Official Says Katy Perry, Bezos’ Fiancée Not Real Astronauts
Platforms Offering Money-Back Guarantees And Free Trials
Top 10 Platforms Offering Money-Back Guarantees And Free Trials

HEALTH

How to Identify and Manage Burnout in the Workplace
How to Identify and Manage Burnout in the Workplace?
How to Start a Mental Wellness Program at Work
How to Start a Mental Wellness Program at Your Office?
Tips For Mentally Healthy Leadership
10 Tips For Mentally Healthy Leadership
Back Pain In Athletes
Back Pain In Athletes: Prevention And Recovery Strategies
Sinclair Method
What is the Sinclair Method?