Search
Close this search box.
Search
Close this search box.

Apple Launches 8 Compact AI Models for Enhanced On-Device Use

Apple launches ai language models for on-device use

Apple just unveiled these nifty little AI language models called OpenELM. They’re pretty compact, so you can run them right on your smartphone instead of needing some beefy cloud servers.

It’s all part of this growing trend of “small language models” that are gaining traction in the AI world.

OpenELM models are still in the research phase, but they could be the foundation for some seriously cool on-device AI features from Apple down the line. Microsoft’s doing something similar with their Phi-3 models, aiming to pack a punch in terms of language understanding and processing, all while keeping things local.

Some of these OpenELM models are super tiny, ranging from just 270 million to 3 billion parameters. That’s nothing compared to behemoths like Meta’s Llama 3 or OpenAI’s GPT-3, which have billions upon billions of parameters. But here’s the thing: recent research is all about making these smaller models as capable as their larger predecessors.

Apple’s giving us eight different OpenELM models to play with. Four of them are “pretrained,” which is basically the raw, next-token version. The other four are instruction-tuned, making them perfect for building AI assistants and chatbots.

  1. OpenELM-270M
  2. OpenELM-450M
  3. OpenELM-1_1B
  4. OpenELM-3B
  5. OpenELM-270M-Instruct
  6. OpenELM-450M-Instruct
  7. OpenELM-1_1B-Instruct
  8. OpenELM-3B-Instruct

OpenELM models can handle a whopping 2048 tokens at a time, which is pretty impressive. Apple trained them on some seriously massive datasets, like RefinedWeb, a cleaned-up version of PILE, and chunks of RedPajama and Dolma v1.6. All in all, we’re talking about 1.8 trillion tokens of data. That’s a mind-boggling amount of information for these AI models to chew on.

Now, here’s where it gets really interesting. Apple’s using this nifty “layer-wise scaling strategy” for OpenELM. In summary, this clever strategy distributes parameters across each layer of the model, thereby reducing computational resources and enhancing performance. Get this: OpenELM managed to beat Allen AI’s OLMo 1B by 2.36 percent in accuracy, and it only needed half the pre-training tokens to do it. That’s some seriously efficient AI right there.

But wait, there’s more! Apple’s not just giving us the OpenELM models; they’re also sharing the code for CoreNet, the library they used to train these bad boys. Plus, they’ve included step-by-step recipes to recreate the model weights, which is pretty rare for a big tech company. Apple’s all about transparency with this release, aiming to “empower and enrich the open research community.”

Of course, Apple’s not naive. They know that since these models were trained on public datasets, there’s a chance they might spit out some inaccurate, harmful, or biased stuff. But hey, that’s part of the learning process.

We haven’t seen Apple integrate this cutting-edge AI into their devices yet, but rumor has it that iOS 18 might come packed with some nifty on-device AI features. And who knows, maybe they’ll even team up with Google or OpenAI to give Siri a much-needed upgrade.

The Information is Taken from Ars Technica, Times of India and FirstPost


Subscribe to Our Newsletter

Related Articles

Top Trending

Circular Economy
The Circular Economy Explained: Why It Matters in 2025
hearthstats interesting news
Hearthstats Interesting News: Latest Updates And Real-Time Hearthstone Updates
How Gen Z Is Shaping the Future of Sustainable Brands
How Gen Z Is Driving the Demand for Sustainable Brands
doctor odyssey disney sexual harassment lawsuit
Doctor Odyssey Crew Sues Disney Over On-Set Sexual Harassment
Taylor Swift Buys Back Her First 6 Albums’ Master Recordings
Taylor Swift Buys Back Her First 6 Albums’ Master Recordings

LIFESTYLE

Smart Skincare
What Smart Skincare Looks Like in a World of Overload
Swim Academy in Amman
How to Choose the Right Swim Academy in Amman?
Shopping in Madrid
Shopping in Madrid: From Exclusive Boutiques to Vintage Markets: A Shopping Lover's Guide
how long does dermaplaning last
How Long Does Dermaplaning Last? All About Dermaplaning Duration
Selling Used Designer Handbags
10 Expert Tips for Selling Your Used Designer Handbags for Top Dollar

Entertainment

doctor odyssey disney sexual harassment lawsuit
Doctor Odyssey Crew Sues Disney Over On-Set Sexual Harassment
Taylor Swift Buys Back Her First 6 Albums’ Master Recordings
Taylor Swift Buys Back Her First 6 Albums’ Master Recordings
lainey wilson boyfriend
Lainey Wilson’s Boyfriend: Love Story That Will Surprise You
jasmine crockett net worth
Jasmine Crockett Net Worth: Congress Representative Crockett's Impressive $9 Million in 2025
Justin Bieber Reacts Hailey $1 Billion Rhode Deal
Justin Bieber Reacts to Hailey’s $1 Billion Rhode Deal

GAMING

Parental Guide for Kid-Friendly Gaming
Parental Guide to Safe and Age-Appropriate Gaming for Kids
How Video Games Help Reduce Stress
Gaming for Mental Health: How Video Games Help Reduce Stress
unblocked games granny
Play Granny Unblocked: Online Game Fun With Unblocked Games Granny
PC vs Console Gaming
PC vs Console Gaming: Which One Should You Choose?
Guide to Building a Custom Gaming PC
Beginner’s Guide to Building a Custom Gaming PC

BUSINESS

Circular Economy
The Circular Economy Explained: Why It Matters in 2025
Rise of Urban Micro-Fulfillment Centers
The Rise of Urban Micro-Fulfillment Centers: What It Means for E-Commerce
ftasiastock technology news
Breaking Ftasiastock Technology News: Supply Chain Insights Unveiled
Digital Nomad Taxes
Digital Nomad Taxes Explained: How to Legally Save Thousands in 2025
AI and Drones in Last-Mile Delivery
How AI and Drones Are Revolutionizing Last-Mile Delivery in 2025

TECHNOLOGY

Anthropic Launches Voice Chat for Claude Mobile Users
Anthropic Launches Real-Time Voice Chat for Claude Mobile Users
Instagram Story Viewer Tools
Instagram Story Viewer Tools That Actually Work in 2025
Protect Yourself from Data Breaches
How to Protect Yourself from Data Breaches?
AI Portraits
Retro Royalty: Design AI Portraits of Imaginary Kings and Queens
Protect Teenagers From Online Scams
How to Protect Teenagers From Online Scams?

HEALTH

How Video Games Help Reduce Stress
Gaming for Mental Health: How Video Games Help Reduce Stress
Meaning in the Everyday
Moments that Change: Do We See the Meaning in the Everyday?
Tighten Your Skin After Losing Weight
5 Ways to Tighten Your Skin After Losing Weight
Physician Contract Negotiations
What Are the Common Red Flags in Physician Contract Negotiations?
Who Benefits Most from In-Home Care Services
Who Benefits Most from In-Home Care Services