Search
Close this search box.
Search
Close this search box.

Apple Launches 8 Compact AI Models for Enhanced On-Device Use

Apple launches ai language models for on-device use

Apple just unveiled these nifty little AI language models called OpenELM. They’re pretty compact, so you can run them right on your smartphone instead of needing some beefy cloud servers.

It’s all part of this growing trend of “small language models” that are gaining traction in the AI world.

OpenELM models are still in the research phase, but they could be the foundation for some seriously cool on-device AI features from Apple down the line. Microsoft’s doing something similar with their Phi-3 models, aiming to pack a punch in terms of language understanding and processing, all while keeping things local.

Some of these OpenELM models are super tiny, ranging from just 270 million to 3 billion parameters. That’s nothing compared to behemoths like Meta’s Llama 3 or OpenAI’s GPT-3, which have billions upon billions of parameters. But here’s the thing: recent research is all about making these smaller models as capable as their larger predecessors.

Apple’s giving us eight different OpenELM models to play with. Four of them are “pretrained,” which is basically the raw, next-token version. The other four are instruction-tuned, making them perfect for building AI assistants and chatbots.

  1. OpenELM-270M
  2. OpenELM-450M
  3. OpenELM-1_1B
  4. OpenELM-3B
  5. OpenELM-270M-Instruct
  6. OpenELM-450M-Instruct
  7. OpenELM-1_1B-Instruct
  8. OpenELM-3B-Instruct

OpenELM models can handle a whopping 2048 tokens at a time, which is pretty impressive. Apple trained them on some seriously massive datasets, like RefinedWeb, a cleaned-up version of PILE, and chunks of RedPajama and Dolma v1.6. All in all, we’re talking about 1.8 trillion tokens of data. That’s a mind-boggling amount of information for these AI models to chew on.

Now, here’s where it gets really interesting. Apple’s using this nifty “layer-wise scaling strategy” for OpenELM. In summary, this clever strategy distributes parameters across each layer of the model, thereby reducing computational resources and enhancing performance. Get this: OpenELM managed to beat Allen AI’s OLMo 1B by 2.36 percent in accuracy, and it only needed half the pre-training tokens to do it. That’s some seriously efficient AI right there.

But wait, there’s more! Apple’s not just giving us the OpenELM models; they’re also sharing the code for CoreNet, the library they used to train these bad boys. Plus, they’ve included step-by-step recipes to recreate the model weights, which is pretty rare for a big tech company. Apple’s all about transparency with this release, aiming to “empower and enrich the open research community.”

Of course, Apple’s not naive. They know that since these models were trained on public datasets, there’s a chance they might spit out some inaccurate, harmful, or biased stuff. But hey, that’s part of the learning process.

We haven’t seen Apple integrate this cutting-edge AI into their devices yet, but rumor has it that iOS 18 might come packed with some nifty on-device AI features. And who knows, maybe they’ll even team up with Google or OpenAI to give Siri a much-needed upgrade.

The Information is Taken from Ars Technica, Times of India and FirstPost


Subscribe to Our Newsletter

Related Articles

Top Trending

low maintenance short natural haircuts for black females
5 Low Maintenance Short Natural Haircuts for Black Females
What is Claressa Shields' Boxing Record
What is Claressa Shields' Boxing Record? A Detailed Examination of her Career Stats and Achievements
How Much is Claressa Shields Worth
How Much is Claressa Shields Worth? A Deep Dive into the Boxer's Net Worth and Earnings
andy cohen net worth
Andy Cohen Net Worth: Find Out How He Became a Multi-Millionaire in 2025
Who is Claressa Shields' Mother
Who is Claressa Shields' Mother: The Untold Story of Her Family and Struggles

LIFESTYLE

summer birthday party ideas
Creative Summer Birthday Party Ideas for Kids in 2025
May 6 Zodiac
May 6 Zodiac: Positive Traits, Compatibility and More about Taurus
self storage solutions for life transitions
How Self Storage Can Help During Major Life Changes (Divorce, Moving, etc.)?
why is my poinsettia dying
Why Is My Poinsettia Dying? Tips To Revive Your Wilting Poinsettia Plant
crypto retirement plan strategies
7 Ways Crypto Can Reshape Your Retirement Plan for the Future

Entertainment

andy cohen net worth
Andy Cohen Net Worth: Find Out How He Became a Multi-Millionaire in 2025
rihanna hinted pregnancy before met gala
Rihanna Hinted at Pregnancy Before Met Gala, Says Anna Wintour
Jules Ari
Jules Ari Age, Height, Relationship, Family, Biography, and Net Worth
rocket league unblocked
Rocket League Unblocked: Soccer And Vehicular Mayhem Online Game
smokey robinson sexual assault allegations
Smokey Robinson Faces Sexual Assault Allegations by 4 Women

GAMING

Best Mobile Horror Games
The Best Mobile Horror Games That Will Keep You Up at Night
Evolution of Video Game Graphics
The Evolution of Video Game Graphics: 1980s to 2025
Best Workouts Inspired by Video Games
Level Up Your Fitness: Best Video Game-Inspired Workouts
rocket league unblocked
Rocket League Unblocked: Soccer And Vehicular Mayhem Online Game
Maksym Krippa GSC Game World
S.T.A.L.K.E.R. Reimagined: How Maksym Krippa’s Entry Reshaped GSC Game World in 2023

BUSINESS

Business Behind Game Localization
The Business Behind Game Localization: How It Works
International Employment Agencies
How international employment agencies can help you find talent in hard-to-reach markets?
Transition Your Business to Web3
How to Transition Your Business to Web3 Successfully
How to Calculate Quarterly Tax Payments
How to Calculate Quarterly Tax Payments in 5 Easy Steps
credit suisse tax evasion
Credit Suisse Fined $511M for U.S. Offshore Tax Evasion Scheme

TECHNOLOGY

bill gates accuses elon musk of harming poor children
Bill Gates Blames Elon Musk for Harming World's Poorest Children
interactive videos with AI voice
Guide for Making Interactive Videos with AI Voice
Maksym Krippa GSC Game World
S.T.A.L.K.E.R. Reimagined: How Maksym Krippa’s Entry Reshaped GSC Game World in 2023
Strengthening Cybersecurity with Security Operations
Strengthening Cybersecurity with Security Operations, CWPP, and Product Security
pitch a game idea
How to Pitch a Game Idea to a Developer or Publisher?

HEALTH

Yimusanfendi
7 Incredible Benefits of Yimusanfendi Meditation and Possible Side Effects
Connection Between Hydration and Urinary Health
The Connection Between Hydration and Urinary Health
Neuralink Brain Implant Patient Regains Speech
Neuralink Brain Implant Helps ALS Patient Regain Speech with AI Support
Wegovy for Weight Loss
Wegovy for Weight Loss: Is It Worth Buying Online?
Role of Sperm DNA Fragmentation Testing in IVF
The Role of Sperm DNA Fragmentation Testing in IVF with ICSI Success