Search
Close this search box.
Search
Close this search box.

Microsoft Built Supercomputer for OpenAI to Train Large AI Models

Microsoft Supercomputer for OpenAI

Listen to the Podcast:

To train enormous sets of models, Microsoft has created a supercomputer for the OpenAI artificial intelligence (AI) research startup. The business incorporated thousands of Nvidia A100 graphics chips to assist the ChatGPT and Bing AI chatbots.

The Windows manufacturer committed to constructing a “massive, cutting-edge supercomputer” in exchange for its $1 billion investment in OpenAI.

Why did Microsoft Build a Supercomputer?

The purpose of this supercomputer is to offer the computational power required to train and retrain an ever-growing number of AI models using massive amounts of data over protracted periods.

Nidhi Chappell, Microsoft’s head of product for Azure high-performance computing and AI, stated, “One of the things we had learnt from research is that the larger the model, the more data you have, and the longer you can train, the greater the accuracy of the model is.

She continued that in addition to having the most prominent infrastructure, you also need to be able to run it dependably for an extended amount of time. “There was also a tremendous push to get bigger models trained for a more extended period.

Microsoft said it is constructing a supercomputer for OpenAI that would be hosted in Azure and used exclusively to train AI models at its Build developers conference in 2020.

Greg Brockman, president and co-founder of OpenAI, said, “Co-designing supercomputers with Azure has been necessary for scaling our demanding AI training demands, making our research and alignment work on systems like ChatGPT possible.

Microsoft Supercomputer Architecture?

Microsoft modified how it arranged servers on racks to prevent power outages and connected tens of thousands of Nvidia A100 graphics chips to train AI models.

This time. That’s how ChatGPT came to be possible. One model that resulted from it is that. According to Chappell, who Bloomberg quoted, there will be a ton more.

Scott Guthrie, the executive vice president of Microsoft responsible for cloud and AI, stated that the project’s cost is “definitely more” than several hundred million dollars.

Microsoft Azure is Getting more Power

OpenAI also requires a powerful cloud architecture in addition to a supercomputer to process and train models. Microsoft is already working on enhancing the AI capabilities of Azure Cloud with new virtual machines that utilize Quantum-2 InfiniBand networking and Nvidia’s H100 and A100 Tensor Core GPUs.

With this, Microsoft will make it possible for OpenAI and other businesses that rely on Azure to train bigger and more intricate AI models. Some businesses are already deploying AI chatbots.

OpenAI was one of the earliest proof points demonstrating the necessity to create special purpose clusters centered on supporting enormous training workloads. Eric Boyd, corporate vice president of Azure AI at Microsoft, continued, “We worked closely with them to identify what are the important things they were looking for as they built out their training environments and what were the essential things they needed.


Subscribe to Our Newsletter

Related Articles

Top Trending

Nintendo lawsuit Rhode Island Game Piracy
Nintendo Takes Legal Action Against Rhode Island Company Over Game Piracy Claims
Google Cloud Stack Overflow Gemini Partnership
Google Cloud and Stack Overflow Unite: Gemini Project Elevates Developer Experience
Online Search Decline 2026 Change Drivers
2026 Forecast: The Key Drivers Behind a 25% Drop in Online Searches
March 1 Zodiac
March 1 Zodiac: Understanding Your Pisces Personality & Future
European Countries Dual Citizenship
Top 17 Dual Citizenship-Friendly European Countries

LIFESTYLE

Taurine Key to Extending Life Research Finds
Taurine: The Secret Ingredient for a Longer Life? Latest Research Insights
Strategies to Beat Procrastination
Beat Procrastination: Effective Strategies to Stay Productive!
Egyptian Cotton Sheets for Your Bed
A Beginner's Guide to Choosing the Perfect Egyptian Cotton Sheets for Your Bed
Long Lehenga Choli
Elegance Redefined: Navigating the Diverse World of Long Lehenga Choli Designs
valentines day outfits
Top 20 Trendy Valentine's Day Outfits in 2024 For Every Occasion

Entertainment

how tall is adin ross
How Tall is Adin Ross? An In-Depth Look at the Twitch Star's Height
Netflix Ends Apple Billing Legacy Subscribers
Netflix Ends Apple Billing for Existing Subscribers: What You Need to Know?
Avatar The Last Airbender
Avatar' Reigns on Netflix, 'The Abyss' Emerges as Week's Top Watch
Taylor Swift Father Photographer Assault Accusation
Scott Swift, Taylor Swift's Dad, Faces Accusations From Photographer
female naruto characters
50 Most Iconic Female Naruto Characters [Ranked]

GAMING

Nintendo lawsuit Rhode Island Game Piracy
Nintendo Takes Legal Action Against Rhode Island Company Over Game Piracy Claims
Live Casino Influence on Virtual Gaming
Live Casino Influence on Virtual Gaming
Sports Betting vs Online Casinos
Sports Betting vs Online Casinos: Where is it Easier to Win?
Play Games for Bitcoin
Can You Play Games for Bitcoin? 
Most Played Games at Online Casinos
Discover the Most Played Games at Online Casinos

BUSINESS

Young Australians Money
Why Young Australians Need to Know About Money?
NPS Tier 1 vs Tier 2
NPS Tier 1 vs Tier 2: Understanding the Differences
Tips to Manage Your Small Business in 2024
5 Tips to Manage Your Small Business in 2024
bluefire wilderness complaints
Addressing Concerns: Understanding Bluefire Wilderness Complaints
Work Life Balance Europe vs America Comparison
Europe vs America: Decoding Work-Life Balance Differences

TECHNOLOGY

Nintendo lawsuit Rhode Island Game Piracy
Nintendo Takes Legal Action Against Rhode Island Company Over Game Piracy Claims
Google Cloud Stack Overflow Gemini Partnership
Google Cloud and Stack Overflow Unite: Gemini Project Elevates Developer Experience
Online Search Decline 2026 Change Drivers
2026 Forecast: The Key Drivers Behind a 25% Drop in Online Searches
Rogue Chatbots Microsoft AI Copilot Concerns
Rogue Chatbots: Microsoft Investigates AI Copilot's Unsettling Messages
Intel Chips 100 Million AI PCs 2025
Intel's Bold Goal: Powering Chips for 100M AI PCs by 2025

HEALTH

Norovirus Cases Surge US Northeast CDC Report
US Norovirus Surge: CDC Highlights Spike in Northeast Cases
Top Healthiest and Unhealthiest Countries
Top Healthiest and Unhealthiest Countries Globally - 2024 Rankings
Best Way to Prevent Gum Disease
What is the Best Way to Prevent Gum Disease?
Norovirus Outbreak Northeast CDC Data
Norovirus Outbreak Hits Northeast: Latest CDC Data Reveals Spread
Brain Stimulation RTMS vs DTMS
Decoding Brain Stimulation Therapies: RTMS vs DTMS Explained