Search
Close this search box.
Search
Close this search box.

ChatGPT Bias Alert: How ‘Black Names’ Are Being Sidelined in Job Searches?

ChatGPT Enable Internet Browsing Feature

ChatGPT has been accused of favoring names distinct to different racial groups for different jobs, according to a Bloomberg News investigation.

OpenAI offers businesses the opportunity to utilize its AI-powered chatbot technology for HR and recruiting purposes.

ChatGPT has been trained on a wide range of data sources, like books, articles, and social media posts, which can lead to reflecting the biases present in that data.

Bloomberg chose real names from census data that are representative of specific races and ethnicities at least 90 percent of the time and assigned them to job resumes of equal qualifications.

The widely used chatbot ChatGPT 3.5 processed the resumes, and depending on the position it was evaluating them for, it displayed bias towards particular races.

According to Bloomberg, the experiments revealed that utilizing generative AI for recruiting and hiring could lead to widespread automated discrimination.

When asked to rank eight equally-qualified resumes for a real financial analyst role at a Fortune 500 company, ChatGPT consistently showed a bias against resumes with names distinct to black Americans.

Resumes with names unique to Asian women were consistently ranked as the top candidate for the financial analyst role more than twice as often compared to those with names unique to black men.

The experiment used four different kinds of job openings: financial analyst, retail manager, senior software engineer, and HR business partner.

According to the analysis, ChatGPT’s preferences for gender and race varied based on the specific job being evaluated for.

According to Bloomberg, black Americans were less likely to be selected as top candidates for financial analyst and software engineer positions.

The bot seldom selects names typically linked with men as the top choice for roles traditionally held by women, like retail and HR positions.

When compared to resumes with male-specific names, Hispanic women were nearly twice as likely to be chosen as the best applicant for an HR position.

OpenAI informed Bloomberg that the results generated by using GPT models ‘out-of-the-box’ may not align with the results produced by customers who can customize the software’s responses to meet their specific hiring requirements.

According to OpenAI, businesses could decide to remove names before entering resumes into a GPT model.

OpenAI frequently performs adversarial testing and red-teaming on its models to investigate how malicious actors could potentially misuse them, according to the company.

Seek Out, an HR tech company, has created its own AI recruiting tool that processes job descriptions using GPT and provides a list of candidates from platforms like LinkedIn and Github.

Hundreds of businesses, including Fortune 10 and tech organizations, are already utilizing the technology, according to SeekOut general counsel Sam Shaddox, who spoke with Bloomberg.

Saying, “Hey, there’s all this bias out there, but we’re just going to ignore it” is not the appropriate response, in Shaddox’s opinion.

Large language learning model technology (GPT) is the best solution for it because it can identify some of those biases and then work toward overcoming them.”

Emily Bender, a University of Washington computational linguistics professor, is less convinced.

According to Bender, a phenomenon known as automation bias occurs when individuals assume machines are objective in their decision-making, especially when contrasted to humans.

Nevertheless, it’s easy to picture businesses utilizing these systems claiming, “Well, we didn’t have any bias here; we just followed the computer’s instructions,” if they “result in a pattern of discriminatory hiring decisions.


Subscribe to Our Newsletter

Related Articles

Top Trending

Australian Online Learning Platforms Beating Global Competitors
20 Australian Online Learning Platforms Beating Global Competitors (2025 Comparison)
The Impact of Pre-Existing Conditions on Personal Injury Cases
The Impact of Pre-Existing Conditions on Personal Injury Cases
How to Choose the Right Lawyer for Your Case
Choose the Right Lawyer for Your Case: A Complete Guide
hard rock nick net worth
Hard Rock Nick Net Worth: Uncovering The Wealth of The Social Media Sensation
pros and cons of painting ceiling same color as walls
Pros and Cons of Painting Ceiling Same Color As Walls: Is Matching Color Scheme a Win or Lose?

LIFESTYLE

How Emergency Preparedness Builds Smarter Communities
From Crisis to Confidence: How Emergency Preparedness Builds Smarter Communities
april nail colors
Top April Nail Colors For Spring 2025
how to put on a duvet cover
How To Put on A Duvet Cover Easily: Simple Quora Way
12 Budget-Friendly Activities That Won’t Cost a Penny
12 Fun and Budget-Friendly Activities That Are Completely Free
lovelolablog code
Unlock Exclusive Lovelolablog Code For Discount Deals in 2025

Entertainment

hard rock nick net worth
Hard Rock Nick Net Worth: Uncovering The Wealth of The Social Media Sensation
bernice burgos net worth
Bernice Burgos Net Worth: Unveiling The Finances of The Sought-After Personality
lux pascal praises pedro pascal for self acceptance
Lux Pascal Praises Brother Pedro: 'He Taught Me to Embrace Who I Am'
Disney Typhoon Lagoon Lawsuit
Disney Faces $2M Lawsuit After Typhoon Lagoon Wave Injury
Kim Kardashian Paris Robbery Trial
Kim Kardashian Set to Testify in Paris Robbery Trial Against Grandpa Gang

GAMING

Most Valuable Retro Games
Most Valuable Retro Games: Classic Titles Now Worth a Fortune
Improve Reflexes for Fast-Paced Gaming
Master Fast-Paced Games: How to Improve Your Reflexes Quickly
Cloud gaming revolution
Cloud Gaming Trends That Are Redefining the Industry in 2025
Snokido Games
Snokido Games: The Ultimate Guide To Play for Free Online
unblocked games 67
Are Unblocked Games 67 Safe? Top Unblocked Games to Play in 2024

BUSINESS

Rules For Keeping Credit Utilization
9 Smart Rules to Keep Your Credit Utilization Under 30%
Bajaj Finserv Business Loan to Fuel Your Entrepreneurial Journey
Secure a Bajaj Finserv Business Loan to Fuel Your Entrepreneurial Journey Successfully
Credit Card Habits That Boost Your Score
10 Credit Card Habits That Boost Your Score Fast (Do #7 Daily!)
Businesses That Need Backflow Prevention Services
Which Businesses Need Backflow Prevention Services? (Critical Industries)
Most Common Plumbing Issues in US Restaurants
Top Plumbing Problems Restaurants Face in the US: What to Know

TECHNOLOGY

Automated vs. Manual Data Collection
Automated vs Manual Data Collection: Which is Better
OpenAI and Yahoo Chrome acquisition
OpenAI and Yahoo Interested in Chrome Acquisition During Trial
CapCut Desktop
Creating Educational Videos Made Easy with CapCut Desktop
How Many Wheels Are There in the World
How Many Wheels Are There in the World? The Ultimate Investigation
xr:d:DAF_piQWhQQ:6,j:8643955411235431116,t:24031606
Perplexity Eyes Chrome Takeover if Google Is Forced to Sell

HEALTH

Wegovy for Weight Loss
Wegovy for Weight Loss: Is It Worth Buying Online?
Role of Sperm DNA Fragmentation Testing in IVF
The Role of Sperm DNA Fragmentation Testing in IVF with ICSI Success
Online Yoga Certificate Course
Why an Online Yoga Certificate Course is the Key to Advancing Your Practice
Moringa’s Bioactive Compounds
Moringa’s Bioactive Compounds: What Makes It a Powerful Lactation Booster?
Hidden Costs of Cosmetic Dentistry
Hidden Costs of Cosmetic Dentistry