Search
Close this search box.
Search
Close this search box.

OpenAI’s ChatGPT Now Can Speak, Hear, and See: a Multimodal Upgrade in History

ChatGPT Now Can Speak Hear and See

With the addition of additional speech and image capabilities in ChatGPT, OpenAI is once again pushing the boundaries of AI technology. These features are expected to change the way users engage with the AI model, providing a more intuitive and immersive experience.

Voice Conversations with ChatGPT

One of the most notable aspects of this version is the ability to do voice conversations using ChatGPT. Users may now converse with their AI helper in real time, bringing up a world of possibilities. ChatGPT’s voice skills are ready to assist you whether you’re on the go, looking for a bedtime story for your family, or settling a dinner table disagreement.

To begin using voice, go to the Settings menu in the mobile app, pick “New Features,” and enable voice conversations. Once activated, press the headphone icon in the top-right corner of the home screen to select one of five voices. Professional voice actors have meticulously developed these voices to provide a human-like audio experience. Furthermore, Whisper, OpenAI’s open-source speech recognition system, transcribes spoken words into text, improving the overall quality of the conversation.

Image Interaction with ChatGPT

The ability to share photos with ChatGPT is another game changer. Users can now use ChatGPT to troubleshoot difficulties, explore material, and evaluate complex data by displaying one or more photos. ChatGPT can help you figure out why your grill won’t start, design a dinner based on the contents of your fridge, or analyze a data graph for work.

Tap the photo button to capture or select an image to use this function. Tap the addition button first on iOS or Android to upload several photographs, or use the sketching tool to lead your assistant. Multimodal models, such as GPT-3.5 and GPT-4, power these picture capabilities by applying language reasoning skills to a wide range of visual input, such as photos, screenshots, and documents comprising text and images.

Gradual Deployment for Security and Resilience

Voice and image capabilities will be gradually handed out to Plus and Enterprise subscribers over the next two weeks. Voice will be available on both the iOS and Android platforms, with the option to opt in via settings, while photos will be available on all devices.

OpenAI recognizes the hazards involved with these increased capabilities. The emphasis for voice is on voice chat, and the technology was created in partnership with voice actors to assure authenticity and safety. Notably, Spotify is leveraging this technology for its Voice Translation service, which allows podcasters to increase their audience by translating content into several languages using their own voices.

To protect people’s privacy, OpenAI has limited ChatGPT’s capacity to analyze and make direct statements about them using image input. Real-world usage and user input will be critical in further improving these safeguards while ensuring the tool’s usability.


Subscribe to Our Newsletter

Related Articles

Top Trending

May 30 Zodiac
May 30 Zodiac: Sign, Personality, Compatibility and More
Dave Portnoy Net Worth
Dave Portnoy Net Worth, Bio, Age, Wife, Career, and Wiki [Updated 2025]
Overview of Letflix
Letflix: Your Ultimate Alternative to Stream Free Movies and Watch Free Movies
biitland.com stablecoins
Unlocking The Potential of Stable Digital Crypto With Biitland.com Stablecoins
kenneth mygreenbucks .net
Discover The Ultimate Guide to Kenneth Mygreenbucks .net and Kenneth Jones

LIFESTYLE

Smart Skincare
What Smart Skincare Looks Like in a World of Overload
Swim Academy in Amman
How to Choose the Right Swim Academy in Amman?
Shopping in Madrid
Shopping in Madrid: From Exclusive Boutiques to Vintage Markets: A Shopping Lover's Guide
how long does dermaplaning last
How Long Does Dermaplaning Last? All About Dermaplaning Duration
Selling Used Designer Handbags
10 Expert Tips for Selling Your Used Designer Handbags for Top Dollar

Entertainment

Dave Portnoy Net Worth
Dave Portnoy Net Worth, Bio, Age, Wife, Career, and Wiki [Updated 2025]
Overview of Letflix
Letflix: Your Ultimate Alternative to Stream Free Movies and Watch Free Movies
Brad Pitt Breaks Silence on 8-Year Divorce
Brad Pitt Breaks Silence on 8-Year Divorce: 'No Big Deal!'
hailey bieber rhode sale elf beauty deal
Hailey Bieber Sells Rhode to e.l.f. Beauty in $1 Billion Deal
unblocked games granny
Play Granny Unblocked: Online Game Fun With Unblocked Games Granny

GAMING

How Video Games Help Reduce Stress
Gaming for Mental Health: How Video Games Help Reduce Stress
unblocked games granny
Play Granny Unblocked: Online Game Fun With Unblocked Games Granny
PC vs Console Gaming
PC vs Console Gaming: Which One Should You Choose?
Guide to Building a Custom Gaming PC
Beginner’s Guide to Building a Custom Gaming PC
sled rider 3d unblocked
Sled Rider 3D Unblocked: Snow Rider 3D Game Available For Unblocked Gaming

BUSINESS

kenneth mygreenbucks .net
Discover The Ultimate Guide to Kenneth Mygreenbucks .net and Kenneth Jones
ftasiastock business news
Stay Updated on Ftasiastock Business News, Technology, and Supply Chain Developments
Official Cash Advances From FamilyPayBank
2025 And Enjoy The Privileges Of Quick, Official Cash Advances From FamilyPayBank
Gold in the Digital Age
Gold in the Digital Age: Why It Still Matters to Investors
Annual Returns vs Average Returns
Annual Returns vs Average Returns: Why It’s Not Just About the Numbers

TECHNOLOGY

Anthropic Launches Voice Chat for Claude Mobile Users
Anthropic Launches Real-Time Voice Chat for Claude Mobile Users
Instagram Story Viewer Tools
Instagram Story Viewer Tools That Actually Work in 2025
Protect Yourself from Data Breaches
How to Protect Yourself from Data Breaches?
AI Portraits
Retro Royalty: Design AI Portraits of Imaginary Kings and Queens
Protect Teenagers From Online Scams
How to Protect Teenagers From Online Scams?

HEALTH

How Video Games Help Reduce Stress
Gaming for Mental Health: How Video Games Help Reduce Stress
Meaning in the Everyday
Moments that Change: Do We See the Meaning in the Everyday?
Tighten Your Skin After Losing Weight
5 Ways to Tighten Your Skin After Losing Weight
Physician Contract Negotiations
What Are the Common Red Flags in Physician Contract Negotiations?
Who Benefits Most from In-Home Care Services
Who Benefits Most from In-Home Care Services