AI Researchers Discover Method to Jailbreak Bard and ChatGPT

Researchers from Carnegie Mellon University in Pittsburgh and the Center for AI Safety in San Francisco have reportedly discovered a method to bypass the safety measures in place for AI chatbots like Google’s Bard and OpenAI’s ChatGPT, according to a Business Insider report.

These researchers have effectively “jailbroken” the chatbots, a term usually associated with software modifications that grant total system access. They utilized jailbreak tools typically used for open-source AI models on closed systems such as ChatGPT.

One primary tactic used in this process is known as automated adversarial attacks. By adding extra characters to the end of a user query, they found a way to outmaneuver the protective barriers installed by Google and OpenAI. This strategy could potentially be used to prompt the chatbots into generating harmful or misleading content.

According to the researchers, this method is entirely automated and could enable an almost limitless number of similar attacks. Google, OpenAI, and Anthropic have all been informed about these techniques.

In response, a representative from Google mentioned that while such issues affect all language learning models, the company has embedded critical safety features in Bard. The spokesperson assured that these protections would continue to be enhanced over time.

Nevertheless, the researchers expressed some uncertainty regarding the ability of AI developing companies to fend off such attacks.

Subscribe to Our Latest Newsletter

To Read Our Exclusive Content, Sign up Now.
$5/Monthly, $50/Yearly



Media Mogul Rupert Murdoch Retires, Passes Mantle to Son Lachlan

Media Mogul Rupert Murdoch has announced his decision to...

Bears Defensive Coordinator Alan Williams Resigns

Alan Williams, the Chicago Bears' defensive coordinator, resigned on...

Google Antitrust Trial: A Major Challenge for the Tech Giant

Google has disputed claims that it is the world's...

iPhone 15 Series Release Date 2023: The Wait Ends Here!

Apple's newest flagship phones with features and specifications that...

iPhone 15 vs 15 Plus vs 15 Pro vs 15 Pro Max: All the Key Differences

Are you in the market for a smartphone upgrade?...