AI researchers have found a way to jailbreak Bard and ChatGPT

Jul 28 2023 05:18 PM IST
share
Share Via
Researchers from Carnegie Mellon University in Pittsburgh, and the Center for AI safety in San Francisco have found a way to circumvent the safety rails for Google's Bard and OpenAI's ChatGPT AI chatbots. The researchers said their exploits were completely automated and would allow, "virtually unlimited" number of such attacks. They have already disclosed their methods to Google, OpenAI and Anthropic.

Researchers from Carnegie Mellon University in Pittsburgh, and the Center for AI safety in San Francisco have found a way to circumvent the safety rails for Google’s Bard and OpenAI’s ChatGPT AI chatbots.As reported by , the researchers found they could use jailbreak tools designed for open-sourced AI models on closed systems like ChatGPT as well.This could be used to remove the security guardrails that OpenAI and Google have placed on their chatbots, and to trick them into producing harmful content or misinformation.The researchers said their exploits were completely automated and would allow, “virtually unlimited” number of such attacks. They have already disclosed their methods to Google, OpenAI and Anthropic.A google spokesperson told that “While this is an issue across LLMs, we’ve built important guardrails into Bard – like the ones posited by this research – that we’ll continue to improve over time”.The researchers said that it was “unclear” if it’s possible to block such attacks by the companies developing AI models.

Discover the latest business news, Sensex, and Nifty updates. Obtain Personal Finance insights, tax queries, and expert opinions on Moneycontrol or download the Moneycontrol App to stay updated!


Mojo Stocks - The Top 1% Picks across Markets

Top 10 Large Cap Mid Cap Small Cap
{{col.header}}
Latest
OPEN CALL
CLOSED CALL
{{s[col.key]}} {{s.change_value}}
{{ s.score.value }} - {{ s.score.call_type }}
{{ s.dot_summary.score }} - {{ s.dot_summary.scoreText }}
{{s[col.key]}} {{col.extra}}

Our weekly and monthly stock recommendations are here
Loading...
{{!sm.blur ? sm.comp_name : ''}}
Industry
{{sm.old_ind_name }}
Market Cap
{{sm.mcapsizerank }}
Date of Entry
{{sm.date }}
Entry Price
Target Price
{{sm.target_price }} ({{sm.performance_target }}%)
Holding Duration
{{sm.target_duration }}
Last 1 Year Return
{{sm.performance_1y}}%
{{sm.comp_name}} price as on {{sm.todays_date}}
{{sm.price_as_on}} ({{sm.performance}}%)
Industry
{{sm.old_ind_name}}
Market Cap
{{sm.mcapsizerank}}
Date of Entry
{{sm.date}}
Entry Price
{{sm.opening_price}}
Last 1 Year Return
{{sm.performance_1y}}%
Related News