Skeleton

Gemini

Security

Microsoft researchers recently uncovered a new form of “jailbreak” attack they are calling a “Skeleton Key” that is capable of removing the protections that keep generative artificial intelligence (AI) systems from outputting dangerous and sensitive data.&nbsp;
According to a Microsoft Security blog post, the Skeleton Key attack works by simply <a href="https://www.microsoft.com/en-us/security/blog/2024/06/26/mitigating-skeleton-key-a-new-type-of-generative-ai-jailbreak-technique/" target="_blank" rel="noopener nofollow">prompting</a> a generative AI model with text asking it to augment its encoded security features. 
<h2 id="skeleton-key">Skeleton Key</h2>
In one example given by the researchers, an AI model is asked to generate a recipe for a “Molotov Cocktail” — a simple firebomb popularized during World War II — and the model refused, citing safety guidelines. 
<figure>
 <img src="https://s3.cointelegraph.com/uploads/2024-06/61eed352-c7a2-4483-a45b-b1dd429a0534.jpg">
 <figcaption style="text-align: center;">
 Source: <a href="https://www.microsoft.com/en-us/security/blog/2024/06/26/mitigating-skeleton-key-a-new-type-of-generative-ai-jailbreak-technique/" target="_blank" rel="noopener nofollow">Microsoft Security</a>
 </figcaption>
</figure>
The Skeleton Key, in this case, was simply telling the model that the user was an expert in a laboratory setting. The model then acknowledged that it was augmenting its behavior and subsequently outputted what appeared to be a workable Molotov Cocktail recipe. 
While the danger here might be mitigated by the fact that similar ideas can be found through most search engines, there is one area where this form of attack could be catastrophic: data containing personally identifiable and financial information. 
According to Microsoft, the Skeleton Key attack works on most popular generative AI models including GPT-3.5, GPT-4o, Claude 3, Gemini Pro, and Meta Llama-3 70B. 
<h2 id="attack-and-defense">Attack and Defense</h2>
Large language models such as Google’s Gemini, Microsoft’s CoPilot, and OpenAI’s ChatGPT are trained on data troves often described as “internet sized.” While that may be an exaggeration, the fact remains that many models contain trillions of data points encompassing entire social media networks and information depository sites such as Wikipedia. 
The possibility that personally identifiable information such as names connected to phone numbers, addresses, and account numbers exists within a given large language model’s data set is only constrained by how selective the engineers who trained it were with the data they chose. 
Furthermore, any business, agency, or institution spinning up its own AI models, or adapting enterprise models for commercial/organizational use are also at the mercy of their base model’s training data set. 
If, for example, a bank connected a chatbot to its customer’s private data and relied on existing security measures to prevent the model from outputting personally identifiable&nbsp;data&nbsp;and private financial data, then it is possible that a Skeleton Key attack could trick some AI systems into sharing sensitive data. 
According to Microsoft there are several steps organizations can take to prevent this from happening. These include hard coded input/output filtering and secure monitoring systems to prevent advanced prompt engineering beyond the system’s safety threshold.
Related: <a href="https://cointelegraph.com/news/us-presidential-debate-inexplicably-omits-ai-artificial-intelligence-trump-biden-quantum-computing">US presidential debate inexplicably omits AI and quantum</a>

AI ‘Skeleton Key’ attack found by Microsoft could expose personal, financial data

목차

Cointelegraph

2024년 6월 28일에 게재된 다른 기사

Ringkasan Berita Kripto Hari Ini: Setelah Burn NOT US$3 Juta, VanEck Ajukan Proposal ETF SOL, Pot...

Solana Backed From Demand Zone: Can SOL Surpass The $150 Mark?

Bitcoin spikes as betting markets favor Trump during debate with Biden

Oil King Pepe (OILPEPE) Surges 2,000% and Prepares to Rally Another 18,000% Ahead of KuCoin Listi...

Bitcoin Takes a Hit, but These 3 Altcoins Are Defying the Trend

Presidential Debate Influences Meme Coin Prices

무료 뉴스레터에 가입하여 매일 최신 암호화폐 소식을 받아보세요!