Hardware FixRecommendedDevice not working? Your driver may be the problemCheck updates for common hardware issues.Fix DriversOctober DealsAmazon USOctober deal check: compare before you payAmazon US: current deals, useful picks and tech finds.Check DealsClean PCRecommendedOne scan can reveal what keeps slowing WindowsLook for cleanup and repair opportunities.Run Scan×
Skip to content
Redmond desk6 min

Microsoft’s “Skeleton Key” AI Jailbreak: What Its 2024 Tests Showed

Skeleton Key is Microsoft’s name for a direct, multi-turn jailbreak that tries to make an AI model rewrite its own safety behavior. Here is what Microsoft tested in 2024, what the technique cannot do, and how developers can defend against it.
Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

Skeleton Key is a direct, multi-turn jailbreak technique described by Microsoft. An attacker with legitimate access to an AI model tries to persuade it to change or augment its own behavior rules, then answer requests it would normally refuse—often by placing a warning before the response. Microsoft reported successful tests on seven named model systems in April and May 2024, but those results are not a current audit of every AI model or deployment.

What is the Skeleton Key AI jailbreak?

Microsoft disclosed Skeleton Key on June 26, 2024, in its security blog report. The company calls the method “Explicit: forced instruction-following.” Instead of disguising a harmful request, the attacker directly asks the model to update, augment or reinterpret its behavior rules.

As an Amazon Associate I earn from qualifying purchases.

The setup commonly claims a safety, research or training purpose and instructs the model to provide normally disallowed material with a warning rather than refuse it. If the model accepts that rule change, later prompts can be phrased as ordinary requests even though the model’s original safeguards would have blocked them.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

How the multi-turn sequence works

  1. Establish a purported context: the user frames the conversation as research, evaluation or another supposedly legitimate exercise.
  2. Request a behavior change: the user asks the model to add an instruction that favors compliance and requires a warning prefix instead of a refusal.
  3. Obtain confirmation: the attacker gets the model to acknowledge or restate the new behavior.
  4. Make direct requests: the attacker asks for content in categories that the model would ordinarily block.

The important mechanism is not a stolen credential or a software vulnerability in the surrounding service. It is an attempt to make the model treat a user-supplied rule as more authoritative than its existing safety instructions.

Which AI models did Microsoft say it affected?

Microsoft said it tested the technique from April through May 2024. Its disclosure reported successful behavior on the following base and hosted systems:

Model system named by Microsoft Access type in the report Reported result
Meta Llama 3 70B Instruct Base model Microsoft reported compliance after the behavior-change sequence.
Google Gemini Pro Base model Microsoft reported compliance after the behavior-change sequence.
OpenAI GPT-3.5 Turbo Hosted Microsoft reported compliance after the behavior-change sequence.
OpenAI GPT-4o Hosted Listed among the systems affected in Microsoft’s testing.
Mistral Large Hosted Microsoft reported compliance after the behavior-change sequence.
Anthropic Claude 3 Opus Hosted Microsoft reported compliance after the behavior-change sequence.
Cohere Command R Plus Hosted Microsoft reported compliance after the behavior-change sequence.

Microsoft said the test tasks covered explosives, bioweapons, political content, self-harm, racism, drugs, graphic sex and violence. It reported that affected models produced the requested material without the usual censorship, while adding the warning prefix demanded by the attacker. These are Microsoft’s results for its test period and configurations, not a prevalence rate or a guarantee about current versions.

The GPT-4 qualification

Microsoft separately noted that GPT-4 resisted the technique unless the behavior-update request was supplied as a user-defined system message rather than in the primary user message. Most consumer interfaces do not let an ordinary user set that message, although an underlying API or toolchain may. This qualification should not be treated as evidence that every GPT-4-family deployment behaves the same way.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

What Skeleton Key can—and cannot—do

What it can do

For a user who already has legitimate access, the technique can bypass a model’s conversational safety guardrails and induce it to generate disallowed content or follow disallowed instructions. The effect is at the model-response layer: the system answers when its normal policy would have refused.

What it does not establish

  • It does not, by itself, grant access to another user’s conversations or files.
  • It does not demonstrate control of the host computer, cloud account or model-serving infrastructure.
  • It does not inherently exfiltrate data or constitute a general system compromise.
  • It does not show that every AI model, version or product is vulnerable.

The attacker still needs an authorized way to use the model. A successful jailbreak can create serious safety and abuse risk, but it is different from account takeover or a data breach.

How Skeleton Key differs from other prompt attacks

Direct jailbreaks

Microsoft uses “jailbreak” for techniques that cause an AI model’s safety guardrails to fail. Skeleton Key is a direct user interaction: the user openly tries to change how the model follows its behavior rules.

Crescendo

Microsoft’s earlier Crescendo work describes another multi-turn strategy. Crescendo gradually leads a model toward a target by building on the model’s earlier replies. Skeleton Key instead centers on an explicit request to alter the model’s operating rules; the names should not be used interchangeably.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

Indirect prompt injection

In an indirect prompt injection, malicious instructions are hidden in content—such as a document, web page or message—that the model is asked to process. Skeleton Key arrives through the user’s direct conversation. Both can undermine safeguards, but they require different detection and containment points.

How can AI developers defend against Skeleton Key?

Microsoft recommends defense in depth rather than relying on a single refusal instruction. Its guidance is summarized in its overview of AI jailbreaks and related guardrail guidance.

Control layer Implementation focus What it helps catch
Input filtering Classify requests for harmful intent, rule-changing language and attempts to circumvent safeguards before they reach the main model. Individual jailbreak prompts and obvious setup turns.
System instructions Give the model clear, high-priority directions about acceptable behavior and explicitly tell it to reject requests that undermine those directions. Attempts to make user text outrank the application’s safety policy.
Output filtering Check generated text against safety criteria before displaying it or passing it to another tool. Responses that slip through despite the model’s instructions.
Independent monitoring Use abuse-pattern detection, adversarial examples and content classifiers that are separate from the potentially manipulated model. Repeated probing, coordinated misuse and multi-turn patterns.

Separating detection from the model being tested matters: if the primary model has accepted the attacker’s behavior update, it should not be the only component deciding whether the resulting output is safe.

Azure-specific measures named by Microsoft

For Azure deployments, Microsoft pointed to Azure AI Content Safety Prompt Shields for jailbreak and indirect-prompt-injection defenses, risk and safety evaluations in Azure AI Studio, restrictive filter thresholds and security monitoring such as Microsoft Defender for Cloud. Microsoft announced Prompt Shields in its Azure AI announcement.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

Feature names, defaults, thresholds and availability can change by service and date. Teams should confirm the current Azure documentation and test their own model configuration rather than assuming that a 2024 setting remains enabled or behaves identically.

Independent reader supportYour contribution helps us test, update, and keep practical guides available for everyone.Support on Ko-Fi

A practical verification checklist for AI teams

  1. Inventory trust boundaries: document which callers can submit system-level instructions, user messages and tool outputs.
  2. Run multi-turn adversarial tests: include requests that first ask to rewrite the model’s rules and then request prohibited content.
  3. Test every deployment path: compare the public chat interface, API, orchestration framework and any tool that can set a system message.
  4. Inspect complete conversations: log enough context to identify gradual rule-changing attempts, subject to privacy and retention requirements.
  5. Keep an independent safety gate: evaluate outputs before release or tool execution, even when the model claims that a new user rule authorizes them.
  6. Re-test after model or policy updates: Microsoft’s results were from April–May 2024 and cannot substitute for regression testing of later versions.

Why “almost any AI” needs qualification

Microsoft’s report covered seven named model systems and several sensitive content categories, but it did not establish how common Skeleton Key is in the wild. The work was conducted in 2024, and later model releases, product wrappers and provider-side mitigations may change outcomes. A result on one endpoint also does not automatically transfer to another endpoint running the same model family with different system prompts, filters or tool permissions.

Microsoft said it updated its own large-language-model technology, including Copilot assistants, addressed the issue in Azure AI-managed models using Prompt Shields and shared the findings with other providers through responsible disclosure. Those statements describe actions at publication; current remediation status for each third-party model requires confirmation from its provider.

“This AI jailbreak technique works by using a multi-turn (or multiple step) strategy to cause a model to ignore its guardrails.”

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

— Mark Russinovich, Chief Technology Officer, Microsoft Azure, Microsoft Security Blog, June 26, 2024

Product prices and availability are accurate as of the date/time indicated and are subject to change. Any price and availability information displayed on Amazon at the time of purchase will apply.

Leave a Reply

Your email address will not be published. Required fields are marked *

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

More from the Wire

  1. World desk4 min
    How to Spot an AI Voice Scam Before Sending MoneyDon’t rely on how a caller sounds. Pause, call back through a known number, and verify the emergency with another trusted person before sending money.
  2. Mountain View desk4 min
    Google’s SynthID Detector: How to Check AI-Generated Images, Video and AudioGoogle’s SynthID Detector looks for an embedded watermark in supported images, video and audio. Here is what its results do—and do not—show.
  3. Redmond desk20 min
    How to create a link to File or Folder in Windows 11Windows 11 gives you several ways to point to a file or folder without moving or duplicating it. You can create a desktop shortcut,…
Recommended PC Tool
Recommended PC Tool
Crashes, No Sound, or Screen Glitches?Free driver scan
Windows Errors? Fix Them Before They SpreadFree repair scan

Two free Windows tools

One Free Minute Could Fix That PC

Before you go - each of these free tools takes about a minute and tackles what quietly slows a Windows PC down.

Special offer. View Outbyte info, uninstall instructions, EULA, and Privacy Policy.