October DealsAmazon USOctober deal check: compare before you payAmazon US: current deals, useful picks and tech finds.Check DealsClean PCRecommendedOne scan can reveal what keeps slowing WindowsLook for cleanup and repair opportunities.Run ScanOctober DealsAmazon USDeal season is back - check today's better picksAmazon US: current deals, useful picks and tech finds.See Picks×
Skip to content
World desk5 min

Why AI Agents Become Riskier When They Can Use Tools

AI agents can turn a mistaken or manipulated decision into an external action. Understand the risk chain and the controls that limit its impact.
Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

AI agents become riskier when their tools let a mistaken or manipulated decision change something outside the chat. A model may misread an email or follow hostile instructions hidden in a document; if it can then send messages, access sensitive records, or modify systems, that error can become a real-world action. The risk depends not just on what the model says, but on what its tools and permissions allow it to do.

How tool access turns a mistake into an external action

A text-only model can produce a harmful answer, but a tool-using agent can also act on it. The basic chain is: untrusted input or model error → agent decision → tool invocation → downstream consequence. Tools may be functions, extensions, APIs, or computer interfaces. The systems they connect to determine what the agent can affect.

As an Amazon Associate I earn from qualifying purchases.

OWASP calls a vulnerability arising from damaging actions enabled by an LLM’s unexpected, ambiguous, or manipulated outputs Excessive Agency. It identifies three common causes: excessive functionality, excessive permissions, and excessive autonomy. Depending on the connected systems, resulting harm can affect confidentiality, integrity, or availability.

Free tools Windows power users keep installed

One-click scans. No signup required.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

Example: a mail assistant that can send

Imagine an assistant intended to summarize incoming email. An attacker sends a message containing instructions that appear to tell the agent to search the inbox for sensitive information and forward it. The message is task data, not a trusted instruction, but the agent may fail to maintain that distinction. If its mail extension can both read and send, and its authorization permits both, the agent can turn that failure into disclosure.

The same misinterpretation would have a different consequence if the assistant could only read messages and produce a summary. The model’s reasoning can still be wrong, but its available action path is narrower.

Why ordinary task data can redirect an agent

NIST’s Center for AI Standards and Innovation (CAISI) describes agent hijacking as a form of indirect prompt injection: an attacker places malicious instructions in data an agent may ingest, such as an email, file, or website. The agent combines developer instructions with task-relevant content. If it does not reliably distinguish trusted instructions from untrusted data, that content can redirect its behavior.

This makes external content a security concern even when a user did not ask the agent to follow it. The danger is not limited to obvious commands in a prompt; hostile instructions can be embedded in material the agent is asked to read or in outputs returned by its tools.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

What CAISI’s evaluation figures do—and do not—show

In a January 17, 2025 technical blog, CAISI reported results from particular AgentDojo-based evaluations using upgraded Claude 3.5 Sonnet. These are measured attack success rates in that evaluation setup, not estimates of how many deployed agents are vulnerable and not real-world incident rates.

Reported result What it measured
11% Success rate for the strongest baseline attack against the upgraded model on a held-out set of Workspace user tasks.
81% Success rate for the strongest novel attack developed for that upgraded model in the same evaluation setup. The result shows that model-specific red teaming changed outcomes in this test; it should not be generalized to all agents.
57% Average success rate across five example injection tasks in the reported collection. CAISI cautioned that task success and impact vary, so an aggregate can conceal important differences.

CAISI also reported inducing the agent to follow malicious instructions across three added risk areas: remote code execution, database exfiltration, and automated phishing. The blog does not give a general prevalence figure for real-world agents. A success percentage alone cannot tell an operator how severe a particular outcome would be.

Why the same model error can have very different consequences

Impact depends on the action the agent can take, the permissions it has, the data and systems it can reach, and whether the action can be undone. An inappropriate draft is not equivalent to a sent message; access to information is not the same as the ability to export it; a reversible change differs from a destructive one. Security reviews should therefore examine consequences, not just how often an attack succeeds.

  • Capability scope: Which tools and operations are exposed, including whether they read, write, send, execute, or delete.
  • Authorization boundary: Whether the downstream service enforces access rules, or whether the agent is expected to decide for itself what is allowed.
  • Human control: Which actions need explicit approval and whether the approval covers the actual action and information being shared.
  • Exposure and reversibility: Which data and systems are reachable, and how difficult it would be to recover from an action.
  • Evaluation quality: Whether tests cover task-specific consequences, novel attacks, and repeated attempts rather than relying on one aggregate score.
Independent reader supportYour contribution helps us test, update, and keep practical guides available for everyone.Support on Ko-Fi

Controls that constrain what an agent can do

The model’s judgment should not be the security boundary. OWASP recommends validating downstream requests against security policies instead of relying on an LLM to decide whether an action is authorized. That way, even if an agent is manipulated, the tool or connected service can reject actions outside its permitted scope.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

Limit tools and permissions to the task

Expose only the functions the task needs, and remove unused or overly broad capabilities. Prefer read-only access when a task only requires reading; restrict access to specific resources and operations rather than granting broad account-level authority. For the mail-summary example, a read-only extension and read-only authorization prevent a request to send from being treated as an available action.

Require approval for consequential actions

Require human review before externally visible or high-impact steps such as sending a message or making a purchase. The reviewer should see the action the agent intends to take and the information it will share—not merely approve a vague plan. OpenAI’s prompt-injection guidance and Operator system card discuss human review as a mitigation, but approval gates work best alongside narrow permissions, not as a substitute for them.

Test, monitor, and limit damage

Treat content from outside the trusted instruction channel as untrusted, and test the agent with adversarial inputs relevant to its actual tasks and tools. NIST notes that evaluation needs to adapt because red teaming can reveal weaknesses missed by earlier attacks. Repeat testing as tools, permissions, models, or workflows change.

Logging, monitoring, and rate limits can help detect suspicious activity or limit how much damage an agent can do. OWASP frames these as damage-limiting measures, not as prevention on their own: they do not replace scoped capabilities or authorization checks.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

A practical way to assess an agent before deployment

  1. List the actions the task genuinely requires. Separate reading and summarizing from writing, sending, executing, or deleting.
  2. Inspect each exposed tool and permission. Check whether it can reach unrelated data or perform operations the task does not need.
  3. Enforce policy outside the model. Confirm that the tool or downstream service checks the user’s authorization and rejects disallowed requests.
  4. Set approval points by consequence. Identify actions that are externally visible, sensitive, costly, or hard to reverse, and require review of their exact details.
  5. Exercise the workflow with hostile task data. Try malicious instructions in realistic emails, files, websites, and tool outputs, then assess both whether the agent follows them and what the resulting action could affect.
  6. Watch for unexpected behavior and cap its reach. Use logs and monitoring to spot misuse, and apply limits that reduce the potential scope or rate of harmful actions.

Product prices and availability are accurate as of the date/time indicated and are subject to change. Any price and availability information displayed on Amazon at the time of purchase will apply.

Leave a Reply

Your email address will not be published. Required fields are marked *

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

More from the Wire

  1. World desk4 min
    How to Spot an AI Voice Scam Before Sending MoneyDon’t rely on how a caller sounds. Pause, call back through a known number, and verify the emergency with another trusted person before sending money.
  2. Mountain View desk4 min
    Google’s SynthID Detector: How to Check AI-Generated Images, Video and AudioGoogle’s SynthID Detector looks for an embedded watermark in supported images, video and audio. Here is what its results do—and do not—show.
  3. Redmond desk20 min
    How to create a link to File or Folder in Windows 11Windows 11 gives you several ways to point to a file or folder without moving or duplicating it. You can create a desktop shortcut,…
Recommended PC Tool
Recommended PC Tool
PC Slower Than It Used to Be?Free scan - under a minute
Crashes, No Sound, or Screen Glitches?Free driver scan

Two free Windows tools

One Free Minute Could Fix That PC

Before you go - each of these free tools takes about a minute and tackles what quietly slows a Windows PC down.

Special offer. View Outbyte info, uninstall instructions, EULA, and Privacy Policy.