Logan Kelly

Agentic AI Governance: Risks, Controls, and How to Enforce Them at Runtime

Agentic AI Governance: Risks, Controls, and How to Enforce Them at Runtime

Agentic AI governance controls what an agent may do, not just what it says. The seven risks, the eight-step rollout, and where enforcement sits.

Black blog cover image with subtle grid pattern. Category label reads "AGENTIC GOVERNANCE" in the upper left. Large headline text reads "What Is Agentic Governance?" Waxell logo in the bottom right corner.

Agentic AI governance is the set of policies and enforcement mechanisms that decide what an AI agent is allowed to do — which tools it may call, which data it may touch, how much it may spend — and that apply those decisions at the moment the agent acts. It is distinct from AI governance, which reviews what a model produces, and from observability, which records what an agent already did.

The distinction matters more than it sounds. In August 2026, Enterprise Management Associates surveyed 202 IT and security leaders at organizations with 1,000 or more employees for a report commissioned by Cequence Security. Only 34.2% of them evaluated whether an agent was authorized to act at the moment it attempted a specific action. Only 32.7% provisioned agents with least-privilege access. Nearly two-thirds had already watched an agent act outside its intended scope — 29.2% with measurable organizational impact, and another 35.6% caught as near misses.

Read those together and the gap is not mainly about visibility. It is about permission. EMA's own report puts it more bluntly: 94% of those leaders were at least somewhat confident their agents did not have more access than they needed.

Output Risk vs Action Risk: Why AI Governance Frameworks Miss Agents

Traditional AI governance was built around output risk. A model produces a sentence, an image, a score, a classification — and the governance question is whether that output is accurate, fair, safe and explainable. The controls follow from the question: red-teaming, evaluation suites, output filters, bias testing, model cards, deployment review. Each of those inspects a product.

An agent does not produce a product. It takes an action. It calls a tool, writes to a system, spends money, sends a message, reads a record. The governance question changes shape entirely: not is this output good but was this action permitted.

That is action risk, and it is a different class of problem. A wrong sentence is a quality problem — annoying, embarrassing, occasionally serious. A wrong action is an authority problem, and authority problems do not degrade gracefully. An agent that summarizes a contract badly wastes an hour. An agent that emails the contract to the wrong counterparty has done something you cannot evaluate your way out of afterwards.

This is why AI governance frameworks written for models transfer so poorly. They are quality-assurance instruments pointed at a system whose failure mode is unauthorized action. Governance for agents is an authority control problem, not a quality assurance problem.

Two other differences compound it:

Agents are non-deterministic. The same prompt, context and tool set can produce meaningfully different behavior across runs. Your governance layer cannot assume it knows in advance what the agent will do; it has to evaluate behavior as it emerges.

The principal is a model. In a conventional system the entity making decisions is a human or a deterministic process, and access control is designed around that. In an agentic system the decision-maker is a probabilistic model, which is why a system prompt is a request rather than a control. We covered the architectural consequence of that in The Three-Layer Agentic Architecture Most Teams Build Wrong and the case for putting the control layer above the agents in Governance Above Agents.

Traditional AI governance, agentic governance, and observability


Traditional AI Governance

Agentic Governance

Observability

Unit of risk

The output

The action

Nothing — records only

When it applies

At evaluation and deployment

At every step of every execution

After actions occur

Question it answers

Is this output acceptable?

Is this action permitted?

What did the agent do?

Key mechanism

Red-teaming, output filtering, model review

Permission scoping, runtime policy checks, kill switches

Tracing, logging, dashboards

Failure mode

A bad answer

An unauthorized action

A well-documented incident

Regulatory surface

EU AI Act Annex I (models in products)

EU AI Act Annex III + NIST AI RMF (operational risk)

Not a compliance instrument

Observability is not the enemy here — you cannot govern what you cannot see, and every control below assumes a trace exists. But visibility is an input to governance, not a substitute for it. The sharpest version of that distinction is why passing every identity check still is not governance.

Seven Risks Agentic Governance Is Built to Catch

Each of these shows up at the action layer, which is exactly where model-level review does not reach.

1. Scope drift. The agent does something adjacent to its job but outside its remit — queries a table it was not meant to touch, files a ticket in the wrong system, escalates a refund it was only meant to flag. In the EMA survey this was the most common failure reported: 29.2% had seen it cause measurable organizational impact, and a further 35.6% had caught it as a near miss.

2. Over-provisioned authority. The agent holds broader access than its task needs, usually because it inherited a human's credentials or a service account that predates it. Nothing goes wrong until something does, at which point the blast radius is the credential's, not the task's.3. Runaway cost. A retry chain, a loop, or an unexpectedly expensive tool path consumes budget with no ceiling to stop it. This is the failure teams discover from an invoice rather than an alert, and it is the one a hard spend limit prevents outright. (Why agent costs spiral — and how to control them →)

4. Data leakage through the context window. Personal or regulated data enters a prompt, a tool return, a log line or a cached response and leaves the boundary it was supposed to stay inside. The Salesforce Agentforce ForcedLeak vulnerability is the public worked example: according to the September 2025 disclosure by Noma Security, an indirect prompt-injection chain could drive an Agentforce deployment into exfiltrating CRM data — Salesforce has since patched it — covered in depth here. (How to keep PII out of your AI agents →)

5. Tool-call compromise. The agent's tools are an attack surface of their own. A tool description can carry an injected instruction; an upstream tool can change behavior after you approved it; a proxy in front of the tools can be bypassed. One June 2026 example: CVE-2026-12773, published by the National Vulnerability Database on 21 June 2026 and scored 9.8 (critical) by NIST, an improper-authentication weakness in the MCP Proxy component of BerriAI's LiteLLM up to version 1.59.8, remotely reachable and with a public exploit — what that revealed about audit trails.

6. Identity collapse. Agents share credentials, or borrow the user's, so an action cannot be attributed to a specific agent after the fact. Attribution is the precondition for every other control: you cannot scope, budget or revoke something you cannot name. EMA found that 54.5% of the organizations surveyed required and enforced unique identities for their agents, and that 47% could not reliably inventory all the agents they had deployed.

7. Unreconstructable decisions. The system can tell you a call was made but not which policy was evaluated, what it decided, or what state the agent was in when it decided. That is a monitoring log, not a governance record, and it is the difference between answering an auditor and apologizing to one. Just over 46% of EMA's respondents could not easily and completely produce an audit trail.

Read as a set, these are also the shape of the market's own framing — see the agentic governance gap for how the category emerged, and what an AI control plane is for how the same requirement gets described from the infrastructure side.

How to Implement Agentic Governance: Eight Steps

The order matters. Several of these are cheap only if you do them before the ones below them.

1. Inventory the agents you actually have. Not the ones in the architecture diagram — the ones running. Shadow agents installed on laptops and one-off scripts with production credentials belong on the list.

2. Give every agent its own identity. Distinct, revocable, and never inherited from the human who started the session. Without this, nothing downstream can be attributed or withdrawn.

3. Write the policy down, outside the prompt. Explicit, versioned, reviewable rules — what the agent may call, touch, spend and send. A rule that lives only in a system prompt is a preference, not a policy.

4. Scope permissions to the task, not to the person. Grant the minimum the declared job needs and set it at configuration time so it cannot be widened at runtime by a persuasive instruction.

5. Enforce at the moment of action. The check has to sit between the decision and the effect — before the write, the spend, the send. This is the step most deployments skip, and it is what separates a governance layer from a reporting layer. (The three-layer enforcement framework →; why enforcement has to be action-level →)

6. Put a budget and a stop control on every session. A spend ceiling that halts rather than warns, and the ability to pause or terminate an agent, a workflow or a session mid-flight without taking down whatever depends on it.

7. Record the decision, not just the call. Capture which policies were evaluated, what each decided, and the state the agent was in — with enough context to reconstruct the run months later. (What an audit-ready agent deployment looks like →)

8. Rehearse the bad day. Pick a real question — show me everything this agent did between 3pm and 4pm yesterday, including every policy evaluation and every blocked call — and answer it before someone external asks it.

If you are evaluating tooling rather than building it, the current platform landscape and our framework write-up are the better starting points.

Why Is Agentic Governance Becoming a Regulatory Requirement?

The regulatory picture moved twice in 2026, in opposite directions, and both moves are worth getting right.In the EU, the high-risk obligations were originally due to apply from 2 August 2026. The AI Omnibus, which entered into force on 27 July 2026, deferred them: per the European Commission, Annex III high-risk systems now apply from 2 December 2027, and Annex I high-risk AI embedded in physical products from 2 August 2028. The date moved; the obligations still arrive. Under Article 99 of the AI Act, breaches including deployer obligations carry fines of up to €15 million or 3% of total worldwide annual turnover, whichever is higher (Article 99(4)); the higher €35 million / 7% tier in Article 99(3) applies to the narrower category of prohibited practices under Article 5.

In the US, the state-level picture is less settled than it looked a year ago. Colorado's SB 24-205 was widely cited as the leading edge of US AI regulation and was scheduled to take effect on 30 June 2026. It never did. In April 2026 the Colorado Attorney General stated, in a joint filing, that the office did not intend to enforce the act until rulemaking concluded, and the federal district court vacated the case's upcoming deadlines by minute order on 27 April. The legislature then repealed and reenacted the framework as SB 26-189, "Automated Decision-Making Technology," signed on 14 May 2026, with developer obligations commencing 1 January 2027. If your governance plan is still anchored to "Colorado, June 2026," it is anchored to a statute that has since been replaced.

The NIST AI Risk Management Framework (AI RMF 1.0) remains the reference most US enterprises actually build against, and it is voluntary — which is exactly why it is useful as an internal standard while the statutory picture keeps moving.

The commercial pressure is arriving faster than the legal deadline. Gartner predicted in May 2026 that by 2027, 40% of enterprises will demote or decommission autonomous AI agents because of governance gaps — and argued that the cause is not too little governance but undifferentiated governance, applied identically to agents operating at very different levels of autonomy. For how that plays out at fleet scale, see our write-up on enterprise agent governance sprawl.

The teams building this now get a compounding advantage, and it is a boring one: auditors cannot audit intentions. They can audit policy records, enforcement decisions and decision trails. A governance-first architecture produces those as a by-product. A monitoring-first one produces logs you then have to argue about.

How Waxell handles this: Waxell Runtime gates each step of the high-risk workflows you build on Waxell — evaluating policies before a step runs, pausing execution and waiting when a policy trigger requires human input, and offering kill switches at agent, workflow and session level. For agents you built on another Python framework, Waxell Observe instruments them in place and applies the same 50+ policy categories during execution, and for the MCP tool calls those agents route through it, the Waxell MCP Gateway resolves each call to a real identity and checks it against policy before the upstream sees it. Decisions land in a durable execution record built to be read by someone who was not there, with framework mappings for the reviews that follow. Start free with Waxell Observe and one governed MCP upstream →

FAQ

What is agentic AI governance? Agentic AI governance is the set of policies and enforcement mechanisms that control what an AI agent can access, spend and do in production — applied at the moment the agent acts, independent of its own reasoning. It covers policy definition, runtime enforcement and the audit record, and it is distinct from observability, which only tells you what already happened.

How is agentic governance different from AI governance? Traditional AI governance manages output risk: it reviews what a model produces, using red-teaming, evaluation and output filtering. Agentic governance manages action risk: it decides whether a tool call, a write, a spend or a send is permitted, at the moment it is attempted. One is a quality-assurance problem; the other is an authority-control problem.

Is observability the same as agentic governance? No. Observability records what an agent did; governance determines what it is allowed to do. You can have complete tracing and zero enforcement. That is the ordinary case rather than the exception: EMA found only 34.2% of surveyed organizations check whether an agent is authorized at the moment it acts.

What should an AI agent governance framework include? An agent inventory, per-agent identity, explicit versioned policies held outside the prompt, task-scoped permissions, enforcement at the moment of action, spend ceilings and stop controls, and a decision-level audit record. The eight-step sequence above is the order we would run them in.

What is an AI agent governance platform? A platform that holds the policies, applies them while agents are running, and produces the record afterwards — as opposed to an evaluation tool, which scores outputs, or an observability tool, which traces calls. The practical test is whether it can refuse an action, not just report one.

Why doesn't a system prompt work as a governance layer? System prompt instructions are requests to a probabilistic model. They are followed most of the time and degrade unpredictably under adversarial input or distribution shift. Governance needs a mechanism that sits outside the model's reasoning and applies regardless of what the model decides.Does the EU AI Act still require this now that the Annex III deadline moved to 2027? Yes — the deferral moved when the obligations apply, not whether they apply. Per the European Commission's published timeline, Annex III high-risk obligations apply from 2 December 2027 and Annex I from 2 August 2028. Article 99 sets the penalty ceilings: up to €15 million or 3% of worldwide annual turnover for the deployer-obligation category, and up to €35 million or 7% for prohibited practices under Article 5.

When should you implement agentic governance? Before you need it. Governance built into a deployment from the start costs a fraction of retrofitting it after an incident, and the retrofit usually lands during the incident review, which is the worst possible time to be designing policy.

Sources

  • Enterprise Management Associates (for Cequence Security), Agents Without Guardrails: The Agentic AI Governance Gap in the Enterprise (August 2026) — https://www.cequence.ai/wp-content/uploads/2026/08/EMA-Research-Report-Agents-Without-Guardrails.pdf

  • Gartner, Gartner Says Applying Uniform Governance Across AI Agents Will Lead to Enterprise AI Agent Failure (26 May 2026) — https://www.gartner.com/en/newsroom/press-releases/2026-05-26-gartner-says-applying-uniform-governance-across-ai-agents-will-lead-to-enterprise-ai-agent-failure

  • European Commission, AI Omnibus enters into force (27 July 2026) — https://digital-strategy.ec.europa.eu/en/news/ai-omnibus-enters-force

  • EU Artificial Intelligence Act, Article 99: Penalties (Regulation (EU) 2024/1689) — https://artificialintelligenceact.eu/article/99/

  • NIST, Artificial Intelligence Risk Management Framework (AI RMF 1.0) (January 2023) — https://doi.org/10.6028/NIST.AI.100-1

  • Colorado General Assembly, SB26-189 — Automated Decision-Making Technology (signed 14 May 2026) — https://leg.colorado.gov/bills/sb26-189

  • Troutman Pepper Locke, Colorado Attorney General Delays Enforcement of Colorado AI Act (April 2026) — https://www.troutmanprivacy.com/2026/04/colorado-attorney-general-delays-enforcement-of-colorado-ai-act/

  • Noma Security, ForcedLeak: AI Agent Risks Exposed in Salesforce AgentForce (September 2025) — https://noma.security/blog/forcedleak-agent-risks-exposed-in-salesforce-agentforce/

  • NVD, CVE-2026-12773 Detail — https://nvd.nist.gov/vuln/detail/CVE-2026-12773

Waxell

Waxell provides observability and governance for AI agents in production. Bring your own framework.

Compliance — NIST AI RMF · EU AI Act · SOC 2 Type II (in progress) · HIPAA (in progress)

Governed continuously in Vanta.

© 2026 Waxell. All rights reserved.

Patent Pending.

Waxell

Waxell provides observability and governance for AI agents in production. Bring your own framework.

Compliance — NIST AI RMF · EU AI Act · SOC 2 Type II (in progress) · HIPAA (in progress)

Governed continuously in Vanta.

© 2026 Waxell. All rights reserved.

Patent Pending.

Waxell

Waxell provides observability and governance for AI agents in production. Bring your own framework.

Compliance — NIST AI RMF · EU AI Act · SOC 2 Type II (in progress) · HIPAA (in progress)

Governed continuously in Vanta.

© 2026 Waxell. All rights reserved.

Patent Pending.