← Back to home
Reference

What is AI agent governance?

AI agent governance is the set of controls that decide what an autonomous AI agent may do before it does it: which systems it can reach, how much it may spend, who has to approve its work, what is allowed to ship, and what is written down afterwards.

The controls are properties of the system the agent runs inside. They are not instructions given to the agent, and that distinction is the whole subject. Telling a model to stay inside a budget is a request. Refusing the call when the budget is gone is a control.

The questions

What governance has to answer.

Every governed action answers the same short list. A framework that cannot answer all of them has a gap, and the gap is where the incident happens.

Scope

What it may touch

Which repositories, tables, files, and services this actor can reach, expressed as something the system enforces rather than a credential handed over on trust. Paths that must never be edited by an agent are the sharpest version of this question.

Budget

What it may spend

Model calls cost money and an agent in a loop does not get tired. A budget answer is only real if the check runs before the call, on the path the call takes.

Approval

Who approves

Separation of duties, applied to non-human actors. The identity that produced the work is not the identity that clears it, and the system has to refuse the shortcut rather than discourage it.

Release

What ships

The gate between work that is finished and work that is live. Governed release means the conditions are checkable, the same every time, and enforced by something other than the actor that wants to ship.

Record

What gets logged

A record written as the work happens, naming the actor, the change, the cost, and the approval, and readable afterwards by someone who was not there. What an audit trail has to carry is its own subject.

Stop

How it stops

The question a security reviewer asks last and cares about most. Someone has to be able to halt the whole thing at once, without a deploy, and the halt has to take effect on work already in flight.

The boundary

Three things it is often confused with.

Model safety and alignment

Concerned with what a model produces: refusals, bias, harmful output. The controls live inside the model and are the provider’s work. Agent governance starts where that ends, at what the agent is permitted to reach and change. A well-aligned model holding an unscoped production credential is still an unbounded actor.

Observability

Traces, token counts, latency charts. Genuinely useful, and structurally incapable of prevention: a dashboard reports the spend after the money is gone. Observability answers what happened. Governance answers what is allowed to happen.

A careful system prompt

The most common substitute, because it is the cheapest. An instruction in the prompt is a request evaluated by the same model that wants to complete the task, in a context window that will be full of other things by the time it matters.

The mechanism

A control is only a control where it can refuse.

This is the load-bearing idea, and it is the one that decides whether a governance program is real. Any control sits in one of four places, and only the last of them is on the path the action takes.

01
A policy document
Written for people, read by people, and invisible to the running system. It records an intention. It has never stopped anything.
02
An instruction in the prompt
Advisory. It competes for attention with everything else in the context window, and a long enough task will bury it. A model asked to stay in budget is being asked, not stopped.
03
A monitoring dashboard
Accurate and too late. It reports what already happened, which is the right tool for an investigation and the wrong one for a runaway loop.
04
The execution path
The only place that can say no in time, because the action goes through it. This is where a control becomes a control, and it is an architecture decision rather than a configuration one.

The test is simple enough to apply in a first meeting, and it has two halves. Ask what happens when the control is violated, and listen for whether the answer is a notification or a refusal. Then ask the second question, which is the one that separates the answers: ask who did the work the control was applied to. A control added around work that arrived from somewhere else can only bound what that work already decided. A control designed with the organization that does the work is part of the same structure, and that is a different thing to audit.

In practice

How SpeyAI enforces it.

SpeyAI is a governance layer for AI agents that runs inside your own infrastructure. It gives every agent a defined seat under one chain of command and puts the gates in the architecture rather than in a policy document. What follows is the mechanism above, applied.

A governed seat is not a prompt with a role in it. Everything the seat is held to is fixed before it is handed any work, and none of it is something the seat can talk its way out of.

The console · one seat
A single seat in the console, showing its identifier, its pod, the model it runs, its daily budget cap with the day's spend against it, and the record of every run it has taken.
The cap, the model and the record are properties of the seat, set before it is given any work.
Spend
The check runs before the model call
Three limits are tested on the way in, not reconciled afterwards: what the seat has left of its allowance for the day, a ceiling on any single call, and a halt on the whole organization’s spend for the day. A seat that trips its own limit stops working and says why.
Approve
The seat that writes is not the seat that clears
Review runs as its own set of seats, and the platform refuses an approval that comes from the identity which authored the change. The chain that runs is keyed to the tier of the work; the disciplines it can draw on are architecture, security, QA, code quality, design, user acceptance, voice, export validation, data, and documentation. Some of them can block, and a blocked verdict stops the stages behind it.
Ship
A new instance holds every merge for a signature
Probation is the default state, and it withholds autonomous merges so you can watch the decisions before the organization acts on them. It stays that way until you graduate it. After graduation, a documentation-only change can merge on its own when every required gate is green, and code still reaches production under a human signature unless the operator deliberately switches on the small-change window.
Log
The record is written as the work runs
Every model call opens a row carrying the seat, the model, the tokens in each direction, the duration, and the cost. Operator actions land against the task they acted on. All of it goes to your own database, which is where you query it. More on what the record has to carry.
Stop
One switch, and the console takes the reason first
The kill switch halts every lane at once and parks work where the pipeline caught it. It is a state in the database, not a deploy, and the reason goes on the record before it trips.
Questions

Asked most often.

Is AI agent governance the same as AI safety?

No. AI safety and alignment work on what a model produces, and the controls live inside the model. Agent governance works on what an agent is permitted to reach, spend, and change, and the controls live in the system around the model. A perfectly aligned model with an unscoped credential is still an unbounded actor.

Can governance be added to agents already running in production?

Partly. Monitoring, logging, and after-the-fact review can be added at any time. Refusal cannot: a control that stops an action has to sit on the path the action takes, so it has to be in the execution path before the call rather than beside it. That is an architecture decision, which is why it is cheaper to make early than to retrofit.

What does a governance control actually look like in code?

A check that can return no, on the path the action takes, before the action happens. In SpeyAI the spend check runs before the model is called: if the seat has spent its allowance for the day, or the single call is estimated over the per-call ceiling, or the organization has hit its daily halt, the call does not happen. The same shape covers approvals, where the platform refuses an approval from the identity that authored the change.

Does governance mean a human has to approve everything?

Not permanently, and that is the point of graduated autonomy. A new instance starts in probation and holds every merge for a human signature, so you watch its decisions before it acts on its own. After you graduate it, a documentation-only change can merge by itself when every required gate is green, and code still goes to a person unless the operator switches on the small-change window.

Read on

Where this goes deeper.

Every mechanism named on this page is enforced by the running system. None of it is a policy document.