explainx / blog
Human in the loop AI isn't about distrusting agents — it's about knowing which actions need a gate. A practical decision framework for 2026.
Jun 28, 2026
Most agent demos work once and fail in production. This guide covers the architecture of a real ai agent loop — triggers, state, executors, terminators, retry logic, checkpoints, and the human handoff decision framework — with working code patterns for all three.
Jun 28, 2026
In agentic systems, context engineering errors compound across every turn. This guide covers how to design the context window for multi-turn AI agents: from initial setup through tool output injection, context evolution, and recovery from failure states.
Jun 28, 2026
Conversation history fills up context windows faster than anything else in agentic systems. This guide covers the four strategies for managing it — full retention, sliding window, summarization, and selective pruning — and when to use each.
In early 2025, a startup's customer success agent sent 4,000 personalized re-engagement emails in under 40 minutes. The emails were well-written, personalized to each user's activity history, and triggered on the correct segment. There was one problem: the segment definition had a bug. The "re-engage churned users" query accidentally matched active paying customers. The agent had been given send access with no approval gate, because someone on the team had assumed the CRM query would be reviewed before the agent ran.
Nobody reviewed it. The agent ran. Four thousand active customers received an email asking if they'd forgotten about the product.
The company spent a week on damage control. They didn't need a better model. They needed a gate.
This is the central problem of human-in-the-loop AI in 2026: not whether to use autonomous agents, but where to put the gates.
Human-in-the-loop is not a feature you turn on or off. It's a spectrum, and every agent system sits somewhere on it — whether that placement was deliberate or not.
Fully manual. A human does every step. The AI assists by suggesting, drafting, or summarizing, but no action executes without explicit human initiation. High safety, zero autonomy, maximum human time cost.
Human-reviewed. The agent acts, but every output is reviewed before downstream systems receive it. Useful for content generation pipelines where the agent drafts and a human editor publishes.
Human-approved before irreversible actions. The agent runs autonomously through reversible steps, then pauses and requests approval before anything that can't be undone — sending, deleting, publishing, charging. This is the sweet spot for most production agent systems.
Fully autonomous. The agent acts without any human checkpoint. Appropriate only when the action set is provably bounded, the blast radius is small, and the cost of mistakes is low enough to absorb without review.
The mistake most teams make is treating this as a binary choice: either they gate everything (and lose all the value of the agent) or they gate nothing (and eventually have a bad day). The right answer is to assign each action type to its correct position on the spectrum, then implement accordingly.
Three variables determine where any given action should sit on the HITL spectrum.
Reversibility. Can this action be undone in under five minutes without data loss? Reading a file is fully reversible. Writing a draft is reversible. Sending an email is not. Deleting database records is not. Charging a payment method is not. Irreversibility is the strongest signal that a gate is needed.
Blast radius. How many entities — records, people, dollars, reputation — does this action affect? A single-row database update is different from a bulk delete. A $1 API call is different from a $500 one. A message to one person is different from a message to 50,000. High blast radius raises the gate requirement even for actions that seem low-risk in isolation.
Confidence threshold. How certain is the agent about its inputs? If the agent is operating on a user-confirmed query with validated data, confidence is high. If the agent is making inferences from ambiguous instructions or running on data it hasn't validated, confidence is lower. Low confidence raises the gate requirement even for actions that are technically reversible.
The practical decision rule: if any two of these three factors are elevated — irreversible, large blast radius, or low confidence — add a gate. If all three are low, autonomous operation is justified.
Here's how this plays out across common agent action types.
Reading files: no gate. Reading is fully reversible (it has no side effects), the blast radius is zero, and even low-confidence reads have no external consequences. Let the agent read freely.
Writing a draft: no gate. Drafts exist in the agent's working memory or a staging area until explicitly sent or published. Writing a draft is reversible — it can be deleted or overwritten. No gate needed; the gate comes at the publish or send step.
Sending an email: gate. Email is irreversible, and the blast radius scales with the recipient count. Every email-send action should require explicit human approval or at minimum a configurable delay window during which the send can be cancelled. The re-engagement story above is what happens when this gate is missing.
Creating a calendar invite: soft gate (notify). A calendar invite is technically reversible — it can be cancelled. But it has a social blast radius: the people invited are notified immediately. Use a soft gate: let the agent create the invite, but notify the human immediately via Slack or email with a cancel link and a short window before the invite is sent to attendees.
Deleting database records: hard gate. Deletion is among the highest-risk action categories in any agent workflow. Even with backups, recovery is time-consuming and error-prone. Bulk deletes can trigger cascading effects on foreign keys, audit logs, and downstream systems. Hard gate: the agent should never delete records without an explicit, logged human approval — preferably with a preview of exactly which records will be affected.
Making an API call that costs money: gate. The gate threshold here depends on the dollar amount. Sub-dollar calls to external APIs can often be gated loosely (log and notify, intervene if needed). Calls above a configurable spend threshold — say, $10 per call or $100 per session — should require explicit approval. This is especially important when the agent is iterating and may make the same expensive call multiple times due to a logic error.
Running code: context-dependent. Running code in a read-only environment or sandbox is low-risk and can proceed autonomously. Running code that writes to production databases, sends network requests, or modifies the filesystem is a different matter. The gate decision should be based on what the code does, not the fact that it's code. Classify the code's side effects using the same reversibility and blast radius criteria.
Posting publicly: gate. Public posts — social media, public forums, published documentation — are technically reversible but practically not. Screenshots spread in minutes. Reputational blast radius is high. Any action that pushes content to a public-facing channel requires human approval. This applies even when the content looks good; the agent cannot assess context, timing, or tone the way a human can.
Summarizing a document: no gate. Summarization is a read-and-transform operation with no external side effects. The output lives in the agent's working context until the human decides what to do with it. No gate needed; review happens naturally when the human reads the summary.
Charging a payment method: hard gate. This is the clearest hard gate in any agent system. Financial transactions are irreversible in practice, high blast radius, and carry legal and compliance weight. No agent should charge a payment method without an explicit, auditable human authorization. If you're building a billing agent, this gate is not optional.
Knowing where to put gates is half the work. The other half is implementing them in a way that doesn't make the agent unusable.
Approval callbacks. The agent pauses execution, serializes its current state and the proposed action, and calls an approval webhook. The webhook notifies a human (via Slack, email, or a dashboard), waits for a response, and returns an approval or rejection signal. The agent resumes on approval or aborts on rejection. This is the cleanest pattern for hard gates on irreversible actions.
Checkpoint files. For longer-running agents, the agent writes a checkpoint file at gate points — a structured JSON file describing what it has done, what it intends to do next, and what it needs approval for. The human reviews the file and sets an approval flag. The agent polls for the flag before proceeding. This pattern works well for batch jobs and overnight agents where real-time human availability isn't assumed.
Slack and email notification hooks. For soft gates — actions that can proceed but where the human should know — the agent sends a notification immediately after acting. The notification includes enough context to understand what happened and a link to undo it if needed. This gives the human a recovery window without requiring pre-approval.
Timeout handling. Any gate pattern needs to handle the case where no human responds within the expected window. Decide upfront: does the agent abort, escalate to a secondary approver, or proceed after a timeout? Aborting is usually the safer default. Log the timeout and the pending action so it can be reviewed and re-triggered manually.
Audit logging. Every gate decision — approved, rejected, or timed out — should be logged with a timestamp, the action that was proposed, and the human who responded. This log serves compliance requirements and also provides the data you need to tune your gate thresholds over time.
In regulated industries, the gate placement decision is often partially made for you. Financial services agents operating on customer accounts need audit trails for every action and human approval before any account modification. Healthcare agents accessing patient records need HIPAA-compliant access controls and documented approval workflows. Legal workflows need human review before any external communication is sent.
In these environments, HITL is not an architectural choice — it's a regulatory requirement. The engineering question shifts from "should we gate this?" to "how do we implement the gate in a way that satisfies our compliance requirements without grinding the agent to a halt?"
The answer is usually the same: hard gates for high-stakes external actions, documented approval workflows, full audit logs, and configurable timeout behavior. The gate patterns described above satisfy these requirements when implemented correctly. What differs is the audit depth and the approval workflow formality.
If you're building agents for enterprise or regulated environments, the gate architecture should be designed upfront, not retrofitted. Retrofitting gates into an agent that was built without them is significantly more expensive than building them in from the start.
There's an opposite failure mode that doesn't get discussed enough: building an agent that asks for permission before doing anything.
If your agent sends a Slack message every time it reads a file, creates an approval workflow for every draft it writes, and requires human sign-off before summarizing a document, you haven't built an autonomous agent — you've built a slow assistant with extra steps. The human time cost of all those approvals will exceed the time cost of just doing the task manually.
Over-gating is often a symptom of unclear ownership. When no one has explicitly decided which actions are safe to run autonomously, the conservative default is to gate everything. This feels responsible but is actually counterproductive — it means the agent never builds a track record, the gates never get tuned, and the team never realizes the efficiency gains that motivated building the agent in the first place.
The goal is surgical gating: pause exactly where the cost of a mistake exceeds the cost of the interruption. Everywhere else, let the agent run.
Gates should not be static. The right gate level for a new agent is more conservative than the right gate level for an agent with a three-month track record of good decisions.
Start with the conservative setting. For any action type you're uncertain about, add a gate. This creates a high-friction baseline that is safe to deploy.
Log the outcomes. Every gate decision produces data: the proposed action, the context, whether the human approved or modified it, and if modified, what changed. After two to four weeks of operation, you have a dataset of agent decisions and human reactions to them.
Review the approval rates by action type. If a particular gate type is approved unchanged 95% of the time, it's a candidate for demotion — either to a soft gate with a notification instead of a block, or to no gate at all. If a gate type is being rejected or modified frequently, keep the gate and investigate the root cause. Is the agent making inferences on bad data? Is the action definition too broad? Is the confidence threshold wrong?
Promote gradually. Lower a gate one level at a time — hard gate to soft gate, soft gate to no gate — and monitor for a few weeks before going further. Trust is earned incrementally, not granted wholesale.
This is not a one-time tuning exercise. As the agent is given new capabilities, new action types, or access to new data sources, the gate configuration needs to be revisited. Treat it as a living part of the agent's configuration, not a setup step you complete at launch.
Understanding the framework is one thing. Implementing it — approval callbacks, checkpoint files, audit logs, timeout handling, and gate promotion logic — is where most teams get stuck.
The Loop Engineering workshop on July 20, 2026 covers exactly this. In a single four-hour live session, you'll build an agent loop from scratch with configurable gate levels, implement Slack-based approval callbacks, wire up checkpoint files for long-running tasks, and build the audit logging infrastructure that makes gate tuning possible.
The workshop is the hands-on companion to this post. If this framework makes sense conceptually and you want to know how to implement it in production code, that session is where to go.
This post focused on the decision framework — where to put gates and why. If you want to go deeper on the mechanics of agent loops, retry logic, and checkpoint architecture, the technical companion to this post is the AI agent loop architecture guide, which covers triggers, retries, and checkpoint design in detail.
The two posts are designed to be read together. This one tells you where to pause. That one tells you how the loop runs between those pauses.
An AI agent is only as trustworthy as its gate placement is intentional — figure out which of your agent's actions are irreversible, calculate their blast radius, and put a hard gate in front of every one of them before the agent ships.
The re-engagement email story is not an edge case. It's the default outcome when teams deploy agents without making explicit gate decisions. The framework in this post is how you avoid being the next version of that story.
If you're building an agent that runs production workflows, make the gate decisions explicit, implement them in code, log every outcome, and tune them as you build track record. That's the loop that earns autonomy.
The Loop Engineering workshop on July 20 is one session. Four hours. You leave with the gating infrastructure running on your own agent. If that's what you need, register before the cohort fills.
Built using Claude Code as part of the agentic AI engineering workflow at explainx.ai.
