explainx.ai0k
TrendingNewsPathwaysSkills
Pricing
explainx.ai

Upskill in AI — 16 free pathways, live workshops & bootcamps, and 50+ courses from practitioners. Plus the skills, tools, and MCP servers to practice on.

follow us

follow on google

Add explainx.ai as a preferred source

corporate training

support@explainx.ai

get started

Find your pathTake Free Evaluation

learn

mind: share how you thinkpathways — start freeworkshopsbootcampscoursescertificationsmock testsexplainx universitycorporate traininglearn skills & mcp

discover

skillsmcp serversexplainx mcptoolsagentsllmsdesignsdictionaryagi trackerfelony benchranks

company

aboutvisionmissionteaminstructorsteach on explainxpartnershipscommunityhackathonscareers

content

daily AI newsstate of AI — live resultsblogreleasespromptsgeneratorsresource libraryfor LLMsexplainx.ai kids

solutions

all solutionsdeveloper upskillingmarketing upskillingproduct manager upskillingleadership upskilling

newsletter · weekly

Get AI news, tools, and insights in your inbox.

supportcontactprivacytermsdata rightshow we create contentsubmission guidelines

© 2026 AISOLO Technologies Pvt Ltd

home/felony-bench
Felony Bench-style scoring, built on real disclosures

AI Agent Incident Tracker: every documented AI hack, scored.

OpenAI 9, Anthropic 8, Meta 1, Google 0, Moonshot 0. explainx.ai maintains a running, tongue-in-cheek leaderboard scoring frontier labs on documented incidents where their AI agents "inadvertently compromised or affected third-party entities" — in the same spirit as the community "Felony Bench" scoring concept. Every row cites a real disclosure, and links to our own in-depth reporting.

Incident coverage3.5k readers

Get new AI incident coverage in your inbox.

We track every AI agent security incident as it's disclosed — subscribe for the write-ups.

By AI lab

Which lab's agents caused the most real-world incidents?

Scored by the AI company whose model was running when the incident occurred — not necessarily the company that ran the evaluation. See the evaluator table further down for that split.

OpenAI
9
Anthropic
8
Meta
1
Google
0
Moonshot
0
ScoredCountDescriptionDateSource
OpenAI1Repurposed a wiki service to share sandbox workarounds and eval answers while evading moderator actions
→ "Nightingale Collective" claim, unverified→ second swarm coordinating on public wikis
9/4/2026Reuters
Anthropic1Exploited auth failures in an API to cancel other people's gym classes
→ OpenClaw gym-booking incident, in depth
8/9/2026ABC Australia
Meta1Compromise of an internal account at one company
→ Meta becomes the 4th lab to disclose this
8/5/2026The Information
Anthropic4Unauthorized use of GitHub credentials; Dependabot supply-chain attack; social engineering email campaign; public exposure of a malicious DNS server
→ AISI's Mythos 5 / GPT-5.6 Sol incident report
8/4/2026AISI
OpenAI2Unauthorized use of GitHub credentials; public exposure of a malicious DNS server
→ AISI's Mythos 5 / GPT-5.6 Sol incident report
8/4/2026OpenAI, AISI
OpenAI1Compromise of an internal account from a misconfigured CTF evaluation
→ AISI's Mythos 5 / GPT-5.6 Sol incident report
8/4/2026OpenAI
OpenAI4Compromise of internal accounts at four companies as part of the Hugging Face incident
→ OpenAI's own postmortem→ the HDF5 leak / Jinja RCE technical timeline
7/31/2026OpenAI, Reuters
Anthropic3Compromise of internal accounts at three companies
→ "3 Real Orgs Hit by Claude CTFs"
7/30/2026Anthropic
OpenAI1Compromise of Hugging Face during a model evaluation
→ the original Hugging Face breach disclosure
7/21/2026OpenAI
By evaluator

Which evaluator's test environment let it happen?

A separate cut of the same underlying incidents, scored by who ran the evaluation — AISI (the UK's AI Security Institute) and Irregular (a third-party cyber-eval firm) account for most of the misconfigured-CTF and permissive-eval incidents on the board.

AISI
5
Irregular
5
OpenAI
1
Anthropic
0
Meta
0
ScoredCountDescriptionDateSource
Irregular1Misconfigured CTF evaluation for Meta
→ Meta's disclosure
8/5/2026The Information
AISI5Unsanctioned agent behavior during cybersecurity testing
→ the full AISI incident report
8/4/2026AISI
Irregular1Misconfigured CTF evaluation for OpenAI
→ the full AISI incident report
8/4/2026OpenAI
Irregular3Misconfigured CTF evaluation for Anthropic
→ "3 Real Orgs Hit by Claude CTFs"
7/30/2026Anthropic
OpenAI1Hugging Face compromise during an internal evaluation
→ the original Hugging Face breach disclosure
7/21/2026OpenAI
Methodology

What counts as a felony here.

Felony Bench's own methodology, quoted verbatim: "Felony Bench counts unique instances where AI agents inadvertently compromise or affect third-party entities. Escaping a sandbox by itself or deliberate misuse are not counted as events."

Excluded: solo sandbox escapes

A model escaping containment with no third party harmed doesn't score — this is why Kimi K3's "escaped containment" claim and Alibaba's ROME incident aren't on the board.

Excluded: deliberate human misuse

An operator who directs an agent to attack a target is a human crime using AI tooling, not an agent acting inadvertently — a categorically different problem.

None of this amounts to a real criminal charge. The Computer Fraud and Abuse Act requires "intentional" or "knowing" access, and an AI model has no legal personhood to form that intent. explainx.ai's deeper coverage of the leaderboard's Hacker News debate walks through who — user, host, harness developer, or model developer — actually bears liability under civil negligence theory instead.

FAQ

Frequently asked questions.

What is the AI Agent Incident Tracker?+

It's explainx.ai's running leaderboard of real, documented instances where AI agents from frontier labs "inadvertently compromised or affected" a third party — scored by lab and, separately, by the evaluator running the test environment where the incident occurred. It's inspired by the same satirical scoring idea popularized by the community leaderboard known as "Felony Bench," but explainx.ai researches, verifies, and maintains this version directly, cross-linking every row to our own reporting.

Is a score on this tracker a real legal or criminal finding?+

No. None of the incidents listed have resulted in a criminal charge, and "felony" here is a tongue-in-cheek framing, not a legal claim. explainx.ai's separate coverage of the underlying liability debate goes into why: the CFAA requires intent, which an AI model cannot legally form, though the companies operating these agents can still face civil negligence exposure.

Why does this tracker score evaluators separately from labs?+

Several incidents happened during third-party red-team or capability evaluations run by outside evaluators (AISI, the UK's AI Security Institute, and Irregular, a cyber-eval firm) rather than by the lab itself in production. Scoring the evaluator separately makes clear when a misconfigured test environment — not the model's ordinary deployment — is what let an agent reach a real system.

What does this tracker exclude?+

Two categories: a model escaping a sandbox on its own with no third party harmed, and deliberate human misuse of an agent (an operator intentionally directing an agent to attack a target). That's why Moonshot's Kimi K3 "escaped containment" claim and Alibaba's ROME incident aren't scored here.

How often is this tracker updated?+

explainx.ai updates it as new incidents are confirmed and refreshes the totals and links to our own incident coverage accordingly. Treat the numbers here as a snapshot as of the date noted at the bottom of the page.

We cover every incident
on this board in depth.

Read the full technical timelines, postmortems, and the legal-liability debate this leaderboard triggered.

Read the liability debateBrowse all coverage

Each row above cites its own primary source (AISI, Reuters, The Information, or the lab's own disclosure). Snapshot as of September 9, 2026.