CYC26  ·  The Three Ways AI Agents Fail
Tools Memory Coordination
01 / 12
Commit Your Code 2026

The Three Ways
AI Agents Fail.

And how to fix yours.
Moeez Khan  ·  @moeez-khan
Views my own, not my employer's. No confidential information.
The moment it breaks
DEMO
PRODUCTION

It worked in the demo.

Then it met real code.
MIT · State of AI in Business 2025
95%
of enterprise GenAI delivers no measurable return
only 5% of custom tools reach production
the model the system around it  is where it breaks.
The Failure Map
1 · TOOLS 2 · MEMORY 3 · COORDINATION AGENT
Running example: an agent modernizing a legacy monolith.
Layer 1 · Tools  /  the break

An agent is only as reliable
as the tools it calls.

agent search_codereturns ½ results wrong planno error thrown
Your story → drop in during rehearsal

A real moment a tool returned partial/wrong data and the agent built on it, what broke, what it cost to find. Keep it field-level.

Layer 1 · Tools  /  the fix
Paradigm: fail loud, not silent  ·  idempotency = an elevator button (press it 5x, one trip)
LOOSE
# anything goes, fails quietly
tool(query: str)
  → returns str (maybe empty)
STRICT
tool(
  query: Enum[...]          # typed
  on_error: Result | Failure  # must handle
  idempotent: true          # safe retry
)
Insight — confirm / replace

The failure that hurts isn't the tool erroring, it's the tool succeeding with wrong data. Give it a third state most schemas can't express: "succeeded, but low confidence."

✓ Takeaway 1 — Reliable Tool Calls
Layer 2 · Memory  /  the break

RAG retrieves snippets.
It misses how they relate.

mod businessrule missed · 3 hops
Your story → drop in during rehearsal

A real case where retrieval missed a relationship and the output looked right but wasn't, the moment you realized RAG alone wasn't enough.

Layer 2 · Memory  /  the fix
Paradigm: retrieval vs. relationships  ·  RAG = index cards. Knowledge graph = a subway map.
mod caught
Facts → RAG
Relationships → graph
wrong = a missed connection? → graph
Insight — confirm / replace

You don't need a perfect graph. A shallow one-hop dependency graph on top of RAG catches most silent drops, for a fraction of the effort.

✓ Takeaway 2 — RAG vs. Knowledge Graph, know which, when
Layer 3 · Coordination  /  the break

More agents is not
more reliability.

analyzer migrator validator
40%
of agentic projects canceled by 2027 — mostly missing risk controls (Gartner)
Your story → drop in during rehearsal

A real multi-agent moment where one agent's bad output flowed downstream unchecked, or where you resisted adding agents and it paid off.

Layer 3 · Coordination  /  the fix
Paradigm: the bulkhead — watertight ship compartments; one floods, the ship floats.  +  least privilege.
analyzer migrator validator boundary human sign-off
Insight — confirm / replace

The human checkpoint is only a bottleneck if it's everywhere. Gate the irreversible ~5% of steps; leave the rest autonomous.

✓ Takeaway 3 — No-Cascade Coordination  ·  delegate the work, never the accountability
What you take home
Three-quarters are adopting agents. Few reach production. These three layers are the gap.

The Failure Map

locate any agent bug

Reliable Tool Calls

kill silent failures

RAG vs. Knowledge Graph

right memory for the job

No-Cascade Coordination

contain, don't spread
Take it with you

Thank you.

→ Full write-up & reference repo: [article link]
[github.com/... link]  tool schemas · RAG-vs-graph demo · coordination patterns
Moeez Khan  ·  @moeez-khan  ·  find me in the hallway.
← → / space  ·  N notes  ·  F full-screen
Speaker notes