news

Understanding Bottleneck

> You can outsource your thinking, but you can't outsource your understanding - Andrej Karpathy

Sebastien Dubois

09 May 2026 — 2 min read

Canonical version: Understanding Bottleneck.

You can outsource your thinking, but you can't outsource your understanding - Andrej Karpathy

The Understanding Bottleneck is a load-bearing principle for the Software 3.0 era: as agents take over more of the production of work (code, prose, analyses, decisions), the human's irreplaceable role becomes holding the model of why the work matters and whether it is correct. The agent can do the doing; only a human can understand. Skip that step and the system silently drifts into states no one can recover from.

The Distinction

Thinking is the cognitive labor: enumerating options, drafting code, summarizing documents, generating hypotheses, describing concepts, etc. This is increasingly outsourceable.
Understanding is the model that sits behind the labor: the why, the constraints, the unseen consequences, the taste calls, the failure modes. This is not outsourceable, because the moment you outsource it you have no way to evaluate the agent's output, and you're not improving along the way, you just become dependent.

For instance, an LLM can write the code, but it cannot tell you whether the code is what your business actually needs. It can synthesize a research brief, but it cannot tell you whether the brief misframed the question. It can describe ideas for you, but it won't change the way you think.

Why This Matters Now

At scale, hidden errors compound: each piece of unreviewed agent output that you don't understand adds to your Cognitive debt. Past a threshold, you can no longer steer the system because you have lost the model.
In fast-moving environments, only understanding transfers: the agent's specific output is disposable. Your understanding is what you carry into the next idea, the next decision, the next agent, the next model release, etc.
Verifiability gates capability (AI Verifiability as a Capability Ceiling); understanding is what lets a human apply that gate. Without understanding, you cannot tell on-rails from off-rails (Jagged Intelligence).
Culture matters: organizations that reward output volume over understanding accumulate invisible risk. The metric that survives is "can this team explain what their agents did and why."

Practical Heuristics

Read the AI output, not just the summary message. If you cannot explain what AI generated in your own words, you have outsourced understanding.
Re-derive at least one step of any agent-produced analysis from scratch. If your re-derivation does not match, the agent is wrong, you are wrong, or the framing was wrong; all three matter.
Refuse to ship what you cannot explain to a hostile reviewer. This is also Simon Willison's vibe-coding line.
Treat dictated handoffs as a tax: when a teammate inherits work, the understanding has to transfer too. Otherwise the recipient inherits cognitive debt.

About Sébastien

I'm Sébastien Dubois, and I'm on a mission to help knowledge workers escape information overload. After 20+ years in IT and seeing too many brilliant minds drowning in digital chaos, I've decided to help people build systems that actually work. Through the Knowii Community, my courses, products & services and my Website/Newsletter, I share practical and battle-tested systems.

I write about Knowledge Work, Personal Knowledge Management, Note-taking, Lifelong Learning, Personal Organization, Productivity, and more. I also craft lovely digital products and tools.

If you want to follow my work, then become a member and join our community.

Ready to get to the next level?

If you're tired of information overwhelm and ready to build a reliable knowledge system:

📚 KM for Beginners — 10+ hours of structured video lessons
🚀 Obsidian Starter Kit — Ready-made vault with 40+ templates
💼 Knowledge Worker Kit — Complete guides + lifetime community
🦉 1-on-1 Coaching — Personalized guidance
🎯 Join Knowii — Community + ALL courses & tools