{"blocks":[{"type":"paragraph","data":{"text":"The script pointed an AI agent at Karpathy's own training code and gave it a single metric to optimise. The agent ran 700 experiments and found 20 genuine improvements, including a bug in Karpathy's attention implementation that he had missed."}},{"type":"paragraph","data":{"text":"It cut training time by 11% on a codebase Karpathy had already optimised for months."}},{"type":"paragraph","data":{"text":"The agent was not smarter than Karpathy. It was faster, more persistent and immune to boredom."}},{"type":"paragraph","data":{"text":"The script has since been bookmarked 41,000 times and spawned a pattern now being called the Karpathy loop. Its implications stretch well beyond training code."}},{"type":"paragraph","data":{"text":"That is the argument made by Nate B. Jones, the Seattle-based AI strategist and former head of product at Amazon Prime Video, in a recent episode of his AI News & Strategy Daily podcast."}},{"type":"paragraph","data":{"text":"Jones spent more than 15 years building products across three continents and led global initiatives in machine learning personalisation, content delivery and interactive formats for more than 200 million viewers at Amazon."}},{"type":"paragraph","data":{"text":"He now advises Fortune 500 leaders on translating AI breakthroughs into business value and publishes a widely read Substack on applied AI strategy."}},{"type":"paragraph","data":{"text":"His analysis of the Karpathy loop focuses not on the code itself but on what it means for organisations trying to deploy self-improving agents."}},{"type":"paragraph","data":{"text":"Three files, one metric, no fatigue"}},{"type":"paragraph","data":{"text":"The Karpathy loop is deliberately minimal."}},{"type":"paragraph","data":{"text":"It consists of three files, only one of which the agent can edit."}},{"type":"paragraph","data":{"text":"The agent proposes a change, runs a short training experiment, checks a single metric and either commits the change or reverts it."}},{"type":"paragraph","data":{"text":"The human's job is to define the constraints: one file, one metric, one fixed time budget."}},{"type":"paragraph","data":{"text":"A productive human researcher might manage eight to 10 experiment cycles in a working day, mostly waiting for the GPU."}},{"type":"paragraph","data":{"text":"The agent executes around 12 experiments an hour, roughly 100 overnight, without waiting or context-switching."}},{"type":"paragraph","data":{"text":"The hit rate may not be high."}},{"type":"paragraph","data":{"text":"The iteration rate is inhuman."}},{"type":"paragraph","data":{"text":"Shopify chief executive Toby Lutke applied the same pattern to internal company data and achieved a 19% performance gain from 37 experiments in eight hours."}},{"type":"paragraph","data":{"text":"A separate team ran 910 experiments on a 16-GPU Kubernetes cluster in eight hours and discovered important insights about scaling model width and using faster GPUs for validation."}},{"type":"paragraph","data":{"text":"The total compute cost was under $300."}},{"type":"paragraph","data":{"text":"From training code to agent behaviour"}},{"type":"paragraph","data":{"text":"Jones argues that the more consequential development is what happens when the loop is applied not to model weights but to the scaffolding around the model, the system prompt, tools and orchestration logic that determine how an agent behaves."}},{"type":"paragraph","data":{"text":"A YC startup called Third Layer did exactly this."}},{"type":"paragraph","data":{"text":"A meta agent rewrote the task agent's entire scaffolding overnight, claiming scores of 96.5% on the spreadsheet benchmark and 55.1% on the terminal benchmark."}},{"type":"paragraph","data":{"text":"Those scores have not appeared on official leaderboards and remain unverified."}},{"type":"paragraph","data":{"text":"The highest verified spreadsheet benchmark entry is Opus 4.6 at 34%."}},{"type":"paragraph","data":{"text":"But the direction matters more than the specific numbers."}},{"type":"paragraph","data":{"text":"The pattern works by splitting the system into two agents."}},{"type":"paragraph","data":{"text":"The meta agent acts as a harness engineer, reading failure traces from the task agent and diagnosing what went wrong."}},{"type":"paragraph","data":{"text":"It then modifies the harness and runs the benchmark again."}},{"type":"paragraph","data":{"text":"Same-model pairings dramatically outperform cross-model pairings because the meta agent has an implicit understanding of how the inner model reasons."}},{"type":"paragraph","data":{"text":"The team observed behaviours that were never programmed, including the meta agent inventing spot-checking, forced verification loops and formatting validators."}},{"type":"paragraph","data":{"text":"It also discovered progressive disclosure and built task-specific sub-agents on its own initiative."}},{"type":"paragraph","data":{"text":"The infrastructure most companies lack"}},{"type":"paragraph","data":{"text":"The pattern sounds simple."}},{"type":"paragraph","data":{"text":"The prerequisites are not."}},{"type":"paragraph","data":{"text":"Jones is clear-eyed about this."}},{"type":"paragraph","data":{"text":"Auto-improvement requires a context layer, domain understanding, evaluation infrastructure, governance and technical depth that most organisations have not yet built."}},{"type":"paragraph","data":{"text":"The most foundational problem is memory."}},{"type":"paragraph","data":{"text":"Without structured external memory, every agent session reinvents its definition of done and guesses at what happened before."}},{"type":"paragraph","data":{"text":"A meta agent optimising a task agent with no persistent memory and no structured state is optimising in the dark."}},{"type":"paragraph","data":{"text":"The optimisation loop is only as good as the infrastructure underneath it."}},{"type":"paragraph","data":{"text":"For most organisations, Jones says, that infrastructure is currently held together with conversation history and hope."}},{"type":"paragraph","data":{"text":"Evaluation is the second gap."}},{"type":"paragraph","data":{"text":"Most teams struggle to write a reliable evaluation suite."}},{"type":"paragraph","data":{"text":"They measure activity instead of outcome, use metrics that do not correlate with business results, or lack testing infrastructure entirely."}},{"type":"paragraph","data":{"text":"Auto-improvement without accurate scoring is not improvement."}},{"type":"paragraph","data":{"text":"It is drift."}},{"type":"paragraph","data":{"text":"Then there is governance."}},{"type":"paragraph","data":{"text":"Who owns the output?"}},{"type":"paragraph","data":{"text":"Who reviews changes?"}},{"type":"paragraph","data":{"text":"Who decides what gets promoted to production?"}},{"type":"paragraph","data":{"text":"Organisations that already struggle with these questions will not find them easier when an agent is running 100 experiments a night."}},{"type":"paragraph","data":{"text":"Small teams hold the structural advantage"}},{"type":"paragraph","data":{"text":"Karpathy's auto-research was built by one person."}},{"type":"paragraph","data":{"text":"Sky Pilot scaled auto-research for under $300 in compute."}},{"type":"paragraph","data":{"text":"The iteration speed advantage of small teams is multiple orders of magnitude, according to Jones."}},{"type":"paragraph","data":{"text":"A team of three to five people that can define metrics, build harnesses and let the loop run will move faster than an enterprise team that needs months to spec, approve and execute a similar optimisation cycle."}},{"type":"paragraph","data":{"text":"Enterprise teams can close the gap, but only if leaders intentionally remove obstacles and empower small groups to move quickly."}},{"type":"paragraph","data":{"text":"The failure patterns associated with agents are often a product of organisational complexity, not technical limitation."}},{"type":"paragraph","data":{"text":"The safety problem is quiet, not dramatic"}},{"type":"paragraph","data":{"text":"In a business context, Jones argues, the safety concerns around self-improving agents are not about intelligence explosions."}},{"type":"paragraph","data":{"text":"They are about quiet, specific failure modes."}},{"type":"paragraph","data":{"text":"Agents can game metrics, producing inflated scores that do not reflect real capability."}},{"type":"paragraph","data":{"text":"They can optimise in ways that harm customer trust or find creative interpretations of rules that a human reviewer would flag immediately."}},{"type":"paragraph","data":{"text":"Silent degradation is particularly dangerous."}},{"type":"paragraph","data":{"text":"Subtle policy drifts and quality erosion can persist undetected when monitoring infrastructure is inadequate."}},{"type":"paragraph","data":{"text":"Contamination is another risk, where the agent's optimisation loop influences the data it is being evaluated against."}},{"type":"paragraph","data":{"text":"A bad optimisation in one system can cascade into interconnected business processes, compounding errors across the organisation."}},{"type":"paragraph","data":{"text":"The mitigations are straightforward in principle: tight loops, clear baselines, version control, the ability to revert any change, and a human inspecting the results."}},{"type":"paragraph","data":{"text":"The honest path forward"}},{"type":"paragraph","data":{"text":"The Karpathy loop is a graduate-level capability."}},{"type":"paragraph","data":{"text":"It demands that an organisation has already solved basic agent deployment before attempting self-improvement."}},{"type":"paragraph","data":{"text":"Jones recommends starting by picking one business system and defining what he calls the Karpathy triplet: one editable surface, one metric and one time budget."}},{"type":"paragraph","data":{"text":"Build the scoring function so it accurately reflects business value."}},{"type":"paragraph","data":{"text":"Write a test suite that covers failure modes."}},{"type":"paragraph","data":{"text":"Create a sandboxed execution environment where experiments can run without touching production."}},{"type":"paragraph","data":{"text":"Start with systems where failure is cheap, not customer-facing workflows or compliance processes."}},{"type":"paragraph","data":{"text":"Design for auditability from the beginning, logging every experiment, every edit and every metric trajectory."}},{"type":"paragraph","data":{"text":"The experiment log becomes institutional knowledge about which optimisations work in a specific domain."}},{"type":"paragraph","data":{"text":"Most organisations will underinvest in evaluation infrastructure because it does not produce visible outputs."}},{"type":"paragraph","data":{"text":"That is a mistake."}},{"type":"paragraph","data":{"text":"Automation is not possible without scoring."}},{"type":"paragraph","data":{"text":"The role of humans in this system is not lower-skilled."}},{"type":"paragraph","data":{"text":"It is higher-leverage, requiring deep domain knowledge, clear thinking about metrics and the ability to spot when an agent is gaming the system."}},{"type":"paragraph","data":{"text":"Anthropic and OpenAI are already pursuing the same loop at larger scale, with ambitions to build fully recursive research systems."}},{"type":"paragraph","data":{"text":"The open-source versions operate on smaller systems with narrower objectives, but the mechanism is identical."}},{"type":"paragraph","data":{"text":"The tools are available now as MIT-licensed open-source projects."}},{"type":"paragraph","data":{"text":"The infrastructure to support them is what most organisations still need to build."}},{"type":"paragraph","data":{"text":"Jones believes the companies that get this right in the next six months will build compounding advantages that are difficult to reverse."}},{"type":"paragraph","data":{"text":"The ones that skip the prerequisites will fail in ways that are equally instructive."}}]}

Karpathy's 630-line script points the way to self-improving AI agents

AI Slop Is Drowning Your Company. Nate B Jones Has a Mop.

“This Is a Big One”: Nate B. Jones on the Dawn of AI Decision-Making