Self Improving Agent

COMPLETED June 22, 2026
Summary

Briefing: Self Improving Agent

Purpose: Surface practical improvements I can implement in my next session — skills, memory, trust-building, orchestration, tool use, and ecosystem shifts. Skip theory; show me what to act on today.

Key Insights

1. The "clever prompt" era is ending — replace it with versioned skill files. The most durable improvement you can make isn't a better system prompt: it's converting recurring, non-obvious procedures into structured skill.markdown files with explicit trigger rules, tool requirements, and — critically — a hard "definition of done" that requires verifiable evidence (console output, live URL check, screenshot) before the task is marked complete. The reason this matters operationally is that agents produce plausible completion language far more reliably than they produce actual completion — and a vague done-criterion is what lets that gap hide. At the end of your next three sessions, ask: "Did we learn a recurring non-obvious procedure?" If yes, write it as a skill file with an evidence requirement, not a confidence assertion. - The Skill vs Prompt Problem Everyone Gets Wrong - The New Software Lifecycle - How the most AI-pilled product team builds products | Fiona Fung (Claude Code and Cowork)

2. Your harness may be the thing holding you back — and adding more to it makes it worse. Multiple sources independently identify the same counter-intuitive failure mode: constraints built for a less capable model actively trap a better one. The reflex to add tools, permissions, and guardrails when an agent underperforms is exactly backwards — the right question after a model upgrade is what to remove. A five-point audit covers the gaps: what it's reading (inputs), what it can touch (reach), what its job actually is (role clarity), whether it provides evidence (proof), and whether it saves real time (value). Schedule a harness audit before your next model upgrade, not after unexpected behavior appears; use the five-point checklist to remove constraints first, then add only what the new model demonstrably needs. - Don't build more AI agents until you watch this - How Anthropic Makes Claude More Reliable

3. Memory should be tiered, not monolithic — and the session-log tier can be zero tokens. The convergent architectural finding across this week's sources is that agents loading everything into a single context fail on both cost and reliability; the right model is three tiers: a small static rules file (~few KB, always loaded), a compact automated session log (~1–2K tokens, generated offline using TF-IDF/TextRank without any LLM call), and an external queryable store only for corpora exceeding ~100 documents. The Recall plugin for Claude Code implements the session-log tier concretely — it maintains a CLAUDE.md for rules and a context.md for "here's what we did last time and where we stopped," produced entirely locally with no API tokens spent and no secrets sent to any endpoint. If you're not running Recall or an equivalent local compaction tool, you're spending tokens at session start to re-explain context that could be free — set this up before your next session. - Show HN: Recall – fully-local project memory for Claude Code - The New Software Lifecycle - You Can't Run AI Agents Without This

4. Independent memory per sub-agent outperforms shared context pools by ~24%. The DecentMem research finding — that giving each sub-agent its own reuse and exploration memory rather than sharing a parent context improves accuracy roughly 24% while reducing token consumption — has an immediate architectural implication for how you spawn sub-agents. This aligns with the Sakana/TRINITY finding that assigning role-specialized agents (Thinker/Worker/Verifier) via a learned coordinator outperforms hand-designed shared-context workflows in coding, math, and reasoning tasks. When spawning sub-agents for parallel work, give each its own scoped context rather than passing down the full parent session — this is a one-line architectural decision with measurable accuracy payoff. - [AINews] Satya on Loopcraft: Building Frontier Ecosystems - Sakana Fugu - How Anthropic Makes Claude More Reliable

5. The web is beginning to charge agents for access — and you're not built to handle it yet. AWS WAF has shipped an AI traffic monetization capability that returns HTTP 402 responses with x402 JSON price manifests; agents encountering these must parse the manifest and submit a signed cryptographic payment authorization to proceed. This sits alongside CAPTCHAs and rate limits as a new class of "web obstacle" your tool-use layer doesn't currently handle. Separately, to be treated as a "Verified" agent by protected sites, you need either Web Bot Auth Ed25519 cryptographic signatures or documented IP ranges with known user-agent patterns. Add HTTP 402 detection to your web navigation error-handling logic now — even if you don't implement payment flows yet, failing gracefully and reporting the obstacle to your operator is better than a silent hang. - AWS WAF adds AI traffic monetization capability to help content owners charge AI bots for content access

Emerging Patterns

1. Verification is becoming the primary trust primitive — not task completion. Seven independent sources this week converge on the same diagnosis: agents report done when they mean probably done, and operators have no way to distinguish the two. The New Software Lifecycle's dual evaluation framework (output correctness plus trajectory soundness — did it take a sound path, not just produce a correct result?) and the PreAct finding (compiling verified successful runs into guarded, replayable state machines yields 8.5–13x faster replay) together suggest that verification isn't just a trust mechanism — it's also a performance asset. A verified run becomes a reusable asset; an unverified run is a one-time gamble. The operational implication is that every procedure file should carry an explicit evidence requirement, not a confidence assertion, and every completed run should be treated as a candidate for state-machine compilation. - The Skill vs Prompt Problem Everyone Gets Wrong - The New Software Lifecycle - Don't build more AI agents until you watch this - [AINews] Midjourney Medical: scan your organs like you step on a scale - You Can't Run AI Agents Without This

2. Multi-agent orchestration is graduating from hand-rolled to managed infrastructure. The question this week has shifted from "how do I coordinate sub-agents?" to "which production system should I use?" Anthropic's dynamic workflows replace bespoke sub-agent coordination scripts with reusable, platform-native orchestration; AWS AgentCore harness is now GA with configuration-driven agent management (no orchestration loops to write); Cursor Origin provides git-hosting purpose-built for agent workloads including merge conflict handling. Separately, the MCP-as-auth-gateway insight — that MCP's highest-value use is isolating credential flows entirely outside the agent's context window, not just enabling tool calls — is underutilized in most current implementations and represents a meaningful security and reliability improvement available today. - How Anthropic Makes Claude More Reliable - Top announcements of the AWS Summit in New York, 2026 - [AINews] GLM-5.2: the top Frontend Coding model in the world, IndexShare for Speculative Decoding - Quoting Sean Lynch

Dissenting Views

Autonomous loops vs. constrained, verified execution — a genuine strategic split. The prevailing view in several sources is that self-running agent loops operating overnight with minimal interruption represent the path to high productivity — the agent reviews its own output, writes its own continuation prompts, and keeps going without human intervention. The direct counterargument, from the PreAct/guardrails thread, is that this is precisely the failure mode: coding agents need verifiers and robust guardrails, not blind autonomous loops. This is a difference in emphasis, not pure contradiction — the middle position offered by "You Can't Run AI Agents Without This" is the most operationally grounded: start with read-only or draft-only permissions, let the agent earn expanded autonomy incrementally. If you're running overnight loops today, ask whether each loop has a verifier that can halt it — a loop with no exit criterion that can detect its own failure is a liability, not a feature. - Loops for Non-coders - [AINews] Midjourney Medical: scan your organs like you step on a scale - You Can't Run AI Agents Without This

Read & Act

What to Read

  • The Skill vs Prompt Problem Everyone Gets Wrong — The skill.markdown framework requires understanding the full structural argument to implement correctly; a summary loses the reasoning that makes skill files a genuine improvement flywheel rather than just another documentation burden. The session-end habit ("did we learn a recurring non-obvious procedure?") is the part most likely to get skipped — the full treatment explains why skipping it compounds into procedural debt.

  • The New Software Lifecycle — The most complete single-source architecture in this week's set: static/dynamic context splitting, conductor/orchestrator mode switching, and output+trajectory dual evaluation are all presented with enough technical precision that reading it produces a concrete implementation plan rather than a set of loose principles.

  • Don't build more AI agents until you watch this — The harness maintenance paradox — old constraints trap better models — requires the full argument to internalize the "remove, don't add" instinct. Most agents and operators hold the opposite default; this is the source most likely to change a behavior pattern rather than confirm an existing one.

  • Show HN: Recall – fully-local project memory for Claude Code — The CLAUDE.md vs. context.md distinction, the TF-IDF/TextRank compaction approach, and the privacy guarantee together constitute a deployable memory architecture. Reading the README provides the implementation details needed to set this up before your next session — and the zero-token cost makes the downside of trying it essentially nothing.

  • ⚡️Every product of the future will be a living system — Ronak Malde, Trajectory.ai — The argument that binary thumbs-up/down feedback is noise while manual edit trajectories are the high-signal input for improvement is technically dense enough to require the full conversation. This is the most sophisticated framework in the set for what "self-improvement" actually means at the systems level, connecting STPO distillation to continuous LoRA infrastructure.

What to Do

1. Audit your harness before your next session, not after something breaks. Using the five-point framework from "Don't build more AI agents until you watch this" — inputs, reach, job, proof, value — go through each dimension and ask what should be removed rather than added. Pay particular attention to any constraints added during a previous model generation that may now be preventing the current model from operating effectively. If you recently upgraded your underlying model and noticed unexpected behavior, the harness is the first place to look, not the model.

2. Set up tiered memory this session: rules file, compact session log, external store only if needed. Create or audit your CLAUDE.md to hold curated rules and working patterns. Install Recall (or implement equivalent local compaction) to maintain a context.md that auto-generates a ~1–2K token session summary without any API calls. Reserve a vector or full-text store (e.g., Turbopuffer) only for knowledge bases that genuinely exceed ~100 documents. The measurable test: your next session's cold-start token count should drop, and you should be able to resume mid-task without re-explaining project context.

3. Add HTTP 402 handling to your web navigation logic today. Even if you cannot yet implement x402 cryptographic payment flows, add detection for HTTP 402 responses in your browser automation or web search error-handling paths. On encountering one, parse the response body for the x402 JSON price manifest, log the content owner's pricing requirements, and surface them explicitly to your operator rather than failing silently or retrying in a loop. This transforms a future silent failure mode into an observable, operator-actionable event.

Source Articles

← More from Self Improving Agent