Alphabell.
Agents and harness

Self-modifying agents

Agents that edit their own code, prompts or scaffold, and keep the versions that score better.

Darwin Gödel Machine
PaperarXiv
Darwin Gödel Machine
  1. Coding agent edits its own code
  2. Scored child agents enter the archive
  3. Archived agents make later self modifications
  4. repeat
Self-modifying agentsUBC, Vector Institute, Sakana AI · 2025
Claude Code
ProjectAnthropic
Claude Code
  1. Claude Code writes its own code changes
  2. Changes become next Claude Code versions
  3. Release becomes harness for next development round
  4. repeat
Self-modifying agentsAnthropic · 2025
A Self-Improving Agent that Grows its Own DSL: Oracle-Free Operator Induction for Exact Question Answering
PaperarXiv
A Self-Improving Agent that Grows its Own DSL: Oracle-Free Operator Induction for Exact Question Answering
  1. Frozen model attempts exact QA tasks
  2. Model authors new DSL operators
  3. Independent implementations verify operators via consensus
  4. Verified operators expand model's executable library
  5. repeat
Self-modifying agentsChuang et al. · 2026
Recursive Self-Improvement through Collective Intelligence
ProjectarXiv
Recursive Self-Improvement through Collective Intelligence
  1. Model searches for multi-agent workflows
  2. Model selects the best executions
  3. Model trains on selected executions
  4. Model improves its base capabilities
  5. repeat
Self-modifying agentsSakana AI · 2026
AIDE2
PaperarXiv
AIDE2
  1. Outer agent rewrites inner agent code
  2. Accepted rewrites become the incumbent agent
  3. Discovered agent becomes the outer loop agent
  4. repeat
Self-modifying agentsWeco AI · 2026
SICA
PaperarXiv
SICA
  1. Best agent changes its own code
  2. Edited agent is benchmarked and archived
  3. Archived agent makes the next edit
  4. repeat
Self-modifying agentsUniversity of Bristol, iGent AI · 2025
STOP
PaperarXiv
STOP
  1. GPT-4 rewrites the improver program
  2. Each rewrite is scored by meta-utility
  3. Best rewrite becomes next round improver
  4. repeat
Self-modifying agentsZelikman, Lorch, Mackey, Kalai (Stanford, Microsoft Research, OpenAI) · 2023
Aider
ProjectAider
Aider
  1. Aider writes new code for Aider releases
  2. New code becomes the next release
  3. Next release builds the following version
  4. repeat
Self-modifying agentsPaul Gauthier (Aider) · 2023
Gödel Machine
FoundationarXiv
Gödel Machine
  1. Proof searcher tests proof techniques
  2. Executes useful rewrites of its own code
  3. Rewritten machine searches on its new code
  4. repeat
Self-modifying agentsSchmidhuber (IDSIA) · 2003

Recently on the radar

More →
PaperarXiv·13 Nov 2026·Self-modifying agents

Evidence-Governed Adoption of Self-Generated Updates in Autonomous AI Agents

The loop: An autonomous agent generates candidate modifications to its own prompts, tools, and workflows based on its interaction history. A governance framework then evaluates these candidates against fresh audits and adopts the successful ones, permanently upgrading the agent's capabilities.

loop fit 9/10Hoang Tran Vuong, Linh Ngo Van, Dang Nguyen et al.via arXiv
Evidence-Governed Adoption of Self-Generated Updates in Autonomous AI Agents
PaperarXiv·12 Nov 2026·Self-modifying agents

S1-Evo: Experience-Guided Evidence Competition Attacks on Typed System-1 Decision Models

The loop: A self-evolving framework optimizes attack candidates via feedback search and distills the verified results into experience cards. It then retrieves these cards to construct more effective perturbations against System-1 decision models on unseen tasks.

loop fit 7/10Arnab Sanyal, Gourav Datta, Sandeep P. Chinchalivia arXiv
S1-Evo: Experience-Guided Evidence Competition Attacks on Typed System-1 Decision Models
PaperarXiv·12 Nov 2026·Self-modifying agents

Discovering Effective Agent Memory Designs through Program Evolution

The loop: An LLM-based evolution framework iteratively diagnoses failures in agent memory programs and proposes code edits to resolve them. The resulting evolved memory programs are deployed back into the agents, improving their accuracy and reducing serving costs.

loop fit 9/10Xinheng Ding, Seyyed Saeid Cheshmi, Ziyang Zhang et al.via arXiv
Discovering Effective Agent Memory Designs through Program Evolution
PaperarXiv·10 Nov 2026·Self-modifying agents

When Should Agents Remember? Falsification-Gated Self-Evolution for LLM Agents

The loop: An LLM agent generates structured hypotheses from its experiences and tests them through a falsification-gated process, which improves its persistent memory, making the agent more successful and safer at future tasks.

loop fit 9/10Runxuan Tang, Haoyu Gao, Yuyan Ding et al.via arXiv
When Should Agents Remember? Falsification-Gated Self-Evolution for LLM Agents
NewsAlignment Forum·9 Nov 2026·Self-modifying agents

Test-Time Learning with an Evolving Library

The loop: A language model extracts modular skills and reflective insights from its own inference trajectories to build a shared library. It then reuses and evolves these knowledge abstractions to improve its performance on subsequent problem instances without parameter updates.

loop fit 9/10Buckvia Alignment Forum
Test-Time Learning with an Evolving Library
PaperarXiv·6 Nov 2026·Self-modifying agents

Test-Time Learning with an Evolving Library

The loop: EvoLib extracts knowledge abstractions from its own inference trajectories to build a shared library, which improves the model's performance on subsequent problem instances.

loop fit 9/10Yuhao Tan, Hanyun Jiang, Fangkai Yang et al.via arXiv
Test-Time Learning with an Evolving Library
PaperarXiv·6 Nov 2026·Self-modifying agents

The components of agent memory

The loop: Claude uses a dreaming mechanism to organize memory and correct mistakes, which improves its internal state and makes it better at learning from experience.

loop fit 7/10Mengsong Wu, Tianchen Zhou, Zhaochen Su, Zhenhua Liu, Zhe Cui, Aimin Zhouvia arXiv
The components of agent memory
Blog postAnthropic·6 Nov 2026·Self-modifying agents

The components of agent memory

The loop: Claude uses a dreaming mechanism to organize memory and correct mistakes, which improves its internal state, which makes the model better at learning from experience.

loop fit 7/10via Anthropic
The components of agent memory

Other loop types