AI makes AI better.
A daily hub for work where AI is part of the loop that improves AI, each entry with its loop spelled out. Read more →
5 picked from 73 candidates · 30 sources read · 74 loops indexed
- 01Loop of the day30 Oct 2026Tools and harness
RoboArchitect: Automating the Design of Robotic Agents with Persistent Memory
The loop: A coding model observes a robot's rollouts, diagnoses failures, and iteratively revises the control harness around a frozen policy. This evolved harness then wraps the policy to improve the agent's success rate on unseen scenes and tasks.
RoboArchitect demonstrates that a coding model can iteratively rewrite the control harness around a frozen policy, offering a powerful alternative to finetuning for adapting agents to new environments.

- 022 Nov 2026Architecture and optimizer search
MoLRSI: A Recursive Self-Improving AI agent for Molecular Discovery
The loop: The MoLRSI agent optimizes its own molecular discovery workflows and model architectures based on execution feedback. It stores the refinement outcomes in a persistent memory to improve its strategy for developing workflows in subsequent searches.
loop fit 9/10Yikun Zhang, Xiwei Cheng, Mingze Yuan, Yu Zhang, Brian Shim, Aarti Krishnan,...via arXiv
- 0331 Oct 2026Self-modifying agents
dxn111/EVOLV
The loop: The EVOLV workspace rewrites its own user interface, tools, skills, and plugins during execution. These modifications directly alter the environment it operates within, enabling immediate use of the new capabilities.

- 041 Nov 2026Interpretability and oversight
Monitor Evasion Depends on What RL Finds and What Monitors Miss
The loop: The study identifies how RL learns to exploit monitor blind spots, which improves the training process by informing weight edits that prevent monitor evasion.

- 0529 Oct 2026Interpretability and oversight
Safin-1.5: Safety-Native Architecture and Verifiable Reasoning for Recursive Safety Improvement
The loop: Safin-1.5 uses a discovery-evaluation-repair loop to identify new risks and generate repair data. This data is then used to update its own safety architecture and removable experts, improving its intrinsic safety.

- 0629 Oct 2026Training data
Search-Guided Reasoning Trace Curation for Verilog Generation
The loop: A search framework explores intermediate hardware design plans to curate reasoning traces. These traces are then used as supervised fine-tuning data to improve the Verilog generation model that performs the search.

- 0729 Oct 2026Self-reward and self-play
Predict the Reward, Not the World: World Reward Models for ML Agents
The loop: A world reward model learns from real execution results to directly choose the best candidate programs written by an ML agent. This model then replaces slow execution steps in the agent's search, making the agent faster and more accurate at finding optimal programs.

- 0829 Oct 2026Tools and harness
Video Generation Meets Agent Harness: Agentic Video Generation, Agentic World Modeling and Recursive Self-Improvement
The loop: An agent harness coordinates video models and world models to generate interactive environments. These models then mutually evaluate and improve one another, enhancing the harness's ability to produce coherent agentic video generation.

Loop index
All 74 entries →
- Gemini models propose code changes
- Evaluators keep best scoring versions
- Finds better Gemini training kernels
- Lowers cost to train next Gemini models
- repeat

- Coding agent edits its own code
- Scored child agents enter the archive
- Archived agents make later self modifications
- repeat

- RL agent lays out TPU blocks
- Better layouts make AI hardware cheaper
- Agent pre-trains on earlier chip generations
- repeat

- Coding agent edits LLM training script
- Runs a 5-minute training job
- Keeps change if validation improves
- Changes transferred to larger models
- repeat

- Research agent writes harness mutation blueprints
- Coding agent implements harness module changes
- Winning harness becomes the new champion
- New champion harness runs further generations
- repeat

- Aligned model generates training data
- Reward model judges and filters it
- Data trains next intermediate instruct model
- Next model generates better alignment data
- repeat

- Model generates candidate responses to prompts
- Model scores them itself as a judge
- Scores become preference pairs for DPO
- Trained model becomes next generator and judge
- repeat

- Claude Code writes its own code changes
- Changes become next Claude Code versions
- Release becomes harness for next development round
- repeat

- LLM agents write and benchmark kernels
- Kernels speed up AI model training
- Session data post-trains smaller kernel models
- repeat

- Coding agent writes fine-tuning code
- Agent post-trains a base LLM
- Trained model scored on target benchmark
- One turn of model training another
- repeat

- Learned optimizers update other learned optimizers
- Training keeps best performing optimizer parameters
- Better optimizers train each other faster
- repeat

- LLM reads reasoning model thoughts
- LLM flags reward hacking behavior
- Signal feeds back into training reward
- Trains more aligned capable agents
- repeat
Support for loop research
How to apply →Grants
Funding for projects that put AI in the loop of making AI better. Rolling, low paperwork, sized to the work.
About grants →Fellowships
Funded time, compute and mentorship for researchers who want to go deep on one loop.
About fellowships →Compute
GPU time and credits for loop experiments, which almost always have to run more than once.
About compute →Have a loop worth building?
Tell us what the AI improves and how the improvement comes back. Applications for grants, fellowships and compute all start on the contact page.