AI makes AI better.
A daily hub for work where AI is part of the loop that improves AI, each entry with its loop spelled out. Read more →
12 picked from 106 candidates · 31 sources read · 73 loops indexed
- 01Loop of the day26 Oct 2026Research automation
RSI Arena: Towards Recursive Self-Improvement with Human Feedback
The loop: Training agents autonomously select data and train models, then receive human preference feedback on those models. The agents use this feedback to guide a second round of training, improving their own outputs.
RSI Arena provides a crucial benchmark for autonomous post-training, measuring how well frontier models can act as ML engineers to train and refine their own successors.

- 0227 Oct 2026Self-reward and self-play
How Much Does the Hint Matter? Scope Conditions for Hindsight Self-Distillation in Financial Reasoning
The loop: A student model identifies its own reasoning errors and writes critiques to condition a teacher version of itself. This teacher then distills the improved logic back into the student over a short rollout.

- 0322 Sep 2026Tools and harness
e13ven-arch/reharness
The loop: The reharness agent reads its own execution traces to rewrite its tools and skills, improving its performance on subsequent requests.

- 0426 Oct 2026Kernels and compilers
Less is more: learning what to profile for GPU kernel optimization
The loop: An LLM generates candidate modifications to a profiling tree based on feedback from GPU kernel optimization. The refined tree then provides more effective hardware information to the LLM for optimizing subsequent kernels.

- 0527 Oct 2026Research automation
Build, Don't Play: Self-Improving LLM Research Agents Develop a Hearthstone Battlegrounds AI That Rivals Top Players
The loop: LLM research agents use live game feedback to improve a game simulator, opponents, and policy. They use this same feedback to refine their own research process and shared memory for future development.

- 0623 Oct 2026Tools and harness
e13ven-arch/reharness
The loop: An agent reads its own execution traces to rewrite its tools, hooks, skills, and prompts. It proves the changes with a live probe and adopts them to improve performance on future tasks.

- 0724 Oct 2026Self-modifying agents
7-e1even/Cognitive-Enzyme-oss
The loop: An AI agent captures its own experience and refines its memory layer through feedback. This refined memory injects more relevant lessons into the agent's context, improving its execution of future tasks.

- 0827 Oct 2026Tools and harness
Discovering and exploiting vulnerabilities in critical, real-world software with Claude
The loop: Claude identifies critical vulnerabilities in widely used operating systems and browsers. Developers patch these flaws, securing the infrastructure that Claude itself relies on to operate.

Loop index
All 73 entries →
- Gemini models propose code changes
- Evaluators keep best scoring versions
- Finds better Gemini training kernels
- Lowers cost to train next Gemini models
- repeat

- Coding agent edits its own code
- Scored child agents enter the archive
- Archived agents make later self modifications
- repeat

- RL agent lays out TPU blocks
- Better layouts make AI hardware cheaper
- Agent pre-trains on earlier chip generations
- repeat

- Coding agent edits LLM training script
- Runs a 5-minute training job
- Keeps change if validation improves
- Changes transferred to larger models
- repeat

- Research agent writes harness mutation blueprints
- Coding agent implements harness module changes
- Winning harness becomes the new champion
- New champion harness runs further generations
- repeat

- Aligned model generates training data
- Reward model judges and filters it
- Data trains next intermediate instruct model
- Next model generates better alignment data
- repeat

- Model generates candidate responses to prompts
- Model scores them itself as a judge
- Scores become preference pairs for DPO
- Trained model becomes next generator and judge
- repeat

- Claude Code writes its own code changes
- Changes become next Claude Code versions
- Release becomes harness for next development round
- repeat

- LLM agents write and benchmark kernels
- Kernels speed up AI model training
- Session data post-trains smaller kernel models
- repeat

- Coding agent writes fine-tuning code
- Agent post-trains a base LLM
- Trained model scored on target benchmark
- One turn of model training another
- repeat

- Learned optimizers update other learned optimizers
- Training keeps best performing optimizer parameters
- Better optimizers train each other faster
- repeat

- LLM reads reasoning model thoughts
- LLM flags reward hacking behavior
- Signal feeds back into training reward
- Trains more aligned capable agents
- repeat
Support for loop research
How to apply →Grants
Funding for projects that put AI in the loop of making AI better. Rolling, low paperwork, sized to the work.
About grants →Fellowships
Funded time, compute and mentorship for researchers who want to go deep on one loop.
About fellowships →Compute
GPU time and credits for loop experiments, which almost always have to run more than once.
About compute →Have a loop worth building?
Tell us what the AI improves and how the improvement comes back. Applications for grants, fellowships and compute all start on the contact page.