AI makes AI better.
A daily hub for work where AI is part of the loop that improves AI, each entry with its loop spelled out. Read more →
11 picked from 74 candidates · 29 sources read · 74 loops indexed
- 01Loop of the day1 Nov 2026Tools and harness
Exo: An Architecture for Self-Improving Systems at Runtime
The loop: The Exo agent autonomously edits its own harness code and strategies during task execution. These inspectable code changes are preserved and activated to reduce costs and improve performance on subsequent tasks.
Exo collapses the optimization loop directly into task execution, allowing agents to rewrite their own harnesses on the fly.

- 022 Nov 2026Tools and harness
TinyAstral: Transferring Self-Evolving Harnesses to Tiny Generalist Manipulation Agents
The loop: Frontier agents propose and statistically validate edits to a teacher model's harness. The improved harness is then used to collect successful trajectories to distill a compact student agent that operates in that same evolved harness.

- 032 Nov 2026Interpretability and oversight
Training activation classifiers for safety and alignment
The loop: Activation classifiers monitor a model's internal activity to detect policy violations. This improves the safety and alignment of the model, making it safer to deploy and use for further development.

- 042 Nov 2026Interpretability and oversight
Training activation classifiers for safety and alignment
The loop: Activation classifiers monitor a model's internal activity to detect policy violations, which improves the safety and alignment of the model, which makes the model safer to deploy and use for further development.
loop fit 7/10Alex Makelov, Xiaojun Xu, Sundaram Ananthanarayanan, Ethan Mcdonald, Tom Dupre...via OpenAI Alignment
- 0530 Oct 2026Self-reward and self-play
CARE: Grounded Recursive Self-Improvement for Production Customer-Service Agents
The loop: The CARE agent identifies its own production failures and pairs them with independently verified repairs. It then uses on-policy self-distillation to update its own weights, improving its performance on future customer service traffic.

- 062 Nov 2026Tools and harness
Scaling Git at OpenAI
The loop: Codex generates code at a scale that necessitates a new Git backend, which improves the development infrastructure for OpenAI models, which makes the development of Codex and its successors more efficient.
loop fit 6/10via OpenAI
- 0730 Oct 2026Self-modifying agents
Evolving Memory, Learning to Meta-Control: Test-Time Adaptation for Experience-augmented LLM Agents
The loop: The OMCE meta-controller uses task feedback to update its memory bank and refine its own routing policy via contextual bandit updates. This improves how the agent retrieves and utilizes experience in future tasks.

- 0831 Oct 2026Research automation
algorithmicsuperintelligence/openevolve: v0.4.1
The loop: The OpenEvolve framework uses mixed evolution modes and competitive checkpoints to iteratively refine programs. It records the mode used on each program in an evolution trace to improve the evolution process.

Loop index
All 74 entries →
- Gemini models propose code changes
- Evaluators keep best scoring versions
- Finds better Gemini training kernels
- Lowers cost to train next Gemini models
- repeat

- Coding agent edits its own code
- Scored child agents enter the archive
- Archived agents make later self modifications
- repeat

- RL agent lays out TPU blocks
- Better layouts make AI hardware cheaper
- Agent pre-trains on earlier chip generations
- repeat

- Coding agent edits LLM training script
- Runs a 5-minute training job
- Keeps change if validation improves
- Changes transferred to larger models
- repeat

- Research agent writes harness mutation blueprints
- Coding agent implements harness module changes
- Winning harness becomes the new champion
- New champion harness runs further generations
- repeat

- Aligned model generates training data
- Reward model judges and filters it
- Data trains next intermediate instruct model
- Next model generates better alignment data
- repeat

- Model generates candidate responses to prompts
- Model scores them itself as a judge
- Scores become preference pairs for DPO
- Trained model becomes next generator and judge
- repeat

- Claude Code writes its own code changes
- Changes become next Claude Code versions
- Release becomes harness for next development round
- repeat

- LLM agents write and benchmark kernels
- Kernels speed up AI model training
- Session data post-trains smaller kernel models
- repeat

- Coding agent writes fine-tuning code
- Agent post-trains a base LLM
- Trained model scored on target benchmark
- One turn of model training another
- repeat

- Learned optimizers update other learned optimizers
- Training keeps best performing optimizer parameters
- Better optimizers train each other faster
- repeat

- LLM reads reasoning model thoughts
- LLM flags reward hacking behavior
- Signal feeds back into training reward
- Trains more aligned capable agents
- repeat
Support for loop research
How to apply →Grants
Funding for projects that put AI in the loop of making AI better. Rolling, low paperwork, sized to the work.
About grants →Fellowships
Funded time, compute and mentorship for researchers who want to go deep on one loop.
About fellowships →Compute
GPU time and credits for loop experiments, which almost always have to run more than once.
About compute →Have a loop worth building?
Tell us what the AI improves and how the improvement comes back. Applications for grants, fellowships and compute all start on the contact page.