AI makes AI better.
A daily hub for work where AI is part of the loop that improves AI, each entry with its loop spelled out. Read more →
9 picked from 106 candidates · 31 sources read · 74 loops indexed
- 01Loop of the day5 Nov 2026Training data
EvoOptiGraph: Weakness-Driven Coevolution via Graph-Based Structural Generation for Optimization Modeling
The loop: The model identifies its own weaknesses to guide the generation of structurally diverse training instances. These new instances are then used in a reinforcement learning stage to update the model's own weights.
EvoOptiGraph demonstrates a closed co-evolutionary loop where a model actively targets its own weaknesses to generate the next generation of its training data.
loop fit 10/10Qingcan Kang, Mingyang Liu, Xiaojin Fu, Shixiong Kai, Tao Zhong, Mingxuan Yuanvia arXiv
- 022 Nov 2026Inference efficiency
SpecPilot: Autonomous Algorithm Discovery and Systems Optimization for Speculative Decoding
The loop: Parallel agents explore algorithm and system optimizations for speculative decoding deployments. Successful optimizations are integrated to accelerate the target model's own inference.

- 034 Nov 2026Kernels and compilers
Together Compiler: Continual Compilation for AI inference
The loop: AI agents continuously optimize inference kernels for open models based on changing traffic. The resulting compiled kernels are then deployed to run those same models with higher throughput.
loop fit 8/10via Together AI
- 044 Nov 2026Tools and harness
Reglos: A Self-Evolving Personal Memory Agent with Recursive Self-Improvement
The loop: A coding agent proposes patches to its own memory harness based on failure traces, while a critic screens them for benchmark gaming. Accepted patches permanently update the harness, improving the agent's performance on future conversations.

- 054 Nov 2026Tools and harness
Use NVIDIA NeMo to Turn Agent Failures into Tests and Harness Fixes
The loop: Agents analyze their own production failures to generate custom evaluations and propose harness fixes. These fixes are then applied to improve the agent's prompts, memory, and execution code.

- 065 Nov 2026Architecture and optimizer search
Evolutionary System Prompt Learning for Reinforcement Learning in LLMs
The loop: The language model samples trajectories under multiple system prompts, using them to update its weights via reinforcement learning and evolve its system prompts via self-reflection. Both the updated weights and the evolved prompts are then used by the model in the next iteration.

- 074 Nov 2026AI R&D evals
From AutoResearch to Continual AutoResearch: Do Agents Learn Across Tasks?
The loop: Research agents retain insights and persistent state across multiple machine learning tasks. This memory allows them to apply prior discoveries to new problems, improving their own research efficiency and solution quality over time.

- 08Training data
LegoEnv: Self-Evolving Agentic Environments via Modular Recombination
The loop: LegoEnv enables the self-evolution of agentic environments through modular recombination, creating new training data and benchmarks for agent development.
loop fit 8/10via Awesome-AI4AI
Loop index
All 74 entries →
- Gemini models propose code changes
- Evaluators keep best scoring versions
- Finds better Gemini training kernels
- Lowers cost to train next Gemini models
- repeat

- Coding agent edits its own code
- Scored child agents enter the archive
- Archived agents make later self modifications
- repeat

- RL agent lays out TPU blocks
- Better layouts make AI hardware cheaper
- Agent pre-trains on earlier chip generations
- repeat

- Coding agent edits LLM training script
- Runs a 5-minute training job
- Keeps change if validation improves
- Changes transferred to larger models
- repeat

- Research agent writes harness mutation blueprints
- Coding agent implements harness module changes
- Winning harness becomes the new champion
- New champion harness runs further generations
- repeat

- Aligned model generates training data
- Reward model judges and filters it
- Data trains next intermediate instruct model
- Next model generates better alignment data
- repeat

- Model generates candidate responses to prompts
- Model scores them itself as a judge
- Scores become preference pairs for DPO
- Trained model becomes next generator and judge
- repeat

- Claude Code writes its own code changes
- Changes become next Claude Code versions
- Release becomes harness for next development round
- repeat

- LLM agents write and benchmark kernels
- Kernels speed up AI model training
- Session data post-trains smaller kernel models
- repeat

- Coding agent writes fine-tuning code
- Agent post-trains a base LLM
- Trained model scored on target benchmark
- One turn of model training another
- repeat

- Learned optimizers update other learned optimizers
- Training keeps best performing optimizer parameters
- Better optimizers train each other faster
- repeat

- LLM reads reasoning model thoughts
- LLM flags reward hacking behavior
- Signal feeds back into training reward
- Trains more aligned capable agents
- repeat
Support for loop research
How to apply →Grants
Funding for projects that put AI in the loop of making AI better. Rolling, low paperwork, sized to the work.
About grants →Fellowships
Funded time, compute and mentorship for researchers who want to go deep on one loop.
About fellowships →Compute
GPU time and credits for loop experiments, which almost always have to run more than once.
About compute →Have a loop worth building?
Tell us what the AI improves and how the improvement comes back. Applications for grants, fellowships and compute all start on the contact page.