Alphabell.

AI makes AI better.

A daily hub for work where AI is part of the loop that improves AI, each entry with its loop spelled out. Read more →

1/4
A loop in motion
AlphaEvolve
Project · Google DeepMind
Gemini models propose code changes
From the labalphaBell Qwen Open27B post-training research, with capability tradeoffs measured.Explore the model → From the labModel ObservatoryMeasured Flint and Qwen traces with published decoder maps.Open the lab tool → From the labMiniMax Video BudgetVisualize sampled frames, two-frame groups and vision placeholders.Try the inspector → From the labMOSS Blind Layout CheckCompare exact text and placement in two local images.Try the blind check → From the labAgent Request Evidence LadderSee what a trace proves about an agent's request and its outcome.Explore the cases →

Today's radar

5 Nov 2026Full radar →

9 picked from 106 candidates · 31 sources read · 74 loops indexed

  1. 01
    Loop of the dayPaperarXiv5 Nov 2026Training data

    EvoOptiGraph: Weakness-Driven Coevolution via Graph-Based Structural Generation for Optimization Modeling

    The loop: The model identifies its own weaknesses to guide the generation of structurally diverse training instances. These new instances are then used in a reinforcement learning stage to update the model's own weights.

    EvoOptiGraph demonstrates a closed co-evolutionary loop where a model actively targets its own weaknesses to generate the next generation of its training data.

    loop fit 10/10Qingcan Kang, Mingyang Liu, Xiaojin Fu, Shixiong Kai, Tao Zhong, Mingxuan Yuanvia arXiv
    EvoOptiGraph: Weakness-Driven Coevolution via Graph-Based Structural Generation for Optimization Modeling
  2. 02
    PaperarXiv2 Nov 2026Inference efficiency

    SpecPilot: Autonomous Algorithm Discovery and Systems Optimization for Speculative Decoding

    The loop: Parallel agents explore algorithm and system optimizations for speculative decoding deployments. Successful optimizations are integrated to accelerate the target model's own inference.

    loop fit 9/10Kunjun Li, Wenhao Chai et al.via Hugging Face Papers
    SpecPilot: Autonomous Algorithm Discovery and Systems Optimization for Speculative Decoding
  3. 03
    Blog postTogether AI4 Nov 2026Kernels and compilers

    Together Compiler: Continual Compilation for AI inference

    The loop: AI agents continuously optimize inference kernels for open models based on changing traffic. The resulting compiled kernels are then deployed to run those same models with higher throughput.

    loop fit 8/10via Together AI
    Together Compiler: Continual Compilation for AI inference
  4. 04
    PaperarXiv4 Nov 2026Tools and harness

    Reglos: A Self-Evolving Personal Memory Agent with Recursive Self-Improvement

    The loop: A coding agent proposes patches to its own memory harness based on failure traces, while a critic screens them for benchmark gaming. Accepted patches permanently update the harness, improving the agent's performance on future conversations.

    loop fit 9/10Sen Yang, Jiaduo Lin et al.via arXiv
    Reglos: A Self-Evolving Personal Memory Agent with Recursive Self-Improvement
  5. 05
    Blog postNVIDIA4 Nov 2026Tools and harness

    Use NVIDIA NeMo to Turn Agent Failures into Tests and Harness Fixes

    The loop: Agents analyze their own production failures to generate custom evaluations and propose harness fixes. These fixes are then applied to improve the agent's prompts, memory, and execution code.

    loop fit 8/10Patrick Moorheadvia NVIDIA Technical Blog
    Use NVIDIA NeMo to Turn Agent Failures into Tests and Harness Fixes
  6. 06
    PaperarXiv5 Nov 2026Architecture and optimizer search

    Evolutionary System Prompt Learning for Reinforcement Learning in LLMs

    The loop: The language model samples trajectories under multiple system prompts, using them to update its weights via reinforcement learning and evolve its system prompts via self-reflection. Both the updated weights and the evolved prompts are then used by the model in the next iteration.

    loop fit 9/10Lunjun Zhang, Ryan Chen, Bradly C. Stadievia arXiv
    Evolutionary System Prompt Learning for Reinforcement Learning in LLMs
  7. 07
    PaperarXiv4 Nov 2026AI R&D evals

    From AutoResearch to Continual AutoResearch: Do Agents Learn Across Tasks?

    The loop: Research agents retain insights and persistent state across multiple machine learning tasks. This memory allows them to apply prior discoveries to new problems, improving their own research efficiency and solution quality over time.

    loop fit 9/10Jeremy Qin, Ruizhi Deng, Mohamed Osama Ahmed, Frederick Tung, Leo Fengvia arXiv
    From AutoResearch to Continual AutoResearch: Do Agents Learn Across Tasks?
  8. 08
    PaperarXivTraining data

    LegoEnv: Self-Evolving Agentic Environments via Modular Recombination

    The loop: LegoEnv enables the self-evolution of agentic environments through modular recombination, creating new training data and benchmarks for agent development.

    loop fit 8/10via Awesome-AI4AI
    LegoEnv: Self-Evolving Agentic Environments via Modular Recombination
AlphaEvolve
ProjectGoogle DeepMind
AlphaEvolve
  1. Gemini models propose code changes
  2. Evaluators keep best scoring versions
  3. Finds better Gemini training kernels
  4. Lowers cost to train next Gemini models
  5. repeat
Kernels and compilersGoogle DeepMind · 2025
Darwin Gödel Machine
PaperarXiv
Darwin Gödel Machine
  1. Coding agent edits its own code
  2. Scored child agents enter the archive
  3. Archived agents make later self modifications
  4. repeat
Self-modifying agentsUBC, Vector Institute, Sakana AI · 2025
AlphaChip
ProjectGoogle DeepMind
AlphaChip
  1. RL agent lays out TPU blocks
  2. Better layouts make AI hardware cheaper
  3. Agent pre-trains on earlier chip generations
  4. repeat
Hardware and chipsGoogle DeepMind, Google Research · 2020
autoresearch
Mini-projectGitHub
autoresearch
  1. Coding agent edits LLM training script
  2. Runs a 5-minute training job
  3. Keeps change if validation improves
  4. Changes transferred to larger models
  5. repeat
Research automationAndrej Karpathy · 2026
ScholarEvolve
PaperarXiv
ScholarEvolve
  1. Research agent writes harness mutation blueprints
  2. Coding agent implements harness module changes
  3. Winning harness becomes the new champion
  4. New champion harness runs further generations
  5. repeat
Tools and harnessYang et al. (UC Santa Barbara, Microsoft) · 2026
Nemotron-4 340B
PaperarXiv
Nemotron-4 340B
  1. Aligned model generates training data
  2. Reward model judges and filters it
  3. Data trains next intermediate instruct model
  4. Next model generates better alignment data
  5. repeat
Training dataNVIDIA · 2024
Self-Rewarding LMs
PaperarXiv
Self-Rewarding LMs
  1. Model generates candidate responses to prompts
  2. Model scores them itself as a judge
  3. Scores become preference pairs for DPO
  4. Trained model becomes next generator and judge
  5. repeat
Self-reward and self-playMeta, NYU (Yuan et al.) · 2024
Claude Code
ProjectAnthropic
Claude Code
  1. Claude Code writes its own code changes
  2. Changes become next Claude Code versions
  3. Release becomes harness for next development round
  4. repeat
Self-modifying agentsAnthropic · 2025
KernelEvolve
ProjectarXiv
KernelEvolve
  1. LLM agents write and benchmark kernels
  2. Kernels speed up AI model training
  3. Session data post-trains smaller kernel models
  4. repeat
Kernels and compilersMeta · 2025
PostTrainBench
BenchmarkarXiv
PostTrainBench
  1. Coding agent writes fine-tuning code
  2. Agent post-trains a base LLM
  3. Trained model scored on target benchmark
  4. One turn of model training another
  5. repeat
AI R&D evalsELLIS Institute Tubingen, MPI-IS, University of Tubingen, Thoughtful Lab (Rank et al.) · 2026
Self-training learned optimizers
FoundationarXiv
Self-training learned optimizers
  1. Learned optimizers update other learned optimizers
  2. Training keeps best performing optimizer parameters
  3. Better optimizers train each other faster
  4. repeat
Architecture and optimizer searchMetz et al. (Google Research, Brain Team) · 2021
CoT monitoring
PaperarXiv
CoT monitoring
  1. LLM reads reasoning model thoughts
  2. LLM flags reward hacking behavior
  3. Signal feeds back into training reward
  4. Trains more aligned capable agents
  5. repeat
Interpretability and oversightOpenAI (Baker et al.) · 2025

Support for loop research

How to apply →

Have a loop worth building?

Tell us what the AI improves and how the improvement comes back. Applications for grants, fellowships and compute all start on the contact page.

Get in touch