Alphabell.

AI makes AI better.

A daily hub for work where AI is part of the loop that improves AI, each entry with its loop spelled out. Read more →

1/4
A loop in motion
AlphaEvolve
Project · Google DeepMind
Gemini models propose code changes
From the labalphaBell Qwen Open27B post-training research, with capability tradeoffs measured.Explore the model → From the labModel ObservatoryMeasured Flint and Qwen traces with published decoder maps.Open the lab tool → From the labMiniMax Video BudgetVisualize sampled frames, two-frame groups and vision placeholders.Try the inspector → From the labMOSS Blind Layout CheckCompare exact text and placement in two local images.Try the blind check → From the labAgent Request Evidence LadderSee what a trace proves about an agent's request and its outcome.Explore the cases →

Today's radar

3 Nov 2026Full radar →

11 picked from 74 candidates · 29 sources read · 74 loops indexed

  1. 01
    Loop of the dayPaperarXiv1 Nov 2026Tools and harness

    Exo: An Architecture for Self-Improving Systems at Runtime

    The loop: The Exo agent autonomously edits its own harness code and strategies during task execution. These inspectable code changes are preserved and activated to reduce costs and improve performance on subsequent tasks.

    Exo collapses the optimization loop directly into task execution, allowing agents to rewrite their own harnesses on the fly.

    loop fit 9/10Chaoyun Zhang, Bingxuan Li et al.via arXiv
    Exo: An Architecture for Self-Improving Systems at Runtime
  2. 02
    PaperarXiv2 Nov 2026Tools and harness

    TinyAstral: Transferring Self-Evolving Harnesses to Tiny Generalist Manipulation Agents

    The loop: Frontier agents propose and statistically validate edits to a teacher model's harness. The improved harness is then used to collect successful trajectories to distill a compact student agent that operates in that same evolved harness.

    loop fit 9/10Yanbei Jiang, Chao Lei et al.via arXiv
    TinyAstral: Transferring Self-Evolving Harnesses to Tiny Generalist Manipulation Agents
  3. 03
    ReleaseGitHub2 Nov 2026Interpretability and oversight

    Training activation classifiers for safety and alignment

    The loop: Activation classifiers monitor a model's internal activity to detect policy violations. This improves the safety and alignment of the model, making it safer to deploy and use for further development.

    loop fit 7/10codelionvia GitHub releases
    Training activation classifiers for safety and alignment
  4. 04
    Blog postOpenAI2 Nov 2026Interpretability and oversight

    Training activation classifiers for safety and alignment

    The loop: Activation classifiers monitor a model's internal activity to detect policy violations, which improves the safety and alignment of the model, which makes the model safer to deploy and use for further development.

    loop fit 7/10Alex Makelov, Xiaojun Xu, Sundaram Ananthanarayanan, Ethan Mcdonald, Tom Dupre...via OpenAI Alignment
    Training activation classifiers for safety and alignment
  5. 05
    PaperarXiv30 Oct 2026Self-reward and self-play

    CARE: Grounded Recursive Self-Improvement for Production Customer-Service Agents

    The loop: The CARE agent identifies its own production failures and pairs them with independently verified repairs. It then uses on-policy self-distillation to update its own weights, improving its performance on future customer service traffic.

    loop fit 9/10Kehong Gong, Xiaoxu Zheng et al.via Hugging Face Papers
    CARE: Grounded Recursive Self-Improvement for Production Customer-Service Agents
  6. 06
    Blog postOpenAI2 Nov 2026Tools and harness

    Scaling Git at OpenAI

    The loop: Codex generates code at a scale that necessitates a new Git backend, which improves the development infrastructure for OpenAI models, which makes the development of Codex and its successors more efficient.

    loop fit 6/10via OpenAI
    Scaling Git at OpenAI
  7. 07
    PaperarXiv30 Oct 2026Self-modifying agents

    Evolving Memory, Learning to Meta-Control: Test-Time Adaptation for Experience-augmented LLM Agents

    The loop: The OMCE meta-controller uses task feedback to update its memory bank and refine its own routing policy via contextual bandit updates. This improves how the agent retrieves and utilizes experience in future tasks.

    loop fit 9/10Jun He, Canmiao Fu et al.via arXiv
    Evolving Memory, Learning to Meta-Control: Test-Time Adaptation for Experience-augmented LLM Agents
  8. 08
    PaperarXiv31 Oct 2026Research automation

    algorithmicsuperintelligence/openevolve: v0.4.1

    The loop: The OpenEvolve framework uses mixed evolution modes and competitive checkpoints to iteratively refine programs. It records the mode used on each program in an evolution trace to improve the evolution process.

    loop fit 8/10Yandan zheng, Haoran Luo et al.via arXiv
    algorithmicsuperintelligence/openevolve: v0.4.1
AlphaEvolve
ProjectGoogle DeepMind
AlphaEvolve
  1. Gemini models propose code changes
  2. Evaluators keep best scoring versions
  3. Finds better Gemini training kernels
  4. Lowers cost to train next Gemini models
  5. repeat
Kernels and compilersGoogle DeepMind · 2025
Darwin Gödel Machine
PaperarXiv
Darwin Gödel Machine
  1. Coding agent edits its own code
  2. Scored child agents enter the archive
  3. Archived agents make later self modifications
  4. repeat
Self-modifying agentsUBC, Vector Institute, Sakana AI · 2025
AlphaChip
ProjectGoogle DeepMind
AlphaChip
  1. RL agent lays out TPU blocks
  2. Better layouts make AI hardware cheaper
  3. Agent pre-trains on earlier chip generations
  4. repeat
Hardware and chipsGoogle DeepMind, Google Research · 2020
autoresearch
Mini-projectGitHub
autoresearch
  1. Coding agent edits LLM training script
  2. Runs a 5-minute training job
  3. Keeps change if validation improves
  4. Changes transferred to larger models
  5. repeat
Research automationAndrej Karpathy · 2026
ScholarEvolve
PaperarXiv
ScholarEvolve
  1. Research agent writes harness mutation blueprints
  2. Coding agent implements harness module changes
  3. Winning harness becomes the new champion
  4. New champion harness runs further generations
  5. repeat
Tools and harnessYang et al. (UC Santa Barbara, Microsoft) · 2026
Nemotron-4 340B
PaperarXiv
Nemotron-4 340B
  1. Aligned model generates training data
  2. Reward model judges and filters it
  3. Data trains next intermediate instruct model
  4. Next model generates better alignment data
  5. repeat
Training dataNVIDIA · 2024
Self-Rewarding LMs
PaperarXiv
Self-Rewarding LMs
  1. Model generates candidate responses to prompts
  2. Model scores them itself as a judge
  3. Scores become preference pairs for DPO
  4. Trained model becomes next generator and judge
  5. repeat
Self-reward and self-playMeta, NYU (Yuan et al.) · 2024
Claude Code
ProjectAnthropic
Claude Code
  1. Claude Code writes its own code changes
  2. Changes become next Claude Code versions
  3. Release becomes harness for next development round
  4. repeat
Self-modifying agentsAnthropic · 2025
KernelEvolve
ProjectarXiv
KernelEvolve
  1. LLM agents write and benchmark kernels
  2. Kernels speed up AI model training
  3. Session data post-trains smaller kernel models
  4. repeat
Kernels and compilersMeta · 2025
PostTrainBench
BenchmarkarXiv
PostTrainBench
  1. Coding agent writes fine-tuning code
  2. Agent post-trains a base LLM
  3. Trained model scored on target benchmark
  4. One turn of model training another
  5. repeat
AI R&D evalsELLIS Institute Tubingen, MPI-IS, University of Tubingen, Thoughtful Lab (Rank et al.) · 2026
Self-training learned optimizers
FoundationarXiv
Self-training learned optimizers
  1. Learned optimizers update other learned optimizers
  2. Training keeps best performing optimizer parameters
  3. Better optimizers train each other faster
  4. repeat
Architecture and optimizer searchMetz et al. (Google Research, Brain Team) · 2021
CoT monitoring
PaperarXiv
CoT monitoring
  1. LLM reads reasoning model thoughts
  2. LLM flags reward hacking behavior
  3. Signal feeds back into training reward
  4. Trains more aligned capable agents
  5. repeat
Interpretability and oversightOpenAI (Baker et al.) · 2025

Support for loop research

How to apply →

Have a loop worth building?

Tell us what the AI improves and how the improvement comes back. Applications for grants, fellowships and compute all start on the contact page.

Get in touch