Alphabell.

AI makes AI better.

A daily hub for work where AI is part of the loop that improves AI, each entry with its loop spelled out. Read more →

1/4
A loop in motion
AlphaEvolve
Project · Google DeepMind
Gemini models propose code changes
From the labalphaBell Qwen Open27B post-training research, with capability tradeoffs measured.Explore the model →

Today's radar

21 Oct 2026Full radar →

7 picked from 112 candidates · 31 sources read · 68 loops indexed

  1. 01
    Loop of the dayPaperarXiv21 Oct 2026Tools and harness

    Recoverability and Verifier Strength: Two Measured Preconditions for Unattended Agent Self-Improvement

    The loop: An agent platform reads deployed agents' execution traces, derives changes, and uses an automated verifier to approve them. By measuring verifier strength and recoverability, the platform safely applies prompt, tool, and skill edits to its agents without human intervention.

    This paper takes a crucial step toward fully autonomous self-improvement by defining measurable safety thresholds for when an agent platform can deploy self-derived edits without human oversight.

    loop fit 9/10De Wang, Peng Qivia arXiv
    Recoverability and Verifier Strength: Two Measured Preconditions for Unattended Agent Self-Improvement
  2. 02
    PaperarXiv20 Oct 2026Tools and harness

    Training the Whole Agent, Not Just the Model

    The loop: Teacher models evolve an agent's harness and tools during reinforcement learning based on its trajectories. The policy trains with this adapted harness, improving its coding performance and generating new trajectories that guide further adaptation.

    loop fit 10/10Lingxiao Tang, Wei Tao et al.via arXiv
    Training the Whole Agent, Not Just the Model
  3. 03
    ProjectGitHub19 Oct 2026Research automation

    TaewiKim/autoresearchlab

    The loop: Codex agents operate within a multi-agent harness to automate the end-to-end research cycle. This provides a platform for automating machine learning engineering and research, prospectively improving the agents' own capabilities.

    loop fit 6/10TaewiKimvia GitHub
    TaewiKim/autoresearchlab
  4. 04
    Forum postLessWrong18 Oct 2026Interpretability and oversight

    The Snitch Reflex: Can We Force Language Models to Be Compulsively Honest?

    The loop: A fine-tuned model compulsively outputs specific tokens when generating text related to certain training data subsets. This hidden reporting system reveals the model's internal state, improving the oversight and interpretability of the model itself.

    loop fit 6/10Sean Hackingvia LessWrong
    The Snitch Reflex: Can We Force Language Models to Be Compulsively Honest?
  5. 05
    Blog postSakana AI20 Oct 2026Research automation

    オープンエンドな探索を意思決定支援へ:推薦の質と多様性を高める「QD-Rec」を提案

    The loop: QD-Rec uses a generative AI to iteratively write and refine recommendation hypotheses based on past successful ones, improving the quality and diversity of its own suggestions.

    loop fit 7/10Sakana AIvia Sakana AI
    オープンエンドな探索を意思決定支援へ:推薦の質と多様性を高める「QD-Rec」を提案
  6. 06
    PaperarXiv19 Oct 2026Self-reward and self-play

    Teach the Magnitude, Not the Direction: Verifier-Anchored Credit Assignment for Multi-Turn Multi-Step LLM Agents

    The loop: A privileged self-teacher provides dense token-level magnitude signals anchored to verified rewards. These signals improve the credit assignment during the agent's training, leading to better performance on multi-turn tool-use tasks.

    loop fit 10/10Zechuan Wang, Siyuan Lu, Hongxuan Zhang, Linjian Mo, Chenyi Zhuang, Leilei Ganvia arXiv
    Teach the Magnitude, Not the Direction: Verifier-Anchored Credit Assignment for Multi-Turn Multi-Step LLM Agents
  7. 07
    PaperarXiv17 Oct 2026Research automation

    MELD: Recursive Self-Improvement via Hierarchical Coordination for Multi-Agent Scientific Discovery

    The loop: A coordinator policy and individual scientist policies jointly adapt through GRPO updates based on the outcomes of their scientific discovery tasks. This allows team organization and research behavior to co-evolve in a recursive self-improvement loop.

    loop fit 9/10Sizhe Tang, Zuyuan Zhang et al.via arXiv
    MELD: Recursive Self-Improvement via Hierarchical Coordination for Multi-Agent Scientific Discovery
  8. 08
    PaperarXiv19 Oct 2026AI R&D evals

    VibeTraining-Bench: Data-Trainer-Harness Co-Design for Iterative System Improvement

    The loop: Research agents are tasked with optimizing an initial agent system under a fixed budget. Guided by validation feedback, they iteratively refine the training data, trainers, and inference harnesses to produce a more capable final agent.

    loop fit 10/10Ruotian Peng, Yuanyi Ren et al.via arXiv
    VibeTraining-Bench: Data-Trainer-Harness Co-Design for Iterative System Improvement
AlphaEvolve
ProjectGoogle DeepMind
AlphaEvolve
  1. Gemini models propose code changes
  2. Evaluators keep best scoring versions
  3. Finds better Gemini training kernels
  4. Lowers cost to train next Gemini models
  5. repeat
Kernels and compilersGoogle DeepMind · 2025
Darwin Gödel Machine
PaperarXiv
Darwin Gödel Machine
  1. Coding agent edits its own code
  2. Scored child agents enter the archive
  3. Archived agents make later self modifications
  4. repeat
Self-modifying agentsUBC, Vector Institute, Sakana AI · 2025
AlphaChip
ProjectGoogle DeepMind
AlphaChip
  1. RL agent lays out TPU blocks
  2. Better layouts make AI hardware cheaper
  3. Agent pre-trains on earlier chip generations
  4. repeat
Hardware and chipsGoogle DeepMind, Google Research · 2020
autoresearch
Mini-projectGitHub
autoresearch
  1. Coding agent edits LLM training script
  2. Runs a 5-minute training job
  3. Keeps change if validation improves
  4. Changes transferred to larger models
  5. repeat
Research automationAndrej Karpathy · 2026
ScholarEvolve
PaperarXiv
ScholarEvolve
  1. Research agent writes harness mutation blueprints
  2. Coding agent implements harness module changes
  3. Winning harness becomes the new champion
  4. New champion harness runs further generations
  5. repeat
Tools and harnessYang et al. (UC Santa Barbara, Microsoft) · 2026
Nemotron-4 340B
PaperarXiv
Nemotron-4 340B
  1. Aligned model generates training data
  2. Reward model judges and filters it
  3. Data trains next intermediate instruct model
  4. Next model generates better alignment data
  5. repeat
Training dataNVIDIA · 2024
Self-Rewarding LMs
PaperarXiv
Self-Rewarding LMs
  1. Model generates candidate responses to prompts
  2. Model scores them itself as a judge
  3. Scores become preference pairs for DPO
  4. Trained model becomes next generator and judge
  5. repeat
Self-reward and self-playMeta, NYU (Yuan et al.) · 2024
Claude Code
ProjectAnthropic
Claude Code
  1. Claude Code writes its own code changes
  2. Changes become next Claude Code versions
  3. Release becomes harness for next development round
  4. repeat
Self-modifying agentsAnthropic · 2025
KernelEvolve
ProjectarXiv
KernelEvolve
  1. LLM agents write and benchmark kernels
  2. Kernels speed up AI model training
  3. Session data post-trains smaller kernel models
  4. repeat
Kernels and compilersMeta · 2025
PostTrainBench
BenchmarkarXiv
PostTrainBench
  1. Coding agent writes fine-tuning code
  2. Agent post-trains a base LLM
  3. Trained model scored on target benchmark
  4. One turn of model training another
  5. repeat
AI R&D evalsELLIS Institute Tubingen, MPI-IS, University of Tubingen, Thoughtful Lab (Rank et al.) · 2026
Self-training learned optimizers
FoundationarXiv
Self-training learned optimizers
  1. Learned optimizers update other learned optimizers
  2. Training keeps best performing optimizer parameters
  3. Better optimizers train each other faster
  4. repeat
Architecture and optimizer searchMetz et al. (Google Research, Brain Team) · 2021
CoT monitoring
PaperarXiv
CoT monitoring
  1. LLM reads reasoning model thoughts
  2. LLM flags reward hacking behavior
  3. Signal feeds back into training reward
  4. Trains more aligned capable agents
  5. repeat
Interpretability and oversightOpenAI (Baker et al.) · 2025

Support for loop research

How to apply →

Have a loop worth building?

Tell us what the AI improves and how the improvement comes back. Applications for grants, fellowships and compute all start on the contact page.

Get in touch