Alphabell.

AI makes AI better.

A daily hub for work where AI is part of the loop that improves AI, each entry with its loop spelled out. Read more →

1/4
A loop in motion
AlphaEvolve
Project · Google DeepMind
Gemini models propose code changes
From the labalphaBell Qwen Open27B post-training research, with capability tradeoffs measured.Explore the model → From the labModel ObservatoryMeasured Flint and Qwen traces with published decoder maps.Open the lab tool → From the labMiniMax Video BudgetVisualize sampled frames, two-frame groups and vision placeholders.Try the inspector → From the labMOSS Blind Layout CheckCompare exact text and placement in two local images.Try the blind check → From the labAgent Request Evidence LadderSee what a trace proves about an agent's request and its outcome.Explore the cases →

Today's radar

2 Nov 2026Full radar →

5 picked from 73 candidates · 30 sources read · 74 loops indexed

  1. 01
    Loop of the dayPaperarXiv30 Oct 2026Tools and harness

    RoboArchitect: Automating the Design of Robotic Agents with Persistent Memory

    The loop: A coding model observes a robot's rollouts, diagnoses failures, and iteratively revises the control harness around a frozen policy. This evolved harness then wraps the policy to improve the agent's success rate on unseen scenes and tasks.

    RoboArchitect demonstrates that a coding model can iteratively rewrite the control harness around a frozen policy, offering a powerful alternative to finetuning for adapting agents to new environments.

    loop fit 9/10Shengguang Wu, Suning Huang et al.via arXiv
    RoboArchitect: Automating the Design of Robotic Agents with Persistent Memory
  2. 02
    PaperarXiv2 Nov 2026Architecture and optimizer search

    MoLRSI: A Recursive Self-Improving AI agent for Molecular Discovery

    The loop: The MoLRSI agent optimizes its own molecular discovery workflows and model architectures based on execution feedback. It stores the refinement outcomes in a persistent memory to improve its strategy for developing workflows in subsequent searches.

    loop fit 9/10Yikun Zhang, Xiwei Cheng, Mingze Yuan, Yu Zhang, Brian Shim, Aarti Krishnan,...via arXiv
    MoLRSI: A Recursive Self-Improving AI agent for Molecular Discovery
  3. 03
    ProjectGitHub31 Oct 2026Self-modifying agents

    dxn111/EVOLV

    The loop: The EVOLV workspace rewrites its own user interface, tools, skills, and plugins during execution. These modifications directly alter the environment it operates within, enabling immediate use of the new capabilities.

    loop fit 8/10dxn111via GitHub
    dxn111/EVOLV
  4. 04
    Forum postLessWrong1 Nov 2026Interpretability and oversight

    Monitor Evasion Depends on What RL Finds and What Monitors Miss

    The loop: The study identifies how RL learns to exploit monitor blind spots, which improves the training process by informing weight edits that prevent monitor evasion.

    loop fit 7/10Pranjal Gargvia LessWrong
    Monitor Evasion Depends on What RL Finds and What Monitors Miss
  5. 05
    PaperarXiv29 Oct 2026Interpretability and oversight

    Safin-1.5: Safety-Native Architecture and Verifiable Reasoning for Recursive Safety Improvement

    The loop: Safin-1.5 uses a discovery-evaluation-repair loop to identify new risks and generate repair data. This data is then used to update its own safety architecture and removable experts, improving its intrinsic safety.

    loop fit 8/10Jingnan Zheng, Cheng Jin et al.via arXiv
    Safin-1.5: Safety-Native Architecture and Verifiable Reasoning for Recursive Safety Improvement
  6. 06
    PaperarXiv29 Oct 2026Training data

    Search-Guided Reasoning Trace Curation for Verilog Generation

    The loop: A search framework explores intermediate hardware design plans to curate reasoning traces. These traces are then used as supervised fine-tuning data to improve the Verilog generation model that performs the search.

    loop fit 8/10Liaoyuan Fan, Yuhao Zheng et al.via Hugging Face Papers
    Search-Guided Reasoning Trace Curation for Verilog Generation
  7. 07
    PaperarXiv29 Oct 2026Self-reward and self-play

    Predict the Reward, Not the World: World Reward Models for ML Agents

    The loop: A world reward model learns from real execution results to directly choose the best candidate programs written by an ML agent. This model then replaces slow execution steps in the agent's search, making the agent faster and more accurate at finding optimal programs.

    loop fit 8/10Ruoyu Wu, Zengji Tu et al.via arXiv
    Predict the Reward, Not the World: World Reward Models for ML Agents
  8. 08
    PaperarXiv29 Oct 2026Tools and harness

    Video Generation Meets Agent Harness: Agentic Video Generation, Agentic World Modeling and Recursive Self-Improvement

    The loop: An agent harness coordinates video models and world models to generate interactive environments. These models then mutually evaluate and improve one another, enhancing the harness's ability to produce coherent agentic video generation.

    loop fit 8/10Chengyu Yang, Yunxiang Zheng et al.via arXiv
    Video Generation Meets Agent Harness: Agentic Video Generation, Agentic World Modeling and Recursive Self-Improvement
AlphaEvolve
ProjectGoogle DeepMind
AlphaEvolve
  1. Gemini models propose code changes
  2. Evaluators keep best scoring versions
  3. Finds better Gemini training kernels
  4. Lowers cost to train next Gemini models
  5. repeat
Kernels and compilersGoogle DeepMind · 2025
Darwin Gödel Machine
PaperarXiv
Darwin Gödel Machine
  1. Coding agent edits its own code
  2. Scored child agents enter the archive
  3. Archived agents make later self modifications
  4. repeat
Self-modifying agentsUBC, Vector Institute, Sakana AI · 2025
AlphaChip
ProjectGoogle DeepMind
AlphaChip
  1. RL agent lays out TPU blocks
  2. Better layouts make AI hardware cheaper
  3. Agent pre-trains on earlier chip generations
  4. repeat
Hardware and chipsGoogle DeepMind, Google Research · 2020
autoresearch
Mini-projectGitHub
autoresearch
  1. Coding agent edits LLM training script
  2. Runs a 5-minute training job
  3. Keeps change if validation improves
  4. Changes transferred to larger models
  5. repeat
Research automationAndrej Karpathy · 2026
ScholarEvolve
PaperarXiv
ScholarEvolve
  1. Research agent writes harness mutation blueprints
  2. Coding agent implements harness module changes
  3. Winning harness becomes the new champion
  4. New champion harness runs further generations
  5. repeat
Tools and harnessYang et al. (UC Santa Barbara, Microsoft) · 2026
Nemotron-4 340B
PaperarXiv
Nemotron-4 340B
  1. Aligned model generates training data
  2. Reward model judges and filters it
  3. Data trains next intermediate instruct model
  4. Next model generates better alignment data
  5. repeat
Training dataNVIDIA · 2024
Self-Rewarding LMs
PaperarXiv
Self-Rewarding LMs
  1. Model generates candidate responses to prompts
  2. Model scores them itself as a judge
  3. Scores become preference pairs for DPO
  4. Trained model becomes next generator and judge
  5. repeat
Self-reward and self-playMeta, NYU (Yuan et al.) · 2024
Claude Code
ProjectAnthropic
Claude Code
  1. Claude Code writes its own code changes
  2. Changes become next Claude Code versions
  3. Release becomes harness for next development round
  4. repeat
Self-modifying agentsAnthropic · 2025
KernelEvolve
ProjectarXiv
KernelEvolve
  1. LLM agents write and benchmark kernels
  2. Kernels speed up AI model training
  3. Session data post-trains smaller kernel models
  4. repeat
Kernels and compilersMeta · 2025
PostTrainBench
BenchmarkarXiv
PostTrainBench
  1. Coding agent writes fine-tuning code
  2. Agent post-trains a base LLM
  3. Trained model scored on target benchmark
  4. One turn of model training another
  5. repeat
AI R&D evalsELLIS Institute Tubingen, MPI-IS, University of Tubingen, Thoughtful Lab (Rank et al.) · 2026
Self-training learned optimizers
FoundationarXiv
Self-training learned optimizers
  1. Learned optimizers update other learned optimizers
  2. Training keeps best performing optimizer parameters
  3. Better optimizers train each other faster
  4. repeat
Architecture and optimizer searchMetz et al. (Google Research, Brain Team) · 2021
CoT monitoring
PaperarXiv
CoT monitoring
  1. LLM reads reasoning model thoughts
  2. LLM flags reward hacking behavior
  3. Signal feeds back into training reward
  4. Trains more aligned capable agents
  5. repeat
Interpretability and oversightOpenAI (Baker et al.) · 2025

Support for loop research

How to apply →

Have a loop worth building?

Tell us what the AI improves and how the improvement comes back. Applications for grants, fellowships and compute all start on the contact page.

Get in touch