Alphabell.

AI makes AI better.

A daily hub for work where AI is part of the loop that improves AI, each entry with its loop spelled out. Read more →

1/4
A loop in motion
AlphaEvolve
Project · Google DeepMind
Gemini models propose code changes
From the labalphaBell Qwen Open27B post-training research, with capability tradeoffs measured.Explore the model → From the labModel ObservatoryMeasured Flint and Qwen traces with published decoder maps.Open the lab tool → From the labMiniMax Video BudgetVisualize sampled frames, two-frame groups and vision placeholders.Try the inspector → From the labMOSS Blind Layout CheckCompare exact text and placement in two local images.Try the blind check → From the labAgent Request Evidence LadderSee what a trace proves about an agent's request and its outcome.Explore the cases →

Today's radar

14 Nov 2026Full radar →

6 picked from 22 candidates · 30 sources read · 77 loops indexed

  1. 01
    Loop of the dayPaperarXiv12 Nov 2026Hardware and chips

    Toward Autonomous RTL and Synthesis Optimization: Benchmarking and Self-Improving Agents

    The loop: A multi-agent framework automates RTL rewriting and critical-path analysis for hardware design. By continuously refining a library of reusable optimization skills, the agent improves its own ability to optimize future chips.

    Hardware design is a critical bottleneck for AI scaling, making autonomous RTL optimization a highly leveraged path to better AI accelerators.

    loop fit 8/10Doyoung Kim, Byeongguk Jeon et al.via Hugging Face Papers
    Toward Autonomous RTL and Synthesis Optimization: Benchmarking and Self-Improving Agents
  2. 02
    PaperarXiv11 Nov 2026Tools and harness

    Experience-Handoff Reinforcement Learning for Recursive Self-Improvement

    The loop: An LLM agent generates and curates task-local playbooks from its own environment experiences. These playbooks are then handed off to the agent's future rollouts, improving their performance on agentic tasks.

    loop fit 9/10Binghang Lu, Lang Cao et al.via arXiv
    Experience-Handoff Reinforcement Learning for Recursive Self-Improvement
  3. 03
    Forum postLessWrong12 Nov 2026Research automation

    Updates from METR report: short timelines vs IE

    The loop: AI systems automate AI research and development tasks, which increases the total R&D effort and leads to more capable AI systems for further automation.

    loop fit 6/10Tom Davidsonvia LessWrong
    Updates from METR report: short timelines vs IE
  4. 04
    PaperarXiv9 Nov 2026AI R&D evals

    BioXArena-Pro: A Research-Grade Benchmark for Autonomous Biomedical Machine Learning Agents

    The loop: Autonomous ML agents attempt to build biomedical machine learning models from scratch. The benchmark measures their success at this ML engineering work, providing a rigorous evaluation target to drive the development of better ML agents.

    loop fit 9/10Weimin Wu, Han Liuvia arXiv
    BioXArena-Pro: A Research-Grade Benchmark for Autonomous Biomedical Machine Learning Agents
  5. 05
    PaperarXiv11 Nov 2026Architecture and optimizer search

    NCP: Verifier-Guided Optimization of Weight-Space Control Policies

    The loop: The Neural Control Plane observes a language model's execution telemetry to synthesize candidate weight-space intervention rules. It evaluates these candidates and admits beneficial policies to its active rule set, directly improving the model's subsequent inference performance.

    loop fit 8/10Alexander Yue, Qibin Liu et al.via arXiv
    NCP: Verifier-Guided Optimization of Weight-Space Control Policies
  6. 06
    PaperarXiv11 Nov 2026Research automation

    Updates From METR Report: Short Timelines vs IE

    The loop: AI systems increasingly automate AI research and development tasks. This automation expands the total R&D effort, which accelerates the creation of more capable successor systems.

    loop fit 6/10Daniela Gottesman, Gal Yona et al.via arXiv
    Updates From METR Report: Short Timelines vs IE
  7. 07
    PaperarXiv12 Nov 2026AI R&D evals

    Singularity-Bench: Can Agents Build Agents?

    The loop: Frontier AI agents are tasked with implementing core AI development systems from scratch, including pre-training, post-training, and agent harnesses. By successfully building and optimizing these pipelines, the agents directly construct the infrastructure required to train and run their own successors.

    loop fit 10/10Yang Zhou, Krish Agarwal et al.via arXiv
    Singularity-Bench: Can Agents Build Agents?
  8. 08
    PaperarXiv8 Nov 2026Tools and harness

    JoMoHa: Joint Model-Harness Optimization with Reinforcement Learning

    The loop: JoMoHa uses reinforcement learning on its own execution trajectories to jointly update its task execution policy and its harness generation policy. The improved harness generation policy creates better runtime environments for the execution policy, leading to higher success rates on subsequent tasks.

    loop fit 9/10Xudong Wu, Guangchen Lan et al.via arXiv
    JoMoHa: Joint Model-Harness Optimization with Reinforcement Learning
AlphaEvolve
ProjectGoogle DeepMind
AlphaEvolve
  1. Gemini models propose code changes
  2. Evaluators keep best scoring versions
  3. Finds better Gemini training kernels
  4. Lowers cost to train next Gemini models
  5. repeat
Kernels and compilersGoogle DeepMind · 2025
Darwin Gödel Machine
PaperarXiv
Darwin Gödel Machine
  1. Coding agent edits its own code
  2. Scored child agents enter the archive
  3. Archived agents make later self modifications
  4. repeat
Self-modifying agentsUBC, Vector Institute, Sakana AI · 2025
AlphaChip
ProjectGoogle DeepMind
AlphaChip
  1. RL agent lays out TPU blocks
  2. Better layouts make AI hardware cheaper
  3. Agent pre-trains on earlier chip generations
  4. repeat
Hardware and chipsGoogle DeepMind, Google Research · 2020
autoresearch
Mini-projectGitHub
autoresearch
  1. Coding agent edits LLM training script
  2. Runs a 5-minute training job
  3. Keeps change if validation improves
  4. Changes transferred to larger models
  5. repeat
Research automationAndrej Karpathy · 2026
ScholarEvolve
PaperarXiv
ScholarEvolve
  1. Research agent writes harness mutation blueprints
  2. Coding agent implements harness module changes
  3. Winning harness becomes the new champion
  4. New champion harness runs further generations
  5. repeat
Tools and harnessYang et al. (UC Santa Barbara, Microsoft) · 2026
Nemotron-4 340B
PaperarXiv
Nemotron-4 340B
  1. Aligned model generates training data
  2. Reward model judges and filters it
  3. Data trains next intermediate instruct model
  4. Next model generates better alignment data
  5. repeat
Training dataNVIDIA · 2024
Self-Rewarding LMs
PaperarXiv
Self-Rewarding LMs
  1. Model generates candidate responses to prompts
  2. Model scores them itself as a judge
  3. Scores become preference pairs for DPO
  4. Trained model becomes next generator and judge
  5. repeat
Self-reward and self-playMeta, NYU (Yuan et al.) · 2024
Claude Code
ProjectAnthropic
Claude Code
  1. Claude Code writes its own code changes
  2. Changes become next Claude Code versions
  3. Release becomes harness for next development round
  4. repeat
Self-modifying agentsAnthropic · 2025
KernelEvolve
ProjectarXiv
KernelEvolve
  1. LLM agents write and benchmark kernels
  2. Kernels speed up AI model training
  3. Session data post-trains smaller kernel models
  4. repeat
Kernels and compilersMeta · 2025
PostTrainBench
BenchmarkarXiv
PostTrainBench
  1. Coding agent writes fine-tuning code
  2. Agent post-trains a base LLM
  3. Trained model scored on target benchmark
  4. One turn of model training another
  5. repeat
AI R&D evalsELLIS Institute Tubingen, MPI-IS, University of Tubingen, Thoughtful Lab (Rank et al.) · 2026
Self-training learned optimizers
FoundationarXiv
Self-training learned optimizers
  1. Learned optimizers update other learned optimizers
  2. Training keeps best performing optimizer parameters
  3. Better optimizers train each other faster
  4. repeat
Architecture and optimizer searchMetz et al. (Google Research, Brain Team) · 2021
CoT monitoring
PaperarXiv
CoT monitoring
  1. LLM reads reasoning model thoughts
  2. LLM flags reward hacking behavior
  3. Signal feeds back into training reward
  4. Trains more aligned capable agents
  5. repeat
Interpretability and oversightOpenAI (Baker et al.) · 2025

Support for loop research

How to apply →

Have a loop worth building?

Tell us what the AI improves and how the improvement comes back. Applications for grants, fellowships and compute all start on the contact page.

Get in touch