Alphabell.

AI makes AI better.

A daily hub for work where AI is part of the loop that improves AI, each entry with its loop spelled out. Read more →

1/4
A loop in motion
AlphaEvolve
Project · Google DeepMind
Gemini models propose code changes
From the labalphaBell Qwen Open27B post-training research, with capability tradeoffs measured.Explore the model → From the labModel ObservatoryMeasured Flint and Qwen traces with published decoder maps.Open the lab tool → From the labMiniMax Video BudgetVisualize sampled frames, two-frame groups and vision placeholders.Try the inspector → From the labMOSS Blind Layout CheckCompare exact text and placement in two local images.Try the blind check → From the labAgent Request Evidence LadderSee what a trace proves about an agent's request and its outcome.Explore the cases →

Today's radar

4 Nov 2026Full radar →

8 picked from 145 candidates · 29 sources read · 74 loops indexed

  1. 01
    Loop of the dayPaperarXiv4 Nov 2026Inference efficiency

    Think Less, Locally: Local Preference Learning for Reasoning Compression

    The loop: A reasoning model detects candidate overthinking states in its own traces and regenerates shorter verified continuations. These self-generated preference pairs are then used to train the model via DPO to compress its reasoning.

    LoCo demonstrates a clean closed loop where a model learns to compress its own reasoning by generating and training on its own preference pairs.

    loop fit 10/10Muyao Yuan, Liyan Xu, Weizhan Zhang, Muyan Jiao, Jiangnan Li, Jinchao Zhang,...via arXiv
    Think Less, Locally: Local Preference Learning for Reasoning Compression
  2. 02
    ProjectGitHub25 Apr 2026Self-modifying agents

    Protocol-zero-0/evolution-kernel

    The loop: A coding agent proposes changes to its own git repository, which are then scored by a kernel. Winning changes are kept, creating an open-source evolution loop that improves the agent's own harness.

    loop fit 9/10Protocol-zero-0via GitHub
    Protocol-zero-0/evolution-kernel
  3. 03
    PaperarXiv3 Nov 2026Kernels and compilers

    ForgeKernel: Self-Evolving Kernels Catching and Surpassing Experts and Agents

    The loop: A kernel-generation system distills validated architectural decisions into reusable knowledge of hardware mechanisms. It then uses its own optimized kernels as references for subsequent optimization runs, enabling continuous architectural evolution.

    loop fit 9/10Yaojian Chen, Dazhi Peng et al.via arXiv
    ForgeKernel: Self-Evolving Kernels Catching and Surpassing Experts and Agents
  4. 04
    NewsAlignment Forum3 Nov 2026Interpretability and oversight

    Automating subtle emergent misalignment research

    The loop: A Claude model is instructed to write training data that induces misalignment while bypassing a production safety monitor. The successful attacks it discovers are then used to test and improve the robustness of future monitors.

    loop fit 9/10evhubvia Alignment Forum
    Automating subtle emergent misalignment research
  5. 05
    ModelHugging Face3 Nov 2026AI R&D evals

    StateBench: Testing how language models track state changes over long documents

    The loop: Language models are evaluated on their ability to track state changes over long documents. The resulting benchmark data identifies reasoning failures, which are used to improve the reasoning capabilities of future models.

    loop fit 8/10via Hugging Face
    StateBench: Testing how language models track state changes over long documents
  6. 06
    PaperarXiv4 Nov 2026AI R&D evals

    Training LLM Agents to Automate LLM Post-Training with RSI-Dojo

    The loop: LLM agents use the RSI-Dojo environment to learn post-training skills such as data selection, model training, and failure diagnosis. This internalizes the ability to conduct post-training, improving the agents' capacity to train their own successors.

    loop fit 9/10Shuzheng Gao, Zhaojian Yu, Penghao Yin, Yuling Shi, Kai Cai, Shilin He,...via arXiv
    Training LLM Agents to Automate LLM Post-Training with RSI-Dojo
  7. 07
    PaperarXiv31 Oct 2026Tools and harness

    Selecting LLM-Generated Hypotheses Raises Truth Beyond What an LLM Panel Expects: A Pre-registered Study on NAS-Bench-201 and HPOBench

    The loop: A harness optimizer searches for agentic steps that improve the truthfulness of LLM-generated hypotheses. It discovers a two-stage drafting and selection step that raises the excess truth of the generated claims.

    loop fit 9/10Shanglin Yang, Zhan Shivia arXiv
    Selecting LLM-Generated Hypotheses Raises Truth Beyond What an LLM Panel Expects: A Pre-registered Study on NAS-Bench-201 and HPOBench
  8. 08
    PaperarXivAI R&D evals

    The Verifier Is Part of the Simulator: Evidence-View Gaming in Agentic Equation Discovery

    The loop: An agentic equation discovery system uses a verifier integrated into its simulator to provide feedback on its outputs. This evidence-view gaming improves the accuracy of the mathematical models the agent discovers.

    loop fit 8/10via Awesome-AI4AI
    The Verifier Is Part of the Simulator: Evidence-View Gaming in Agentic Equation Discovery
AlphaEvolve
ProjectGoogle DeepMind
AlphaEvolve
  1. Gemini models propose code changes
  2. Evaluators keep best scoring versions
  3. Finds better Gemini training kernels
  4. Lowers cost to train next Gemini models
  5. repeat
Kernels and compilersGoogle DeepMind · 2025
Darwin Gödel Machine
PaperarXiv
Darwin Gödel Machine
  1. Coding agent edits its own code
  2. Scored child agents enter the archive
  3. Archived agents make later self modifications
  4. repeat
Self-modifying agentsUBC, Vector Institute, Sakana AI · 2025
AlphaChip
ProjectGoogle DeepMind
AlphaChip
  1. RL agent lays out TPU blocks
  2. Better layouts make AI hardware cheaper
  3. Agent pre-trains on earlier chip generations
  4. repeat
Hardware and chipsGoogle DeepMind, Google Research · 2020
autoresearch
Mini-projectGitHub
autoresearch
  1. Coding agent edits LLM training script
  2. Runs a 5-minute training job
  3. Keeps change if validation improves
  4. Changes transferred to larger models
  5. repeat
Research automationAndrej Karpathy · 2026
ScholarEvolve
PaperarXiv
ScholarEvolve
  1. Research agent writes harness mutation blueprints
  2. Coding agent implements harness module changes
  3. Winning harness becomes the new champion
  4. New champion harness runs further generations
  5. repeat
Tools and harnessYang et al. (UC Santa Barbara, Microsoft) · 2026
Nemotron-4 340B
PaperarXiv
Nemotron-4 340B
  1. Aligned model generates training data
  2. Reward model judges and filters it
  3. Data trains next intermediate instruct model
  4. Next model generates better alignment data
  5. repeat
Training dataNVIDIA · 2024
Self-Rewarding LMs
PaperarXiv
Self-Rewarding LMs
  1. Model generates candidate responses to prompts
  2. Model scores them itself as a judge
  3. Scores become preference pairs for DPO
  4. Trained model becomes next generator and judge
  5. repeat
Self-reward and self-playMeta, NYU (Yuan et al.) · 2024
Claude Code
ProjectAnthropic
Claude Code
  1. Claude Code writes its own code changes
  2. Changes become next Claude Code versions
  3. Release becomes harness for next development round
  4. repeat
Self-modifying agentsAnthropic · 2025
KernelEvolve
ProjectarXiv
KernelEvolve
  1. LLM agents write and benchmark kernels
  2. Kernels speed up AI model training
  3. Session data post-trains smaller kernel models
  4. repeat
Kernels and compilersMeta · 2025
PostTrainBench
BenchmarkarXiv
PostTrainBench
  1. Coding agent writes fine-tuning code
  2. Agent post-trains a base LLM
  3. Trained model scored on target benchmark
  4. One turn of model training another
  5. repeat
AI R&D evalsELLIS Institute Tubingen, MPI-IS, University of Tubingen, Thoughtful Lab (Rank et al.) · 2026
Self-training learned optimizers
FoundationarXiv
Self-training learned optimizers
  1. Learned optimizers update other learned optimizers
  2. Training keeps best performing optimizer parameters
  3. Better optimizers train each other faster
  4. repeat
Architecture and optimizer searchMetz et al. (Google Research, Brain Team) · 2021
CoT monitoring
PaperarXiv
CoT monitoring
  1. LLM reads reasoning model thoughts
  2. LLM flags reward hacking behavior
  3. Signal feeds back into training reward
  4. Trains more aligned capable agents
  5. repeat
Interpretability and oversightOpenAI (Baker et al.) · 2025

Support for loop research

How to apply →

Have a loop worth building?

Tell us what the AI improves and how the improvement comes back. Applications for grants, fellowships and compute all start on the contact page.

Get in touch