Alphabell.

AI makes AI better.

A daily hub for work where AI is part of the loop that improves AI, each entry with its loop spelled out. Read more →

1/4
A loop in motion
AlphaEvolve
Project · Google DeepMind
Gemini models propose code changes
From the labalphaBell Qwen Open27B post-training research, with capability tradeoffs measured.Explore the model → From the labModel ObservatoryMeasured Flint and Qwen traces with published decoder maps.Open the lab tool → From the labMiniMax Video BudgetVisualize sampled frames, two-frame groups and vision placeholders.Try the inspector → From the labMOSS Blind Layout CheckCompare exact text and placement in two local images.Try the blind check → From the labAgent Request Evidence LadderSee what a trace proves about an agent's request and its outcome.Explore the cases →

Today's radar

30 Oct 2026Full radar →

6 picked from 64 candidates · 31 sources read · 73 loops indexed

  1. 01
    Loop of the dayPaperarXiv28 Oct 2026Kernels and compilers

    A Case Study of a Multi-Agent Kernel-Optimization Loop That Learns a New AI Accelerator

    The loop: An LLM agent loop builds a target knowledge base of DSL documentation and microbenchmarks to autonomously optimize decode kernels, which run the models that power the agent.

    An LLM agent loop autonomously learns a new AI accelerator's DSL to optimize the very decode kernels that will run its successors.

    loop fit 9/10Byonggon Chunvia arXiv
    A Case Study of a Multi-Agent Kernel-Optimization Loop That Learns a New AI Accelerator
  2. 02
    PaperarXiv28 Oct 2026Training data

    A-RSI: Adaptive Task Refresh for Zero-Data Multimodal Self-Improvement

    The loop: A-RSI monitors its own training logs to decide when to refresh a task pool with model-authored programs, enabling continuous multimodal self-improvement without external data.

    loop fit 10/10Yu Liu, Youxing Li et al.via arXiv
    A-RSI: Adaptive Task Refresh for Zero-Data Multimodal Self-Improvement
  3. 03
    Blog postSakana AI30 Oct 2026Research automation

    Intelligence Report: SNSのAI分析からみる米中間選挙

    The loop: Sakana Marlin uses multiple AI agents to parallelize hypothesis search and evaluate each other, improving the accuracy and depth of the research reports it generates.

    loop fit 7/10Sakana AIvia Sakana AI
    Intelligence Report: SNSのAI分析からみる米中間選挙
  4. 04
    PaperarXiv28 Oct 2026Tools and harness

    Masked Erosion: How Acceptance Gates Lose Redundant Safeguards in Self-Improving Agents

    The loop: An AI agent edits its own harness prompts and rules, using an automated gate to measure and retain improvements to its own operating environment.

    loop fit 9/10Hau-Sing So, Daixian Liu et al.via arXiv
    Masked Erosion: How Acceptance Gates Lose Redundant Safeguards in Self-Improving Agents
  5. 05
    Blog postTogether AI27 Oct 2026Hardware and chips

    Auto repair for Together GPU Clusters: from GPU fault to healthy node

    The loop: The auto repair system detects and fixes GPU and fabric faults, which maintains the availability of the hardware used to train and run the system's successors.

    loop fit 6/10via Together AI
    Auto repair for Together GPU Clusters: from GPU fault to healthy node
  6. 06
    PaperarXiv28 Oct 2026Self-reward and self-play

    SCOPE: Selective Critical-Step On-Policy Self-Distillation for Agentic Reinforcement Learning

    The loop: The SCOPE policy analyzes its own trajectories to generate step-specific hindsight skills, distilling their guidance back into itself at selected error steps.

    loop fit 9/10Qirui Liu, Wei Cao et al.via Hugging Face Papers
    SCOPE: Selective Critical-Step On-Policy Self-Distillation for Agentic Reinforcement Learning
  7. 07
    PaperarXiv28 Oct 2026Research automation

    Build, Don't Play: Self-Improving LLM Research Agents Develop a Hearthstone Battlegrounds AI That Rivals Top Players

    The loop: AutoTavern uses LLM research agents to build a game simulator and policy from live feedback, which improves their shared research memory and process, making the agents better at researching the game.

    loop fit 9/10Johnny Yu, Cyril Gorllavia arXiv
    Build, Don't Play: Self-Improving LLM Research Agents Develop a Hearthstone Battlegrounds AI That Rivals Top Players
  8. 08
    PaperarXiv24 Oct 2026Tools and harness

    When the Critic Falls Behind: Co-Evolving Rubrics and Harnesses for Continual Agent Self-Improvement

    The loop: RuHarness discovers behavioral criteria from execution trajectories to update its own harness, which improves the supervision used to guide the agent's future execution.

    loop fit 9/10Changlian Ma, Limin Wangvia arXiv
    When the Critic Falls Behind: Co-Evolving Rubrics and Harnesses for Continual Agent Self-Improvement
AlphaEvolve
ProjectGoogle DeepMind
AlphaEvolve
  1. Gemini models propose code changes
  2. Evaluators keep best scoring versions
  3. Finds better Gemini training kernels
  4. Lowers cost to train next Gemini models
  5. repeat
Kernels and compilersGoogle DeepMind · 2025
Darwin Gödel Machine
PaperarXiv
Darwin Gödel Machine
  1. Coding agent edits its own code
  2. Scored child agents enter the archive
  3. Archived agents make later self modifications
  4. repeat
Self-modifying agentsUBC, Vector Institute, Sakana AI · 2025
AlphaChip
ProjectGoogle DeepMind
AlphaChip
  1. RL agent lays out TPU blocks
  2. Better layouts make AI hardware cheaper
  3. Agent pre-trains on earlier chip generations
  4. repeat
Hardware and chipsGoogle DeepMind, Google Research · 2020
autoresearch
Mini-projectGitHub
autoresearch
  1. Coding agent edits LLM training script
  2. Runs a 5-minute training job
  3. Keeps change if validation improves
  4. Changes transferred to larger models
  5. repeat
Research automationAndrej Karpathy · 2026
ScholarEvolve
PaperarXiv
ScholarEvolve
  1. Research agent writes harness mutation blueprints
  2. Coding agent implements harness module changes
  3. Winning harness becomes the new champion
  4. New champion harness runs further generations
  5. repeat
Tools and harnessYang et al. (UC Santa Barbara, Microsoft) · 2026
Nemotron-4 340B
PaperarXiv
Nemotron-4 340B
  1. Aligned model generates training data
  2. Reward model judges and filters it
  3. Data trains next intermediate instruct model
  4. Next model generates better alignment data
  5. repeat
Training dataNVIDIA · 2024
Self-Rewarding LMs
PaperarXiv
Self-Rewarding LMs
  1. Model generates candidate responses to prompts
  2. Model scores them itself as a judge
  3. Scores become preference pairs for DPO
  4. Trained model becomes next generator and judge
  5. repeat
Self-reward and self-playMeta, NYU (Yuan et al.) · 2024
Claude Code
ProjectAnthropic
Claude Code
  1. Claude Code writes its own code changes
  2. Changes become next Claude Code versions
  3. Release becomes harness for next development round
  4. repeat
Self-modifying agentsAnthropic · 2025
KernelEvolve
ProjectarXiv
KernelEvolve
  1. LLM agents write and benchmark kernels
  2. Kernels speed up AI model training
  3. Session data post-trains smaller kernel models
  4. repeat
Kernels and compilersMeta · 2025
PostTrainBench
BenchmarkarXiv
PostTrainBench
  1. Coding agent writes fine-tuning code
  2. Agent post-trains a base LLM
  3. Trained model scored on target benchmark
  4. One turn of model training another
  5. repeat
AI R&D evalsELLIS Institute Tubingen, MPI-IS, University of Tubingen, Thoughtful Lab (Rank et al.) · 2026
Self-training learned optimizers
FoundationarXiv
Self-training learned optimizers
  1. Learned optimizers update other learned optimizers
  2. Training keeps best performing optimizer parameters
  3. Better optimizers train each other faster
  4. repeat
Architecture and optimizer searchMetz et al. (Google Research, Brain Team) · 2021
CoT monitoring
PaperarXiv
CoT monitoring
  1. LLM reads reasoning model thoughts
  2. LLM flags reward hacking behavior
  3. Signal feeds back into training reward
  4. Trains more aligned capable agents
  5. repeat
Interpretability and oversightOpenAI (Baker et al.) · 2025

Support for loop research

How to apply →

Have a loop worth building?

Tell us what the AI improves and how the improvement comes back. Applications for grants, fellowships and compute all start on the contact page.

Get in touch