Alphabell.

AI makes AI better.

A daily hub for work where AI is part of the loop that improves AI, each entry with its loop spelled out. Read more →

1/4
A loop in motion
AlphaEvolve
Project · Google DeepMind
Gemini models propose code changes
From the labalphaBell Qwen Open27B post-training research, with capability tradeoffs measured.Explore the model →

Today's radar

26 Oct 2026Full radar →

7 picked from 88 candidates · 31 sources read · 71 loops indexed

  1. 01
    Loop of the dayPaperarXiv23 Oct 2026Architecture and optimizer search

    RSI-Opt: Recursive Self-Improvement Optimizer Agents For Model Training

    The loop: A meta-agent rewrites the policy and code library of an optimizer agent based on evidence from earlier training runs. The improved optimizer agent then manages subsequent model training tasks more effectively.

    RSI-Opt demonstrates how a meta-agent can accumulate experience across training runs to evolve better optimizer code and policies, directly improving the training of subsequent models.

    loop fit 10/10Binghang Lu, Yige Sun et al.via arXiv
    RSI-Opt: Recursive Self-Improvement Optimizer Agents For Model Training
  2. 02
    PaperarXiv23 Oct 2026Research automation

    Minimum Description Length Unsupervisedly Separates Law-Grade from Statistical-Grade Knowledge in a Self-Improving Science Agent - and Reveals 86% of Its Own Discoveries Are Statistical

    The loop: A self-improving science agent uses a Minimum Description Length compression ratio to unsupervisedly vet its generated scientific relations. This filters the agent's discovery ledger to retain true laws, which guides its future research.

    loop fit 9/10Wenbin Mao, Pei Zouvia arXiv
    Minimum Description Length Unsupervisedly Separates Law-Grade from Statistical-Grade Knowledge in a Self-Improving Science Agent - and Reveals 86% of Its Own Discoveries Are Statistical
  3. 03
    Forum postLessWrong25 Oct 2026Interpretability and oversight

    Is GPT 2XL already clean?

    The loop: Opus 5.5 acts as an automated interpretability researcher to analyze and identify the function of neurons in GPT-2-XL. These insights into model internals provide a pathway for researchers to better align and develop future models.

    loop fit 7/10Jasper Blankvia LessWrong
    Is GPT 2XL already clean?
  4. 04
    PaperarXiv26 Oct 2026Inference efficiency

    NgramRL: Accelerating RL Post-Training for Structured Generation via Rollout-Aware N-gram Speculative Decoding

    The loop: A model undergoing reinforcement learning post-training uses its own recent rollout history to construct an n-gram drafter. This drafter accelerates the autoregressive generation bottleneck, speeding up the model's own post-training process.

    loop fit 9/10Nilesh Prasad Pandey, Jangseon Park, Jason Kong, Onat Gungor, Tajana Rosingvia arXiv
    NgramRL: Accelerating RL Post-Training for Structured Generation via Rollout-Aware N-gram Speculative Decoding
  5. 05
    PaperarXiv26 Oct 2026Self-modifying agents

    AlphaMemo: Structured Search-Process Memory for Self-Evolving Alpha Mining Agents

    The loop: A self-evolving alpha mining agent records reusable evidence of successful and failed edit motifs in a structured memory. The agent then uses this memory to suppress failure patterns and improve its own future discovery efficiency.

    loop fit 9/10Hang Yu, Zifan Zheng, Chun Gan, Jeff Z. Pan, Tongliang Liu, Zhiyong Wang,...via arXiv
    AlphaMemo: Structured Search-Process Memory for Self-Evolving Alpha Mining Agents
  6. 06
    PaperarXivTools and harness

    HarnessEvolve: Learning from Reference Trajectories for Reliable Agent Self-Evolution

    The loop: An agent learns from reference trajectories to evolve its own execution harness. The improved harness provides a more reliable environment, making the agent better at subsequent self-evolution tasks.

    loop fit 9/10via Awesome-AI4AI
    HarnessEvolve: Learning from Reference Trajectories for Reliable Agent Self-Evolution
  7. 07
    PaperarXivTools and harness

    HarnessCompass: Guiding Automatic Harness Evolution toward Generalizable and Effective Agent Harnesses

    The loop: An automated system evolves agent harnesses based on performance feedback. These improved harnesses are then deployed to provide better environments and evaluation frameworks for future agents.

    loop fit 9/10via Awesome-AI4AI
    HarnessCompass: Guiding Automatic Harness Evolution toward Generalizable and Effective Agent Harnesses
  8. 08
    PaperarXiv23 Oct 2026Self-modifying agents

    Agentic Knowledge-Model Co-Evolution via Consistency Regularization

    The loop: The SPLICE framework analyzes agent experience to produce knowledge candidates, which improves the internal model through self-distillation. This makes the agent better at analyzing future experiences and solving tasks.

    loop fit 9/10Sirui Chen, Zhining Liu, Chao Zhang, Jingrui He, Zheng Livia arXiv
    Agentic Knowledge-Model Co-Evolution via Consistency Regularization
AlphaEvolve
ProjectGoogle DeepMind
AlphaEvolve
  1. Gemini models propose code changes
  2. Evaluators keep best scoring versions
  3. Finds better Gemini training kernels
  4. Lowers cost to train next Gemini models
  5. repeat
Kernels and compilersGoogle DeepMind · 2025
Darwin Gödel Machine
PaperarXiv
Darwin Gödel Machine
  1. Coding agent edits its own code
  2. Scored child agents enter the archive
  3. Archived agents make later self modifications
  4. repeat
Self-modifying agentsUBC, Vector Institute, Sakana AI · 2025
AlphaChip
ProjectGoogle DeepMind
AlphaChip
  1. RL agent lays out TPU blocks
  2. Better layouts make AI hardware cheaper
  3. Agent pre-trains on earlier chip generations
  4. repeat
Hardware and chipsGoogle DeepMind, Google Research · 2020
autoresearch
Mini-projectGitHub
autoresearch
  1. Coding agent edits LLM training script
  2. Runs a 5-minute training job
  3. Keeps change if validation improves
  4. Changes transferred to larger models
  5. repeat
Research automationAndrej Karpathy · 2026
ScholarEvolve
PaperarXiv
ScholarEvolve
  1. Research agent writes harness mutation blueprints
  2. Coding agent implements harness module changes
  3. Winning harness becomes the new champion
  4. New champion harness runs further generations
  5. repeat
Tools and harnessYang et al. (UC Santa Barbara, Microsoft) · 2026
Nemotron-4 340B
PaperarXiv
Nemotron-4 340B
  1. Aligned model generates training data
  2. Reward model judges and filters it
  3. Data trains next intermediate instruct model
  4. Next model generates better alignment data
  5. repeat
Training dataNVIDIA · 2024
Self-Rewarding LMs
PaperarXiv
Self-Rewarding LMs
  1. Model generates candidate responses to prompts
  2. Model scores them itself as a judge
  3. Scores become preference pairs for DPO
  4. Trained model becomes next generator and judge
  5. repeat
Self-reward and self-playMeta, NYU (Yuan et al.) · 2024
Claude Code
ProjectAnthropic
Claude Code
  1. Claude Code writes its own code changes
  2. Changes become next Claude Code versions
  3. Release becomes harness for next development round
  4. repeat
Self-modifying agentsAnthropic · 2025
KernelEvolve
ProjectarXiv
KernelEvolve
  1. LLM agents write and benchmark kernels
  2. Kernels speed up AI model training
  3. Session data post-trains smaller kernel models
  4. repeat
Kernels and compilersMeta · 2025
PostTrainBench
BenchmarkarXiv
PostTrainBench
  1. Coding agent writes fine-tuning code
  2. Agent post-trains a base LLM
  3. Trained model scored on target benchmark
  4. One turn of model training another
  5. repeat
AI R&D evalsELLIS Institute Tubingen, MPI-IS, University of Tubingen, Thoughtful Lab (Rank et al.) · 2026
Self-training learned optimizers
FoundationarXiv
Self-training learned optimizers
  1. Learned optimizers update other learned optimizers
  2. Training keeps best performing optimizer parameters
  3. Better optimizers train each other faster
  4. repeat
Architecture and optimizer searchMetz et al. (Google Research, Brain Team) · 2021
CoT monitoring
PaperarXiv
CoT monitoring
  1. LLM reads reasoning model thoughts
  2. LLM flags reward hacking behavior
  3. Signal feeds back into training reward
  4. Trains more aligned capable agents
  5. repeat
Interpretability and oversightOpenAI (Baker et al.) · 2025

Support for loop research

How to apply →

Have a loop worth building?

Tell us what the AI improves and how the improvement comes back. Applications for grants, fellowships and compute all start on the contact page.

Get in touch