Alphabell.
Data and training signal

Training data

Models that generate, filter, label or curate the data their successors learn from.

Nemotron-4 340B
PaperarXiv
Nemotron-4 340B
  1. Aligned model generates training data
  2. Reward model judges and filters it
  3. Data trains next intermediate instruct model
  4. Next model generates better alignment data
  5. repeat
Training dataNVIDIA · 2024
AutoEnvScaling
PaperarXiv
AutoEnvScaling
  1. Proposer agent builds environments
  2. Solver generates rollouts
  3. Rollouts guide next environments
  4. Solver trains on new environments
  5. repeat
Training dataSimon Yu et al. · 2026
AdvSim2Real
PaperarXiv
AdvSim2Real
  1. Simulator co-evolves tasks and adversaries
  2. Generates challenging web agent scenarios
  3. Agent trains on resulting curriculum
  4. Agent handles harder tasks and attacks
  5. repeat
Training dataSarim Hashmi et al. · 2026
Recursive Self-Improvement in Unified Multimodal Models
PaperarXiv
Recursive Self-Improvement in Unified Multimodal Models
  1. UMM generates images and programs
  2. Execution verifies programs against specifications
  3. Verified renders and programs form training data
  4. Data trains UMM visual and text capabilities
  5. repeat
Training dataHuijuan Wang et al. · 2026
Tongyi DeepResearch
ProjectGitHub
Tongyi DeepResearch
  1. Agent synthesizes agentic pretraining data
  2. Pipeline adjusts training set in real time
  3. Data feeds back into model training
  4. repeat
Training dataTongyi Lab, Alibaba · 2025
SEAL
PaperarXiv
SEAL
  1. Language model generates a self-edit
  2. Edit is applied as weight update
  3. RL rewards self-edit by downstream performance
  4. repeat
Training dataMIT (Zweiger, Pari et al.) · 2025
SWE-smith
Datasetswesmith.com
SWE-smith
  1. o3-mini injects bugs and writes issues
  2. SWE-agent solves tasks for expert trajectories
  3. Trajectories fine-tune Qwen 2.5 Coder
  4. Open coding agent trained on agent data
  5. repeat
Training dataStanford, Princeton, Alibaba Qwen (Yang et al.) · 2025
FineWeb-Edu
DatasetHugging Face
FineWeb-Edu
  1. Llama-3-70B scores pages for educational value
  2. Regressor trained on labels filters corpus
  3. Filtered corpus pretrains new language models
  4. LLM judgment sets next training diet
  5. repeat
Training dataHugging Face · 2024
STaR
FoundationarXiv
STaR
  1. Language model writes step-by-step rationales
  2. Correct rationales are kept as dataset
  3. Model is fine-tuned on self-generated set
  4. Improved model generates next rationale dataset
  5. repeat
Training dataZelikman et al. (Stanford, Google Research) · 2022

Recently on the radar

More →
PaperarXiv·11 Nov 2026·Training data

Human or Synthetic? What a Fixed Budget Buys for Post-Training

The loop: Models generate synthetic preference data to train their successors through Direct Preference Optimization. The resulting models achieve higher win rates at lower costs than those trained on human-annotated data.

loop fit 8/10Ziyuan Li, Zihe Song, Xiaofang Qi et al.via arXiv
Human or Synthetic? What a Fixed Budget Buys for Post-Training
PaperarXiv·10 Nov 2026·Training data

KernelMosaic: An Open Dataset and Agentic Framework for CUDA Kernel Generation

The loop: An agentic framework implements, repairs, and optimizes CUDA kernels using execution feedback to build a dataset of verified solutions and trajectories. This dataset is then used to fine-tune a smaller open-source model, dramatically increasing its success rate at generating efficient kernels.

loop fit 8/10Ningyuan Xi, Yuhang Lai, Ning Miaovia arXiv
KernelMosaic: An Open Dataset and Agentic Framework for CUDA Kernel Generation
PaperarXiv·4 Nov 2026·Training data

Micius-Flash: Lightweight Agentic Intelligence for Engineering

The loop: Micius-Flash generates synthetic data and reasoning sequences for hardware coding and semiconductor design. These outputs are used in a multi-teacher on-policy distillation process to train a unified successor model.

loop fit 9/10Hongcheng Gao, Weiheng Li, Yipeng Wei et al.via Hugging Face Papers
Micius-Flash: Lightweight Agentic Intelligence for Engineering
PaperarXiv·7 Nov 2026·Training data

No Second Run: Does RSI Stop at Frontier Pre-training?

The loop: The system decomposes frontier pre-training into smaller loops that repair broken steps, which improves the data pipelines and infrastructure, making the resulting foundation model better.

loop fit 9/10Xiaojie Cai, Jiayi Chen, Junwei Chen et al.via arXiv
No Second Run: Does RSI Stop at Frontier Pre-training?
PaperarXiv·6 Nov 2026·Training data

Recursa: Toward Recursively Self-Improving Foundation Model Systems

The loop: The Recursa foundation model system uses parallel learners to execute tasks and synthesize local improvements. These improvements are validated and merged into the system's own knowledge repository, enabling the model to adapt to new domains through recursive self-improvement.

loop fit 9/10Yiqiao Jin, Yiyang Wang, Lucheng Fu, Yijia Xiao, Yinyi Luo, Haoxin Liu, B....via arXiv
Recursa: Toward Recursively Self-Improving Foundation Model Systems

Other loop types