Alphabell.
Research and evals

Research automation

AI that proposes hypotheses, runs experiments and writes up machine learning research.

autoresearch
Mini-projectGitHub
autoresearch
  1. Coding agent edits LLM training script
  2. Runs a 5-minute training job
  3. Keeps change if validation improves
  4. Changes transferred to larger models
  5. repeat
Research automationAndrej Karpathy · 2026
Infinity Machine
PaperarXiv
Infinity Machine
  1. Agent solves open scientific problems
  2. Agent modifies its own harness
  3. Kernel verifies modifications via checks
  4. Agent uses new harness for research
  5. repeat
Research automationHarish Santhanalakshmi Ganesan · 2026
SplatLab
ProjectarXiv
SplatLab
  1. SplatLab reproduces 3DGS baselines
  2. proposes and codes extensions
  3. scores candidates via Elo tournament
  4. uses feedback to refine research outputs
  5. repeat
Research automationSeemandhar Jain et al. · 2026
FreeEvolve
PaperarXiv
FreeEvolve
  1. Agent evolver automates workflow design
  2. Scores candidate skills on target agents
  3. Improves its own evolution skill
  4. Produces better target agents
  5. repeat
Research automationLecheng Kong et al. · 2026
autoresearch-distillation
Mini-projectGitHub
autoresearch-distillation
  1. Qwen3-14B edits GPT training script
  2. Edit is trained and scored
  3. Score rewards Qwen3-14B weights update
  4. Trained checkpoint re-run in autoresearch loop
  5. repeat
Research automationExperiential Labs (Naihin, Fallah) · 2026
DeepScientist
PaperarXiv
DeepScientist
  1. LLM agents propose hypotheses on AI tasks
  2. Agents implement and test them
  3. Findings Memory steers later proposals
  4. Validated finding directly improves AI system
  5. repeat
Research automationWeng et al. (Westlake University) · 2025
The AI Scientist-v2
ProjectGitHub
The AI Scientist-v2
  1. LLM agents propose ML research ideas
  2. Agents run experiments with tree search
  3. Agents write up results and papers
  4. Output is new knowledge about models
  5. repeat
Research automationYamada et al. (Sakana AI) · 2025

Recently on the radar

More →
PaperarXiv·12 Nov 2026·Research automation

A step toward defining the Standard Model on a lattice

The loop: GPT-6 Astra assists researchers in generating a detailed proof for a nonperturbative lattice definition of the Standard Model. This successful application of AI to advanced theoretical physics generates high-quality reasoning trajectories that serve as training data for future models.

loop fit 6/10Subodh Lonkarvia Hugging Face Papers
A step toward defining the Standard Model on a lattice
PaperarXiv·11 Nov 2026·Research automation

Updates From METR Report: Short Timelines vs IE

The loop: AI systems increasingly automate AI research and development tasks. This automation expands the total R&D effort, which accelerates the creation of more capable successor systems.

loop fit 6/10Daniela Gottesman, Gal Yona, Ori Ram et al.via arXiv
Updates From METR Report: Short Timelines vs IE
Forum postLessWrong·12 Nov 2026·Research automation

Updates from METR report: short timelines vs IE

The loop: AI systems automate AI research and development tasks, which increases the total R&D effort and leads to more capable AI systems for further automation.

loop fit 6/10Tom Davidsonvia LessWrong
Updates from METR report: short timelines vs IE
PaperarXiv·9 Nov 2026·Research automation

HyPLM Technical Report

The loop: The Hyra 2.0 research agent autonomously trains HyPLM-Flash, a highly efficient 650-million-parameter protein language model. The resulting model provides a faster and more precise tool for protein annotation and design, which the agent can utilize in subsequent research cycles.

loop fit 8/10Haowei Lin, Cai Zhou, Xiangxin Zhouvia arXiv
HyPLM Technical Report
ProjectGitHub·5 Nov 2026·Research automation

zou-group/BVSR

The loop: The BVSR framework applies evolutionary principles to the generation and selection of creative research ideas, which improves the AI scientists, making them better at autonomous scientific discovery.

loop fit 7/10zou-groupvia GitHub
zou-group/BVSR

Other loop types