Singularity-Bench: Can Agents Build Agents?
The loop: Frontier AI agents are tasked with implementing core AI development systems from scratch, including pre-training, post-training, and agent harnesses. By successfully building and optimizing these pipelines, the agents directly construct the infrastructure required to train and run their own successors.
An open-ended benchmark that evaluates whether frontier models can autonomously build and optimize the core infrastructure of AI development, from pre-training pipelines to agent harnesses.






