ScholarEvolve
Learning from Research: Toward Lifelong Agent Harness Evolution (ScholarEvolve)A framework in which an LLM research agent retrieves and reads AI papers and turns their mechanisms into changes to an agent's harness (tools, context management, skills, memory, workflows), which a coding agent then implements and tests.
A research agent audits the task agent's failures, turns them into capability gaps, retrieves papers on those gaps and writes mutation blueprints, and a coding agent implements each one as a harness module change while the model weights stay fixed. Candidates and their combinations are validated against the current champion harness, the winner becomes the new champion, and new publications can start further generations.
- Research agent writes harness mutation blueprints
- Coding agent implements harness module changes
- Winning harness becomes the new champion
- New champion harness runs further generations
- Research agent writes harness mutation blueprints
- Coding agent implements harness module changes
- Winning harness becomes the new champion
- New champion harness runs further generations
Why it is a road to recursion
AI agents read the latest AI research to rebuild an AI agent's harness, so newly published methods reach the agent without a human engineer translating them, and the process repeats as the literature grows.
Evidence
The evolved harness raised Qwen3.5-27B task goal completion on AppWorld Challenge from 49.6% to 63.6% and GPT-5.4-mini pass@1 on Tau2-Bench Telecom from 72.7% to 81.9%.
Related loops
More tools and harness →- LLM optimizers critique deep research reports
- Optimizers rewrite research agent prompts
- Optimized system runs the next queries
- repeat
- Reflection LLM writes revised module prompts
- Winning prompt candidates are kept
- Optimized prompts return to same system
- New system traces feed next reflection round
- repeat
- Meta agent programs new agent designs
- Designs are evaluated on target tasks
- Results are added to an archive
- Meta agent uses archive for next design
- repeat