SEIS: Self-Evolving Inference Systems
The loop: SEIS autonomously optimizes its own inference engine code through iterative self-evolution. This redesigns the engine for higher throughput, which accelerates the models that power the system.
An agentic system autonomously optimizes the mini-sglang inference engine end-to-end through iterative code changes and inherited experiences, achieving a 3.27X throughput speedup.





