AutoAssumption: Searching over Assumptions Discovers ML-Systems Algorithms
The loop: An LLM searches over explicit algorithm assumptions to discover and prove new ML system algorithms. The search produces state-of-the-art algorithms for KV-cache eviction and weight pruning, which improve the efficiency of the models performing the search.













