MLIRBench: A Benchmark and Dataset for Compiler and Hardware-Aware Reasoning
The loop: A multi-agent pipeline generates and validates program mutations to create a benchmark for evaluating how well LLMs reason about intermediate representations. This dataset directly measures and guides the development of models used to build better compilers and hardware.
A multi-agent pipeline generates a benchmark of validated program mutations to evaluate how well language models reason about compiler intermediate representations.




