Language Models Can Rewrite Their Own Weights
The loop: A 27B language model diagnoses its own failures and directly edits its own weights without gradients or training. These edited weights are then used by the model to achieve higher accuracy on subsequent unseen problems.
A frontier model demonstrates the ability to reason about its own failures and directly rewrite its own weights to improve its accuracy on held-out tests.





