Position: Comprehensive AI governance requires addressing non-model capability gains
Arthur Goemans, Daniel Altman, Noemi Dreksler, Jonas Freund, Milan Gandhi, Zhengdong Wang, Sarah Cogan, Sebastien Krier
Abstract
Frontier AI governance often centres on the model-level governance paradigm, which assumes that a model’s capability profile is primarily a function of the compute and data used during training. This position paper argues that model-level governance becomes less effective when capability progress is increasingly driven by "non-model gains"—improvements that are independent from advances in the base model. We formalise the concept of non-model gains and provide a taxonomy of three distinct vectors of capability gain: inference gain (scaling compute at test-time), systems gain (post-training enhancements such as scaffolds), and asset gain (enhancing a model with restricted assets). We demonstrate how these vectors—alongside potential future impacts from embodiment, continual learning, and diffusion—may undermine risk management strategies that hinge mostly on pre-deployment evaluation and mitigation. We provide an overview of governance approaches that go beyond the model level: system, entity, agent, and cloud governance. Finally, we emphasise the importance of societal resilience as a complement to these governance layers.
BibTeX
@inproceedings{icml2026_positioncomprehe,
title = {Position: Comprehensive AI governance requires addressing non-model capability gains},
author = {Arthur Goemans and Daniel Altman and Noemi Dreksler and Jonas Freund and Milan Gandhi and Zhengdong Wang and Sarah Cogan and Sebastien Krier and Demetra Brady and Lewis Ho and Allan Dafoe},
booktitle = {ICML 2026},
year = {2026}
}