← Search

Jaden Fried Fiotto-Kaufman

2 accepted papers

2025

MIB: A Mechanistic Interpretability Benchmark

ICML 2025poster

How can we know whether new mechanistic interpretability methods achieve real improvements? In pursuit of lasting evaluation standards, we propose MIB, a Mechanistic Interpretability Benchmark, with two tracks spanning four tasks and five models. MIB favors methods that precisely and concisely recov…

2025

NNsight and NDIF: Democratizing Access to Open-Weight Foundation Model Internals

ICLR 2025poster

We introduce NNsight and NDIF, technologies that work in tandem to enable scientific study of the representations and computations learned by very large neural networks. NNsight is an open-source system that extends PyTorch to introduce deferred remote execution. The National Deep Inference Fabric (…