Peter R. Carroll

Efficient Automated Circuit Discovery in Transformers using Contextual Decomposition

Automated mechanistic interpretation research has attracted great interest due to its potential to scale explanations of neural network internals to large models. Existing automated circuit discovery work relies on activation patching or its approximations to identify subgraphs in models for specifi…