Juston S. Moore

If you’ve trained one you’ve trained them all: inter-architecture similarity increases with robustness

Previous work has shown that commonly-used metrics for comparing representations between neural networks overestimate similarity due to correlations between data points. We show that intra-example feature correlations also causes significant overestimation of network similarity and propose an image…