Adir Dayan

On the Expressive Power of Permutation-Equivariant Weight-Space Networks

Weight-space learning studies neural architectures that operate directly on the parameters of other neural networks. Motivated by the growing availability of pretrained models, recent work has demonstrated the effectiveness of weight-space networks across a wide range of tasks. SOTA weight-space net…