On the Implicit Bias of Linear Equivariant Steerable Networks

Ziyu Chen; Wei Zhu

NeurIPS 2023poster5 citations

On the Implicit Bias of Linear Equivariant Steerable Networks

Abstract

We study the implicit bias of gradient flow on linear equivariant steerable networks in group-invariant binary classification. Our findings reveal that the parameterized predictor converges in direction to the unique group-invariant classifier with a maximum margin defined by the input group action. Under a unitary assumption on the input representation, we establish the equivalence between steerable networks and data augmentation. Furthermore, we demonstrate the improved margin and generalization bound of steerable networks over their non-invariant counterparts.

implicit biasequivariant steerable networksdata augmentationmargingeneralization bound

BibTeX

@inproceedings{
chen2023on,
title={On the Implicit Bias of Linear Equivariant Steerable Networks},
author={Ziyu Chen and Wei Zhu},
booktitle={Thirty-seventh Conference on Neural Information Processing Systems},
year={2023},
url={https://openreview.net/forum?id=DnVjDRLwVu}
}