Ziyu Song

Vision Transformers Beat WideResNets on Small Scale Datasets Adversarial Robustness

For an extensive period, Vision Transformers (ViTs) have been deemed unsuitable for attaining robust performance on small-scale datasets, with WideResNet models maintaining dominance in this domain. While WideResNet models have persistently set the state-of-the-art (SOTA) benchmarks for robust accur…