Maurice Georgi

On Transfer of Adversarial Robustness from Pretraining to Downstream Tasks

As large-scale training regimes have gained popularity, the use of pretrained models for downstream tasks has become common practice in machine learning. While pretraining has been shown to enhance the performance of models in practice, the transfer of robustness properties from pretraining to downs…