Ananth Vinjimoor

Boosting Self-Supervised Learning via Knowledge Transfer

In self-supervised learning one trains a model to solve a so-called pretext task on a dataset without the need for human annotation. The main objective, however, is to transfer this model to a target domain and task. Currently, the most effective transfer strategy is fine-tuning, which restricts one…