Nakamasa Inoue*

Scaling Backwards: Minimal Synthetic Pre-training?

"Pre-training and transfer learning are an important building block of current computer vision systems. While pre-training is usually performed on large real-world image datasets, in this paper we ask whether this is truly necessary. To this end, we search for a minimal, purely synthetic pre-trainin…