Shiv Ram Dubey

Patch Attention Excitation Based Vision Transformer for Small-Sized Datasets

Vision Transformers have proven their mettle across a variety of computer vision problems, however, their reliance on pretraining with very large-scale datasets such as JFT-300M is also no secret, as large amounts of data is very conductive to effective feature learning. In this paper, however, we p…