Fangyi Zhu

COOL, a Context Outlooker, and Its Application to Question Answering and Other Natural Language Processing Tasks

Vision outlooker improves the performance of vision transformers, which implements a self-attention mechanism by adding an outlook attention, a form of local attention. In natural language processing, as has been the case in computer vision and other domains, transformer-based models constitute…