Luis Goncalves

Non-autoregressive Sequence-to-Sequence Vision-Language Models

Sequence-to-sequence vision-language models are showing promise but their applicability is limited by their inference latency due to their autoregressive way of generating predictions. We propose a parallel decoding sequence-to-sequence vision-language model trained with a Query-CTC loss that margin…