2023
Incorporating Probing Signals into Multimodal Machine Translation via Visual Question-Answering Pairs
EMNLP 2023long findings
This paper presents an in-depth study of multimodal machine translation (MMT), examining the prevailing understanding that MMT systems exhibit decreased sensitivity to visual information when text inputs are complete. Instead, we attribute this phenomenon to insufficient cross-modal interaction, rat…