Mingyue Jiang

Perception Matters: Detecting Perception Failures of VQA Models Using Metamorphic Testing

Visual question answering (VQA) takes an image and a natural-language question as input and returns a natural-language answer. To date, VQA models are primarily assessed by their accuracy on high-level reasoning questions. Nevertheless, Given that perception tasks (e.g., recognizing objects) are the…