Yoyo Minzhi Zhang

When are Lemons Purple? The Concept Association Bias of Vision-Language Models

Large-scale vision-language models such as CLIP have shown impressive performance on zero-shot image classification and image-to-text retrieval. However, such performance does not realize in tasks that require a finer-grained correspondence between vision and language, such as Visual Question Answer…