Brian Gordon*

Mismatch Quest: Visual and Textual Feedback for Image-Text Misalignment

"While existing image-text alignment models reach high quality binary assessments, they fall short of pinpointing the exact source of misalignment. In this paper, we present a method to provide detailed textual and visual explanation of detected misalignments between text-image pairs. We leverage la…