Ada-Astrid Balauca*

Taming CLIP for Fine-grained and Structured Visual Understanding of Museum Exhibits

"CLIP is a powerful and widely used tool for understanding images in the context of natural language descriptions to perform nuanced tasks. However, it does not offer application-specific fine-grained and structured understanding, due to its generic nature. In this work, we aim to adapt CLIP for fin…