Elif Akata

Testing the Limits of Fine-Tuning for Improving Visual Cognition in Vision Language Models

Pre-trained vision language models still fall short of human visual cognition. In an effort to improve visual cognition and align models with human behavior, we introduce visual stimuli and human judgments on visual cognition tasks, allowing us to systematically evaluate performance across cognitive…