Xu Sun*

VITATECS: A Diagnostic Dataset for Temporal Concept Understanding of Video-Language Models

"The ability to perceive how objects change over time is a crucial ingredient in human intelligence. However, current benchmarks cannot faithfully reflect the temporal understanding abilities of video-language models (VidLMs) due to the existence of static visual shortcuts. To remedy this issue, we…