← Search

Yury Sulsky

2 accepted papers

2023

Perception Test: A Diagnostic Benchmark for Multimodal Video Models

NeurIPS 2023poster

We propose a novel multimodal video benchmark - the Perception Test - to evaluate the perception and reasoning skills of pre-trained multimodal models (e.g. Flamingo, BEiT-3, or GPT-4). Compared to existing benchmarks that focus on computational tasks (e.g. classification, detection or tracking), th…

2021

Imitation by Predicting Observations

ICML 2021spotlight

Imitation learning enables agents to reuse and adapt the hard-won expertise of others, offering a solution to several key challenges in learning behavior. Although it is easy to observe behavior in the real-world, the underlying actions may not be accessible. We present a new method for imitation so…