← Search

Rahul Lokesh

2 accepted papers

2024

Beyond Grounding: Extracting Fine-Grained Event Hierarchies across Modalities

AAAI 2024technical

Events describe happenings in our world that are of importance. Naturally, understanding events mentioned in multimedia content and how they are related forms an important way of comprehending our world. Existing literature can infer if events across textual and visual (video) domains are identical…

2023

Learning from Children: Improving Image-Caption Pretraining via Curriculum

ACL 2023findings

Image-caption pretraining has been quite successfully used for downstream vision tasks like zero-shot image classification and object detection. However, image-caption pretraining is still a hard problem – it requires multiple concepts (nouns) from captions to be aligned to several objects in images…