← Search

Lovish Chum

3 accepted papers

2024

Beyond Grounding: Extracting Fine-Grained Event Hierarchies across Modalities

AAAI 2024technical

Events describe happenings in our world that are of importance. Naturally, understanding events mentioned in multimedia content and how they are related forms an important way of comprehending our world. Existing literature can infer if events across textual and visual (video) domains are identical…

2023

Multi-Scale Compositional Constraints for Representation Learning on Videos

ICASSP 2023accepted

Combining simple concepts to form structured thoughts and decomposing complex concepts into their constituents is one key characteristic of human cognition. In this work we extract video representations by combining multi-scale processing with compositional constraints, i.e., we constrain the latent…

Cited by 0SourceScholar
2021

Joint Multimedia Event Extraction from Video and Article

EMNLP 2021finding

Visual and textual modalities contribute complementary information about events described in multimedia documents. Videos contain rich dynamics and detailed unfoldings of events, while text describes more high-level and abstract concepts. However, existing event extraction methods either do not hand…

Cited by 32SourcePDFScholar