← Search

Sparsh Mittal

3 accepted papers

2026

Best of Both Worlds: Multimodal Reasoning and Generation via Unified Discrete Flow Matching

ICML 2026poster

We propose UniDFlow, a unified discrete flow-matching framework for multimodal understanding, generation, and editing. It decouples understanding and generation via task-specific low-rank adapters, avoiding objective interference and representation entanglement, while a novel reference-based multimo…

Cited by 0SourceScholar
2025

MotionAura: Generating High-Quality and Motion Consistent Videos using Discrete Diffusion

ICLR 2025spotlight

The spatio-temporal complexity of video data presents significant challenges in tasks such as compression, generation, and inpainting. We present four key contributions to address the challenges of spatiotemporal video processing. First, we introduce the 3D Mobile Inverted Vector-Quantization Variat…

2024

GRIZAL: Generative Prior-guided Zero-Shot Temporal Action Localization

EMNLP 2024main

Zero-shot temporal action localization (TAL) aims to temporally localize actions in videos without prior training examples. To address the challenges of TAL, we offer GRIZAL, a model that uses multimodal embeddings and dynamic motion cues to localize actions effectively. GRIZAL achieves sample diver…

Cited by 0SourcePDFScholar