← Search

Saayan Mitra

12 accepted papers

2026

Mosaic: Runtime-Efficient Multi-Agent Embodied Planning

ICML 2026poster

LLM-based multi-agent embodied planning remains impractical due to prohibitively high execution latency. We identify failed actions as the dominant bottleneck, stemming from two core challenges: inaccurate state tracking under partial observability and inefficient coordination that produces redundan…

Cited by 0SourceScholar
2025

SKALD: Learning-Based Shot Assembly for Coherent Multi-Shot Video Creation

ICCV 2025poster

We present SKALD, a multi-shot video assembly method that constructs coherent video sequences from candidate shots with minimal reliance on text. Central to our approach is the Learned Clip Assembly (LCA) score, a learning-based metric that measures temporal and semantic relationships between shots…

Cited by 0SourcePDFScholar
2025

Shape My Moves: Text-Driven Shape-Aware Synthesis of Human Motions

CVPR 2025poster

We explore how body shapes influence human motion synthesis, an aspect often overlooked in existing text-to-motion generation methods due to the ease of learning a homogenized, canonical body shape. However, this homogenization can distort the natural correlations between different body shapes and t…

Cited by 1SourcePDFScholar
2025

VISIAR: Empower MLLM for Visual Story Ideation

ACL 2025finding

Ideation, the process of forming ideas from concepts, is a big part of the content creation process. However, the noble goal of helping visual content creators by suggesting meaningful sequences of visual assets from a limited collection is challenging. It requires a nuanced understanding of visual…

2024

A/B testing under Interference with Partial Network Information

AISTATS 2024poster

A/B tests are often required to be conducted on subjects that might have social connections. For e.g., experiments on social media, or medical and social interventions to control the spread of an epidemic. In such settings, the SUTVA assumption for randomized-controlled trials is violated due to net…

Cited by 2SourcePDFScholar
2024

HanDiffuser: Text-to-Image Generation With Realistic Hand Appearances

CVPR 2024poster

Text-to-image generative models can generate high-quality humans but realism is lost when generating hands. Common artifacts include irregular hand poses shapes incorrect numbers of fingers and physically implausible finger orientations. To generate images with realistic hands we propose a novel dif…

Cited by 27SourcePDFScholar
2024

TAME-RD: Text Assisted Replication of Image Multi-Adjustments for Reverse Designing

ACL 2024findings

Given a source and its edited version performed based on human instructions in natural language, how do we extract the underlying edit operations, to automatically replicate similar edits on other images? This is the problem of reverse designing, and we present TAME-RD, a model to solve this problem…

Cited by 0SourcePDFScholar
2024

ToolChain*: Efficient Action Space Navigation in Large Language Models with A* Search

ICLR 2024poster

Large language models (LLMs) have demonstrated powerful decision-making and planning capabilities in solving complicated real-world problems. LLM-based autonomous agents can interact with diverse tools (e.g., functional APIs) and generate solution plans that execute a series of API function calls in…

Cited by 52SourcePDFScholar
2023

Direct Inference of Effect of Treatment (DIET) for a Cookieless World

AISTATS 2023poster

Brands use cookies and device identifiers to link different web visits to the same consumer. However, with increasing demands for privacy, these identifiers are about to be phased out, making identity fragmentation a permanent feature of the online world. Assessing treatment effects via randomized e…

Cited by 5SourcePDFScholar
2023

Flash: Concept Drift Adaptation in Federated Learning

ICML 2023poster

In Federated Learning (FL), adaptive optimization is an effective approach to addressing the statistical heterogeneity issue but cannot adapt quickly to concept drifts. In this work, we propose a novel adaptive optimizer called Flash that simultaneously addresses both statistical heterogeneity and t…

Cited by 14SourcePDFScholar
2022

DiPS: Differentiable Policy for Sketching in Recommender Systems

AAAI 2022technical

In sequential recommender system applications, it is important to develop models that can capture users' evolving interest over time to successfully recommend future items that they are likely to interact with. For users with long histories, typical models based on recurrent neural networks tend to…