← Search

Yizhi Song

6 accepted papers

2026

Caption Anything in Video: Fine-grained Object-centric Captioning via Spatiotemporal Multimodal Prompting

AAAI 2026technical

In this work, we introduce CAT-V (Caption Anything in Video), a training-free framework for fine-grained object-centric video captioning of user-selected instances. CAT-V combines (i) a SAMURAI-based Segmenter for precise object masks across frames, (ii) a TRACE-Uni Temporal Analyzer for event bound

Cited by 0SourcePDFScholar
2025

MMIG-Bench: Towards Comprehensive and Explainable Evaluation of Multi-Modal Image Generation Models

NeurIPS 2025poster

Recent multimodal image generators such as GPT-4o, Gemini 2.0 Flash, and Gemini 2.5 Pro excel at following complex instructions, editing images and maintaining concept consistency. However, they are still evaluated by disjoint toolkits: text-to-image (T2I) benchmarks that lacks multi-modal condition…

Cited by 0SourceScholar
2025

Refine-by-Align: Reference-Guided Artifacts Refinement through Semantic Alignment

ICLR 2025poster

Personalized image generation has emerged from the recent advancements in generative models. However, these generated personalized images often suffer from localized artifacts such as incorrect logos, reducing fidelity and fine-grained identity details of the generated results. Furthermore, there is…

Cited by 1SourcePDFScholar
2024

IMPRINT: Generative Object Compositing by Learning Identity-Preserving Representation

CVPR 2024poster

Generative object compositing emerges as a promising new avenue for compositional image editing. However the requirement of object identity preservation poses a significant challenge limiting practical usage of most existing methods. In response this paper introduces IMPRINT a novel diffusion-based…

Cited by 29SourcePDFScholar
2024

Thinking Outside the BBox: Unconstrained Generative Object Compositing

ECCV 2024poster

"Compositing an object into an image involves multiple non-trivial sub-tasks such as object placement and scaling, color/lighting harmonization, viewpoint/geometry adjustment, and shadow/reflection generation. Recent generative image compositing methods leverage diffusion models to handle multiple s…

Cited by 9SourcePDFScholar
2023

ObjectStitch: Object Compositing With Diffusion Model

CVPR 2023poster

Object compositing based on 2D images is a challenging problem since it typically involves multiple processing stages such as color harmonization, geometry correction and shadow generation to generate realistic results. Furthermore, annotating training data pairs for compositing requires substantial…

Cited by 94SourcePDFScholar