← Search

Shiyi Zhang

10 accepted papers

2026

Alleviating Sparse Rewards by Modeling Step-Wise and Long-Term Sampling Effects in Flow-Based GRPO

ICML 2026poster

Deploying GRPO on Flow Matching models has proven effective for text-to-image generation. However, existing paradigms typically propagate an outcome-based reward to all preceding denoising steps without distinguishing the local effect of each step. Moreover, current group-wise ranking mainly compare…

Cited by 0SourceScholar
2026

JarvisEvo: Towards a Self-Evolving Photo Editing Agent with Synergistic Editor-Evaluator Optimization

CVPR 2026

Agent-based editing models have substantially advanced interactive experiences, processing quality, and creative flexibility. However, two critical challenges persist: (1) instruction hallucination--text-only chain-of-thought (CoT) reasoning cannot fully prevent factual errors due to inherent inform

Cited by 0SourcecodeScholar
2026

Meta-CoT: Enhancing Granularity and Generalization in Image Editing

CVPR 2026

Unified multi-modal understanding/generative models have shown improved image editing performance by incorporating fine-grained understanding into their Chain-of-Thought (CoT) process. However, a critical question remains underexplored: what forms of CoT and training strategy can jointly enhance bot

Cited by 0SourcecodeScholar
2026

Re-Align: Structured Reasoning-guided Alignment for In-Context Image Generation and Editing

CVPR 2026

In-context image generation and editing (ICGE) enables users to specify visual concepts through interleaved image-text prompts, demanding precise understanding and faithful execution of user intent. Although recent unified multimodal models exhibit promising understanding capabilities, these strengt

Cited by 0SourceScholar
2026

TAG-MoE: Task-Aware Gating for Unified Generative Mixture-of-Experts

CVPR 2026

Unified image generation and editing models suffer from severe task interference in dense diffusion transformers architectures, where a shared parameter space must compromise between conflicting objectives (e.g., local editing v.s. subject-driven generation). While the sparse Mixture-of-Experts (MoE

Cited by 0SourcecodeScholar
2025

HermesFlow: Seamlessly Closing the Gap in Multimodal Understanding and Generation

NeurIPS 2025poster

The remarkable success of the autoregressive paradigm has made significant advancement in Multimodal Large Language Models (MLLMs), with powerful models like Show-o, Transfusion and Emu3 made notable strides in unified image understanding and generation. For the first time, we uncover a common pheno…

Cited by 0SourcecodeScholar
2025

KV-Edit: Training-Free Image Editing for Precise Background Preservation

ICCV 2025poster

Background consistency remains a significant challenge in image editing tasks. Despite extensive developments, existing works still face a trade-off between maintaining similarity to the original image and generating content that aligns with the target. Here, we propose KV-Edit, a training-free appr…

2024

ManiGaussian: Dynamic Gaussian Splatting for Multi-task Robotic Manipulation

ECCV 2024poster

"Performing language-conditioned robotic manipulation tasks in unstructured environments is highly demanded for general intelligent robots. Conventional robotic manipulation methods usually learn a semantic representation of the observation for action prediction, which ignores the scene-level spatio…

2024

Narrative Action Evaluation with Prompt-Guided Multimodal Interaction

CVPR 2024poster

In this paper we investigate a new problem called narrative action evaluation (NAE). NAE aims to generate professional commentary that evaluates the execution of an action. Unlike traditional tasks such as score-based action quality assessment and video captioning involving superficial sentences NAE…

2023

LOGO: A Long-Form Video Dataset for Group Action Quality Assessment

CVPR 2023poster

Action quality assessment (AQA) has become an emerging topic since it can be extensively applied in numerous scenarios. However, most existing methods and datasets focus on single-person short-sequence scenes, hindering the application of AQA in more complex situations. To address this issue, we con…