← Search

Xiaoyi Zhang

13 accepted papers

2026

Attack for Defense: Adversarial Agents for Point Prompt Optimization Empowering Segment Anything Model

CVPR 2026

Prompt quality plays a critical role in the performance of the Segment Anything Model (SAM), yet existing approaches often rely on heuristic or manually crafted prompts, limiting scalability and generalization. In this paper, we propose Point Prompt Defender, an adversarial reinforcement learning fr

Cited by 0SourcecodeScholar
2026

CoD: A Diffusion Foundation Model for Image Compression

CVPR 2026

Existing diffusion codecs typically build on text-to-image diffusion foundation models like Stable Diffusion.However, text conditioning is suboptimal from a compression perspective, hindering the potential of downstream diffusion codecs, particularly at ultra-low bitrates.To address it, we introduce

Cited by 0SourcecodeScholar
2026

From Content to Knowledge: Lightning Fast Long-Video Understanding with Neural Knowledge Representations

ICML 2026poster

We propose a new paradigm for long video understanding by treating a long video as a Neural Knowledge Representation (NKR). NKR represent video contents neither as a stream of tokens or pre-organized databases, but as an individual small portion of network weights attached to the VLM backbone. The N…

Cited by 0SourceScholar
2026

Generative Video Compression with One-Dimensional Latent Representation

CVPR 2026

Recent advancements in generative video codec (GVC) typically encode video into a 2D latent grid and employ high-capacity generative decoders for reconstruction. However, this paradigm still leaves two key challenges in fully exploiting spatial-temporal redundancy: Spatially, the 2D latent grid inev

Cited by 0SourceScholar
2026

Real-Time and Lightweight Diffusion Image Compression

ICML 2026poster

Recent advanced diffusion methods typically derive strong generative priors by scaling diffusion transformers. However, scaling fails to generalize when adapted for real-time compression scenarios that demand lightweight models. In this paper, we explore the design of real-time and lightweight diffu…

Cited by 0SourceScholar
2026

Vision Foundation Models Can Be Good Tokenizers for Latent Diffusion Models

CVPR 2026

The performance of Latent Diffusion Models (LDMs) is critically dependent on the quality of their visual tokenizers. While recent works have explored incorporating Vision Foundation Models (VFMs) into the tokenizers training via distillation, we empirically find this approach inevitably weakens the

Cited by 0SourcecodeScholar
2026

Vision in One Vector: Implicit Visual Compression with Diffusion Foundation Models

ICML 2026poster

Modern visual generative models acquire rich visual knowledge through large-scale training, yet existing visual representations (such as pixels, latents, or tokens) remain external to the model and cannot directly exploit this knowledge for compact storage or reuse. In this work, we introduce a new …

Cited by 0SourceScholar
2025

Deep Video Discovery: Agentic Search with Tool Use for Long-form Video Understanding

NeurIPS 2025poster

Long-form video understanding presents significant challenges due to extensive temporal-spatial complexity and the difficulty of question answering under such extended contexts. While Large Language Models (LLMs) have demonstrated considerable advancements in video analysis capabilities and long co…

Cited by 0SourceScholar
2025

UI-E2I-Synth: Advancing GUI Grounding with Large-Scale Instruction Synthesis

ACL 2025finding

Recent advancements in Large Vision-Language Models are accelerating the development of Graphical User Interface (GUI) agents that utilize human-like vision perception capabilities to enhance productivity on digital devices. Compared to approaches predicated on GUI metadata, which are platform-depen…

Cited by 0SourcePDFScholar
2024

Text Grouping Adapter: Adapting Pre-trained Text Detector for Layout Analysis

CVPR 2024poster

Significant progress has been made in scene text detection models since the rise of deep learning but scene text layout analysis which aims to group detected text instances as paragraphs has not kept pace. Previous works either treated text detection and grouping using separate models or train a mod…

Cited by 1SourcePDFScholar
2023

Unifying Layout Generation With a Decoupled Diffusion Model

CVPR 2023poster

Layout generation aims to synthesize realistic graphic scenes consisting of elements with different attributes including category, size, position, and between-element relation. It is a crucial task for reducing the burden on heavy-duty graphic design works for formatted scenes, e.g., publications, d…

Cited by 45SourcePDFScholar
2016

Low-complexity beamforming designs of sum secrecy rate maximization for the Gaussian MISO multi-receiver wiretap channel

ICASSP 2016accepted

This paper studies the beamforming design for sum secrecy rate (SSR) maximization in the Gaussian multiple-input single-output multi-receiver wiretap channel (MISO-MRWC). The optimization problem of finding the optimal beamforming algorithm is non-convex and intractable to solve using low-complexity…

Cited by 0SourceScholar