← Search

Tian Ye

35 accepted papers

2026

Accelerating Diffusion Model Training under Minimal Budgets: A Condensation-Based Perspective

CVPR 2026

Diffusion models have achieved remarkable performance on a wide range of generative tasks, yet training them from scratch is notoriously resource-intensive, typically requiring millions of training images and many GPU days. Motivated by a data-centric view of this bottleneck, we adopt a condensation

Cited by 0SourcecodeScholar
2026

EditMGT: Unleashing Potentials of Masked Generative Transformers in Image Editing

CVPR 2026

Recent advances in diffusion models (DMs) have achieved exceptional visual quality in image editing tasks. However, the global denoising dynamics of DMs inherently conflate local editing targets with the full-image context, leading to unintended modifications in non-target regions. In this paper, we

Cited by 0SourcecodeScholar
2026

LucidFlux: Caption-Free Universal Image Restoration via a Large-Scale Diffusion Transformer

ICLR 2026poster

Universal image restoration (UIR) aims to recover images degraded by unknown mixtures while preserving semantics—conditions under which discriminative restorers and UNet-based diffusion priors often oversmooth, hallucinate, or drift. We present LucidFlux, a caption-free UIR framework that adapts a l…

Cited by 0SourcecodeScholar
2026

PosterCraft: Rethinking High-Quality Aesthetic Poster Generation in a Unified Framework

ICLR 2026poster

Generating aesthetic posters is more challenging than simple design images: it requires not only precise text rendering but also the seamless integration of abstract artistic content, striking layouts, and overall stylistic harmony. To address this, we propose PosterCraft, a unified framework that a…

Cited by 0SourcecodeScholar
2026

PosterOmni: Generalized Artistic Poster Creation via Task Distillation and Unified Reward Feedback

CVPR 2026

Image-to-poster generation is a high-demand task requiring not only local adjustments but also high-level design understanding. Models must generate text, layout, style, and visual elements while preserving semantic fidelity and aesthetic coherence. The process spans two regimes: local editing, wher

Cited by 0SourcecodeScholar
2026

UltraFlux: Data-Model Co-Design for High-quality Native 4K Text-to-Image Generation across Diverse Aspect Ratios

CVPR 2026

Diffusion transformers have recently delivered strong text-to-image generation around 1K resolution, but we show that extending them to native 4K across diverse aspect ratios exposes a tightly coupled failure mode spanning positional encoding, VAE compression, and optimization. Tackling any of these

Cited by 0SourcecodeScholar
2025

AGLLDiff: Guiding Diffusion Models Towards Unsupervised Training-free Real-world Low-light Image Enhancement

AAAI 2025technical

Existing low-light image enhancement (LIE) methods have achieved noteworthy success in solving synthetic distortions, yet they often fall short in practical applications. The limitations arise from two inherent challenges in real-world LIE: 1) the collection of distorted/clean image pairs is often i…

Cited by 7SourcePDFScholar
2025

Bringing RNNs Back to Efficient Open-Ended Video Understanding

ICCV 2025poster

The challenge of long video understanding lies in its high computational complexity and prohibitive memory cost, since the memory and computation required by transformer-based LLMs scale quadratically with input sequence length. We propose AuroraLong to address this challenge by replacing the LLM co…

Cited by 0SourcePDFScholar
2025

DPLUT: Unsupervised Low-light Image Enhancement with Lookup Tables and Diffusion Priors

AAAI 2025technical

Low-light image enhancement (LIE) aims at precisely and efficiently recovering an image degraded in poor illumination environments. Recent advanced LIE techniques are using deep neural networks, which require lots of low-normal light image pairs, network parameters, and computational resources. As a…

Cited by 6SourcePDFScholar
2025

Dehaze-RetinexGAN: Real-World Image Dehazing via Retinex-based Generative Adversarial Network

AAAI 2025technical

Deep learning based dehazing networks trained on paired synthetic data have shown impressive performance, but they struggle with significant degradation in generalization ability on real-world hazy scenes. In this paper, we propose Dehaze-RetinexGAN, a lightweight Retinex-based Generative Adversari…

Cited by 0SourcePDFScholar
2025

Detect Any Mirrors: Boosting Learning Reliability on Large-Scale Unlabeled Data with an Iterative Data Engine

CVPR 2025poster

Mirror detection is a challenging task because a mirror's visual appearance varies depending on the reflected content. Due to limited annotated data, current methods failed to generalize well for detecting diverse mirror scenes. Semi-supervised learning with large-scale unlabeled data can improve ge…

2025

GenHaze: Pioneering Controllable One-Step Realistic Haze Generation for Real-World Dehazing

ICCV 2025poster

Real-world image dehazing is crucial for enhancing visual quality in computer vision applications. However, existing physics-based haze generation paradigms struggle to model the complexities of real-world haze and lack controllability, limiting the performance of existing baselines on real-world im…

Cited by 0SourcePDFScholar
2025

GlassWizard: Harvesting Diffusion Priors for Glass Surface Detection

ICCV 2025poster

Glass Surface Detection (GSD) is a critical task in computer vision, enabling precise interactions with transparent surfaces and enhancing both safety and object recognition accuracy. However, current research still faces challenges in both recognition performance and generalization capability. Than…

Cited by 0SourcePDFScholar
2025

Meissonic: Revitalizing Masked Generative Transformers for Efficient High-Resolution Text-to-Image Synthesis

ICLR 2025poster

We present Meissonic, which elevates non-autoregressive text-to-image Masked Image Modeling (MIM) to a level comparable with state-of-the-art diffusion models like SDXL. By incorporating a comprehensive suite of architectural innovations, advanced positional encoding strategies, and optimized sampli…

2025

POSTA: A Go-to Framework for Customized Artistic Poster Generation

CVPR 2025poster

Poster design is a critical medium for visual communication. Prior work has explored automatic poster design using deep learning techniques, but these approaches lack text accuracy, user customization, and aesthetic appeal, limiting their applicability in artistic domains such as movies and exhibiti…

Cited by 4SourcePDFScholar
2025

Physics of Language Models: Part 2.1, Grade-School Math and the Hidden Reasoning Process

ICLR 2025poster

Recent advances in language models have demonstrated their capability to solve mathematical reasoning problems, achieving near-perfect accuracy on grade-school level math benchmarks like GSM8K. In this paper, we formally study how language models solve these problems. We design a series of controlle…

Cited by 35SourcePDFScholar
2025

Physics of Language Models: Part 2.2, How to Learn From Mistakes on Grade-School Math Problems

ICLR 2025poster

Language models have demonstrated remarkable performance in solving reasoning tasks; however, even the strongest models still occasionally make reasoning mistakes. Recently, there has been active research aimed at improving reasoning accuracy, particularly by using pretrained language models to "sel…

Cited by 11SourcePDFScholar
2025

PromptHaze: Prompting Real-world Dehazing via Depth Anything Model

AAAI 2025technical

Real-world image dehazing remains a challenging task due to the diverse nature of haze degradation and the lack of large-scale paired datasets. Existing methods based on hand-crafted priors or generative priors struggle to recover accurate backgrounds and fine details from dense haze regions. In thi…

Cited by 0SourcePDFScholar
2025

Residual Diffusion Deblurring Model for Single Image Defocus Deblurring

AAAI 2025technical

Defocus deblurring is a challenging task due to the spatially varying nature of defocus blur with multiple plausible solutions of a single given image. However, most existing methods falter when faced with extensive and variable defocus blur, either ignoring it or relying on additional loss function…

Cited by 0SourcePDFScholar
2025

SnowMaster: Comprehensive Real-world Image Desnowing via MLLM with Multi-Model Feedback Optimization

CVPR 2025poster

Snowfall presents significant challenges for visual data processing, necessitating specialized desnowing algorithms. However, existing models often fail to generalize effectively due to their heavy reliance on synthetic datasets. Furthermore, current real-world snowfall datasets are limited in scale…

Cited by 0SourcePDFScholar
2024

Integrating View Conditions for Image Synthesis

IJCAI 2024poster

In the field of image processing, applying intricate semantic modifications within existing images remains an enduring challenge. This paper introduces a pioneering framework that integrates viewpoint information to enhance the control of image editing tasks, especially for interior design scenes. B…

2024

Learning Diffusion Texture Priors for Image Restoration

CVPR 2024highlight

Diffusion Models have shown remarkable performance in image generation tasks which are capable of generating diverse and realistic image content. When adopting diffusion models for image restoration the crucial challenge lies in how to preserve high-level image fidelity in the randomness diffusion p…

Cited by 20SourcePDFScholar
2024

MovieChat: From Dense Token to Sparse Memory for Long Video Understanding

CVPR 2024poster

Recently integrating video foundation models and large language models to build a video understanding system can overcome the limitations of specific pre-defined vision tasks. Yet existing systems can only handle videos with very few frames. For long videos the computation complexity memory cost and…

2024

RestoreAgent: Autonomous Image Restoration Agent via Multimodal Large Language Models

NeurIPS 2024poster

Natural images captured by mobile devices often suffer from multiple types of degradation, such as noise, blur, and low light. Traditional image restoration methods require manual selection of specific tasks, algorithms, and execution sequences, which is time-consuming and may yield suboptimal resul…

Cited by 6SourcePDFScholar
2024

See and Think: Embodied Agent in Virtual Environment

ECCV 2024poster

"Large language models (LLMs) have achieved impressive pro-gress on several open-world tasks. Recently, using LLMs to build embodied agents has been a hotspot. This paper proposes STEVE, a comprehensive and visionary embodied agent in the Minecraft virtual environment. STEVE comprises three key comp…

Cited by 37SourcePDFScholar
2024

Teaching Tailored to Talent: Adverse Weather Restoration via Prompt Pool and Depth-Anything Constraint

ECCV 2024poster

"Recent advancements in adverse weather restoration have shown potential, yet the unpredictable and varied combinations of weather degradations in the real world pose significant challenges. Previous methods typically struggle with dynamically handling intricate degradation combinations and carrying…

Cited by 11SourcePDFScholar
2024

VQCNIR: Clearer Night Image Restoration with Vector-Quantized Codebook

AAAI 2024technical

Night photography often struggles with challenges like low light and blurring, stemming from dark environments and prolonged exposures. Current methods either disregard priors and directly fitting end-to-end networks, leading to inconsistent illumination, or rely on unreliable handcrafted priors to…

2023

DEHRFormer: Real-Time Transformer for Depth Estimation and Haze Removal from Varicolored Haze Scenes

ICASSP 2023accepted

Varicolored haze caused by chromatic casts poses haze removal and depth estimation challenges. Recent learning-based depth estimation methods are mainly targeted at dehazing first and estimating depth subsequently from haze-free scenes. This way, the inner connections between colored haze and scene…

Cited by 0SourceScholar
2023

MSP-Former: Multi-Scale Projection Transformer for Single Image Desnowing

ICASSP 2023accepted

Snow removal causes challenges due to its characteristic of complex degradations. To this end, targeted treatment of multi-scale snow degradations is critical for the network to learn effective snow removal. In order to handle the diverse scenes, we propose a multi-scale projection transformer (MSP-…

Cited by 0SourceScholar
2023

Sparse Sampling Transformer with Uncertainty-Driven Ranking for Unified Removal of Raindrops and Rain Streaks

ICCV 2023poster

In the real world, image degradations caused by rain often exhibit a combination of rain streaks and raindrops, thereby increasing the challenges of recovering the underlying clean image. Note that the rain streaks and raindrops have diverse shapes, sizes, and locations in the captured image, and th…

Cited by 50PDFcodeScholar
2022

Perceiving and Modeling Density for Image Dehazing

ECCV 2022poster

"In the real world, the degradation of images taken under haze can be quite complex, where the spatial distribution of haze varies from image to image. Recent methods adopt deep neural networks to recover clean scenes from hazy images directly. However, due to the generic design of network architect…

2021

Global Convergence of Gradient Descent for Asymmetric Low-Rank Matrix Factorization

NeurIPS 2021poster

We study the asymmetric low-rank factorization problem: \[\min_{\mathbf{U} \in \mathbb{R}^{m \times d}, \mathbf{V} \in \mathbb{R}^{n \times d}} \frac{1}{2}\|\mathbf{U}\mathbf{V}^\top -\mathbf{\Sigma}\|_F^2\] where $\mathbf{\Sigma}$ is a given matrix of size $m \times n$ and rank $d$. This is a canon…

Cited by 57SourcePDFScholar