← Search

Zhiyu Tan

15 accepted papers

2026

Aligning Multi-Character Narrative Image Generation with Multi-Aspect Human Preferences

CVPR 2026

Narrative image generation aims to create images featuring multiple distinct characters while capturing their interrelationships, posing significant challenges for current text-to-image diffusion models. As a result, general personalized methods often suffer from poor semantic alignment, identity bl

Cited by 0SourceScholar
2026

DiverseDiT: Towards Diverse Representation Learning in Diffusion Transformers

CVPR 2026

Recent breakthroughs in Diffusion Transformers (DiTs) have revolutionized the field of visual synthesis due to their superior scalability. To facilitate DiTs' capability of capturing meaningful internal representations, recent works such as REPA incorporate external pretrained encoders for represent

Cited by 0SourcecodeScholar
2026

Dual-IPO: Dual-Iterative Preference Optimization for Text-to-Video Generation

ICLR 2026poster

Recent advances in video generation have enabled thrilling experiences in producing realistic videos driven by scalable diffusion transformers. However, they usually fail to produce satisfactory outputs that are aligned to users' authentic demands and preferences. In this work, we introduce Dual-Ite…

Cited by 0SourcecodeScholar
2026

Identity-Aware Vision-Language Model for Explainable Face Forgery Detection

AAAI 2026technical

Recent advances in generative artificial intelligence have enabled the creation of highly realistic image forgeries, raising significant concerns about digital media authenticity. While existing detection methods demonstrate promising results on benchmark datasets, they face critical limitations in

Cited by 0SourcePDFScholar
2026

SIPO: Stabilized and Improved Preference Optimization for Aligning Diffusion Models

ICML 2026poster

Preference learning has garnered extensive attention as an effective technique for aligning diffusion models with human preferences in visual generation tasks. However, existing alignment approaches such as Diffusion-DPO suffer from two fundamental challenges: training instability caused by high gra…

Cited by 0SourceScholar
2026

Uni-CoT: Towards Unified Chain-of-Thought Reasoning Across Text and Vision

ICLR 2026poster

Chain-of-Thought (CoT) reasoning has proven effective in enhancing Large Language Models (LLMs) on complex tasks by decomposing problems into step-wise solutions. However, extending CoT to multi-modal settings remains challenging, as it requires modeling transitions of visual states alongside textua…

Cited by 0SourcecodeScholar
2025

ReinAD: Towards Real-world Industrial Anomaly Detection with a Comprehensive Contrastive Dataset

NeurIPS 2025poster

Recent years have witnessed significant advancements in industrial anomaly detection (IAD) thanks to existing anomaly detection datasets. However, the large performance gap between these benchmarks and real industrial practice reveals critical limitations in existing datasets. We argue that the mism…

Cited by 0SourcecodeScholar
2024

An Empirical Study and Analysis of Text-to-Image Generation Using Large Language Model-Powered Textual Representation

ECCV 2024poster

"One critical prerequisite for faithful text-to-image generation is the accurate understanding of text inputs. Existing methods leverage the text encoder of the CLIP model to represent input prompts. However, the pre-trained CLIP model can merely encode English with a maximum token length of 77. Mor…

2024

Towards Effective Usage of Human-Centric Priors in Diffusion Models for Text-based Human Image Generation

CVPR 2024poster

Vanilla text-to-image diffusion models struggle with generating accurate human images commonly resulting in imperfect anatomies such as unnatural postures or disproportionate limbs. Existing methods address this issue mostly by fine-tuning the model with extra images or adding additional controls --…

Cited by 9SourcePDFScholar
2022

Entroformer: A Transformer-based Entropy Model for Learned Image Compression

ICLR 2022poster

One critical component in lossy deep image compression is the entropy model, which predicts the probability distribution of the quantized latent representation in the encoding and decoding modules. Previous works build entropy models upon convolutional neural networks which are inefficient in captur…

Cited by 169SourcePDFScholar
2022

GiraffeDet: A Heavy-Neck Paradigm for Object Detection

ICLR 2022poster

In conventional object detection frameworks, a backbone body inherited from image recognition models extracts deep latent features and then a neck module fuses these latent features to capture information at different scales. As the resolution in object detection is much larger than in image recogni…

2022

Jmpnet: Joint Motion Prediction for Learning-Based Video Compression

ICASSP 2022accepted

In recent years, more attention is attracted by learning-based approaches in the field of video compression. Recent methods of this kind normally consist of three major components: intra-frame network, motion prediction network, and residual network, among which the motion prediction part is particu…

Cited by 0SourceScholar
2022

MAE-DET: Revisiting Maximum Entropy Principle in Zero-Shot NAS for Efficient Object Detection

ICML 2022spotlight

In object detection, the detection backbone consumes more than half of the overall inference cost. Recent researches attempt to reduce this cost by optimizing the backbone architecture with the help of Neural Architecture Search (NAS). However, existing NAS methods for object detection require hundr…

2021

Learning Accurate Entropy Model with Global Reference for Image Compression

ICLR 2021poster

In recent deep image compression neural networks, the entropy model plays a critical role in estimating the prior distribution of deep image encodings. Existing methods combine hyperprior with local context in the entropy estimation function. This greatly limits their performance due to the absence…

Cited by 86SourcePDFScholar