← Search

Yiren Song

25 accepted papers

2026

DiffDecompose: Layer-Wise Decomposition of Alpha-Composited Images via Diffusion Transformers

CVPR 2026

Diffusion models have recently motivated great success in many generation tasks like object removal. Nevertheless, existing image decomposition methods struggle to disentangle semi-transparent or transparent layer occlusions due to mask prior dependencies, static object assumptions, and the lack of

Cited by 0SourcecodeScholar
2026

EasyText: Controllable Diffusion Transformer for Multilingual Text Rendering

AAAI 2026technical

Generating accurate multilingual text with diffusion models has long been desired but remains challenging. Recent methods have made progress in rendering text in a single language, but rendering arbitrary languages is still an under-explored area. This paper introduces EasyText, a text rendering fra

Cited by 0SourcePDFScholar
2026

MCA-Bench: A Multimodal Benchmark for Evaluating CAPTCHA Robustness Against VLM-based Attacks

AAAI 2026technical

As automated attack techniques rapidly advance, CAPTCHAs remain a critical defense mechanism against malicious bots. However, existing CAPTCHA schemes encompass a diverse range of modalities—from static distorted text and obfuscated images to interactive clicks, sliding puzzles, and logic-based ques

Cited by 0SourcePDFScholar
2026

MakeAnything: Harnessing Diffusion Transformers for Multi-Domain Procedural Sequence Generation

CVPR 2026

A hallmark of human intelligence is the ability to create complex artifacts through structured multi-step processes. Generating procedural tutorials with AI is a longstanding but challenging goal, facing three key obstacles: (1) scarcity of multi-task procedural datasets, (2) maintaining logical con

Cited by 44SourcecodeScholar
2026

The Consistency Critic: Correcting Inconsistencies in Generated Images via Reference-Guided Attentive Alignment

CVPR 2026

Previous works have explored various customized generation tasks given a reference image, but they still face limitations in generating consistent fine-grained details. In this paper, our aim is to solve the inconsistency problem of generated images by applying a reference-guided post-editing approa

Cited by 0SourcecodeScholar
2025

Any2AnyTryon: Leveraging Adaptive Position Embeddings for Versatile Virtual Clothing Tasks

ICCV 2025poster

Image-based virtual try-on (VTON) aims to generate a virtual try-on result by transferring an input garment onto a target person's image. However, the scarcity of paired garment-model data makes it challenging for existing meth ods to achieve high generalization and quality in VTON.Also, it limits t…

Cited by 0SourcePDFScholar
2025

ArtEditor: Learning Customized Instructional Image Editor from Few-Shot Examples

ICCV 2025poster

We introduce ArtEditor, a novel framework for instruction-based image editing that learns unique editing styles from few-shot examples. While image editing has seen significant advancements, customized instructional editing remains underexplored. Existing methods often rely on complex, multi-stage p…

2025

DiffSim: Taming Diffusion Models for Evaluating Visual Similarity

ICCV 2025poster

Diffusion models have fundamentally transformed the field of generative models, making the assessment of similarity between customized model outputs and reference inputs critically important. However, traditional perceptual similarity metrics operate primarily at the pixel and patch levels, comparin…

2025

EasyControl: Adding Efficient and Flexible Control for Diffusion Transformer

ICCV 2025poster

Recent advancements in Unet-based diffusion models, such as ControlNet and IP-Adapter, have introduced effective spatial and subject control mechanisms. However, the DiT (Diffusion Transformer) architecture still struggles with efficient and flexible control. To tackle this issue, we propose EasyCon…

Cited by 0SourcePDFScholar
2025

FonTS: Text Rendering With Typography and Style Controls

ICCV 2025poster

Visual text rendering are widespread in various real-world applications, requiring careful font selection and typographic choices. Recent progress in diffusion transformer (DiT)-based text-to-image (T2I) models show promise in automating these processes. However, these methods still encounter challe…

2025

GRE Suite: Geo-localization Inference via Fine-Tuned Vision-Language Models and Enhanced Reasoning Chains

NeurIPS 2025poster

Recent advances in Visual Language Models (VLMs) have demonstrated exceptional performance in visual reasoning tasks. However, geo-localization presents unique challenges, requiring the extraction of multigranular visual cues from images and their integration with external world knowledge for system…

Cited by 0SourcecodeScholar
2025

IDProtector: An Adversarial Noise Encoder to Protect Against ID-Preserving Image Generation

CVPR 2025poster

Recently, zero-shot methods like InstantID have revolutionized identity-preserving generation. Unlike multi-image finetuning approaches such as DreamBooth, these zero-shot methods leverage powerful facial encoders to extract identity information from a single portrait photo, enabling efficient ident…

2025

Image Watermarks are Removable using Controllable Regeneration from Clean Noise

ICLR 2025poster

Image watermark techniques provide an effective way to assert ownership, deter misuse, and trace content sources, which has become increasingly essential in the era of large generative models. A critical attribute of watermark techniques is their robustness against various manipulations. In this pap…

2025

LayerTracer: Cognitive-Aligned Layered SVG Synthesis via Diffusion Transformer

ICCV 2025poster

Generating cognitive-aligned layered SVGs remains challenging due to existing methods' tendencies toward either oversimplified single-layer outputs or optimization-induced shape redundancies. We propose LayerTracer, a DiT based framework that bridges this gap by learning designers' layered SVG creat…

2025

OmniConsistency: Learning Style-Agnostic Consistency from Paired Stylization Data

NeurIPS 2025poster

Diffusion models have advanced image stylization significantly, yet two core challenges persist: (1) maintaining consistent stylization in complex scenes, particularly identity, composition, and fine details, and (2) preventing style degradation in image-to-image pipelines with style LoRAs. GPT-4o's…

Cited by 0SourcecodeScholar
2025

RelationAdapter: Learning and Transferring Visual Relation with Diffusion Transformers

NeurIPS 2025poster

Inspired by the in-context learning mechanism of large language models (LLMs), a new paradigm of generalizable visual prompt-based image editing is emerging. Existing single-reference methods typically focus on style or appearance adjustments and struggle with non-rigid transformations. To address t…

Cited by 0SourceScholar
2025

Stable-Hair: Real-World Hair Transfer via Diffusion Model

AAAI 2025technical

Current hair transfer methods struggle to handle diverse and intricate hairstyles, limiting their applicability in real-world scenarios. In this paper, we propose a novel diffusion-based hair transfer framework, named Stable-Hair, which robustly transfers a wide range of real-world hairstyles to use…

2025

WMAdapter: Adding WaterMark Control to Latent Diffusion Models

ICML 2025poster

Watermarking is essential for protecting the copyright of AI-generated images. We propose WMAdapter, a diffusion model watermark plugin that embeds user-specified watermark information seamlessly during the diffusion generation process. Unlike previous methods that modify diffusion modules to incorp…

Cited by 14SourcePDFScholar
2024

Fast Personalized Text to Image Synthesis with Attention Injection

ICASSP 2024accepted

Currently, personalized image generation methods mostly require considerable time to finetune and often overfit the concept resulting in generated images that are similar to custom concepts but difficult to edit by prompts. We propose an effective and fast approach that could balance the text-image…

Cited by 0SourceScholar
2024

Rethinking Tree-Ring Watermarking for Enhanced Multi-Key Identification

ECCV 2024poster

"We revisit Tree-Ring Watermarking, a recent diffusion model watermarking method that demonstrates great robustness to various attacks. We conduct an in-depth study on it and reveal that the distribution shift unintentionally introduced by the watermarking process, apart from watermark pattern match…

2024

SSR-Encoder: Encoding Selective Subject Representation for Subject-Driven Generation

CVPR 2024poster

Recent advancements in subject-driven image generation have led to zero-shot generation yet precise selection and focus on crucial subject representations remain challenging. Addressing this we introduce the SSR-Encoder a novel architecture designed for selectively capturing any subject from single…

2023

CLIPVG: Text-Guided Image Manipulation Using Differentiable Vector Graphics

AAAI 2023technical

Considerable progress has recently been made in leveraging CLIP (Contrastive Language-Image Pre-Training) models for text-guided image manipulation. However, all existing works rely on additional generative models to ensure the quality of results, because CLIP alone cannot provide enough guidance in…