← Search

Peiyu Yu

11 accepted papers

2026

Designing Instance-Level Sampling Schedules via REINFORCE with James-Stein Shrinkage

CVPR 2026

Most post-training methods for text-to-image samplers focus on the model weights: either fine-tuning the backbone for alignment or distilling it for few-step efficiency. We take a different route: rescheduling the sampling timeline of a frozen sampler. Instead of a fixed, global schedule, we learn i

Cited by 0SourceScholar
2026

EdiVal-Agent: An Object-Centric Framework for Automated, Fine-Grained Evaluation of Multi-Turn Editing

ICLR 2026poster

Instruction-based image editing has advanced rapidly, yet reliable and interpretable evaluation remains a bottleneck. Current protocols either (i) depend on paired reference images—resulting in limited coverage and inheriting biases from prior generative models—or (ii) rely *solely* on zero-shot vis…

Cited by 0SourcecodeScholar
2026

``Noisier'’ Noise Contrastive Estimation is (Almost) Maximum Likelihood

ICLR 2026poster

Noise Contrastive Estimation (NCE) has fueled major breakthroughs in representation learning and generative modeling. Yet a long-standing challenge remains: accurately estimating ratios between distributions that differ substantially, which significantly limits the applicability of NCE on modern hig…

Cited by 0SourcecodeScholar
2024

Flow Priors for Linear Inverse Problems via Iterative Corrupted Trajectory Matching

NeurIPS 2024poster

Generative models based on flow matching have attracted significant attention for their simplicity and superior performance in high-resolution image synthesis. By leveraging the instantaneous change-of-variables formula, one can directly compute image likelihoods from a learned flow, making them ent…

2024

Learning Concept-Based Causal Transition and Symbolic Reasoning for Visual Planning

IROS 2024poster

Visual planning simulates how humans make decisions to achieve desired goals in the form of searching for visual causal transitions between an initial visual state and a final visual goal state. It has become increasingly important in egocentric vision with its advantages in guiding agents to perfor…

Cited by 1SourcecodeScholar
2024

Object-Conditioned Energy-Based Attention Map Alignment in Text-to-Image Diffusion Models

ECCV 2024poster

"Text-to-image diffusion models have shown great success in generating high-quality text-guided images. Yet, these models may still fail to semantically align generated images with the provided text prompts, leading to problems like incorrect attribute binding and/or catastrophic object neglect. Giv…

2024

UltraEdit: Instruction-based Fine-Grained Image Editing at Scale

NeurIPS 2024poster

This paper presents UltraEdit, a large-scale (~ 4M editing samples), automatically generated dataset for instruction-based image editing. Our key idea is to address the drawbacks in existing image editing datasets like InstructPix2Pix and MagicBrush, and provide a *systematic* approach to producing…

2023

Learning Energy-Based Prior Model with Diffusion-Amortized MCMC

NeurIPS 2023poster

Latent space EBMs, also known as energy-based priors, have drawn growing interests in the field of generative modeling due to its flexibility in the formulation and strong modeling power of the latent space. However, the common practice of learning latent space EBMs with non-convergent short-run MCM…

2022

Latent Diffusion Energy-Based Model for Interpretable Text Modelling

ICML 2022spotlight

Latent space Energy-Based Models (EBMs), also known as energy-based priors, have drawn growing interests in generative modeling. Fueled by its flexibility in the formulation and strong modeling power of the latent space, recent works built upon it have made interesting attempts aiming at the interpr…

2021

Unsupervised Foreground Extraction via Deep Region Competition

NeurIPS 2021poster

We present Deep Region Competition (DRC), an algorithm designed to extract foreground objects from images in a fully unsupervised manner. Foreground extraction can be viewed as a special case of generic image segmentation that focuses on identifying and disentangling objects from the background. In…

Cited by 41SourcePDFScholar
2020

Exoskeleton-covered soft finger with vision-based proprioception and tactile sensing

ICRA 2020poster

Soft robots offer significant advantages in adaptability, safety, and dexterity compared to conventional rigid-body robots. However, it is challenging to equip soft robots with accurate proprioception and tactile sensing due to their high flexibility and elasticity. In this work, we describe the dev…

Cited by 74SourceScholar