← Search

Yifan Pu

15 accepted papers

2026

Masked Region Transformer for Layered Image Generation and Editing at Scale

CVPR 2026

Layered image generation and editing is a fundamental capability that enables layer-wise reuse, editing, and composition of generated visual content, analogous to word-level editing in natural language. Despite its importance, this remains an underexplored area at scale. To address this gap, we pres

Cited by 0SourceScholar
2025

ART: Anonymous Region Transformer for Variable Multi-Layer Transparent Image Generation

CVPR 2025poster

Multi-layer image generation is a fundamental task that enables users to isolate, select, and edit specific image layers, thereby revolutionizing interactions with generative models. In this paper, we introduce the Anonymous Region Transformer (ART), which facilitates the direct generation of variab…

Cited by 4SourcePDFScholar
2025

Beyond Single Frames: Can LMMs Comprehend Implicit Narratives in Comic Strip?

EMNLP 2025

Large Multimodal Models (LMMs) have demonstrated strong performance on vision-language benchmarks, yet current evaluations predominantly focus on single-image reasoning. In contrast, real-world scenarios always involve understanding sequences of images. A typical scenario is comic strips understandi

Cited by 0SourcePDFScholar
2025

Linear Differential Vision Transformer: Learning Visual Contrasts via Pairwise Differentials

NeurIPS 2025poster

Vision Transformers (ViTs) have become a universal backbone for both image recognition and image generation. Yet their Multi–Head Self–Attention (MHSA) layer still performs a quadratic query–key interaction for \emph{every} token pair, spending the bulk of computation on visually weak or redundant…

Cited by 0SourcecodeScholar
2024

Bridging the Divide: Reconsidering Softmax and Linear Attention

NeurIPS 2024poster

Widely adopted in modern Vision Transformer designs, Softmax attention can effectively capture long-range visual information; however, it incurs excessive computational cost when dealing with high-resolution inputs. In contrast, linear attention naturally enjoys linear complexity and has great poten…

2024

Demystify Mamba in Vision: A Linear Attention Perspective

NeurIPS 2024poster

Mamba is an effective state space model with linear computation complexity. It has recently shown impressive efficiency in dealing with high-resolution inputs across various vision tasks. In this paper, we reveal that the powerful Mamba model shares surprising similarities with linear attention Tran…

2024

GRA: Detecting Oriented Objects through Group-wise Rotating and Attention

ECCV 2024poster

"Oriented object detection, an emerging task in recent years, aims to identify and locate objects across varied orientations. This requires the detector to accurately capture the orientation information, which varies significantly within and across images. Despite the existing substantial efforts, s…

2024

PsychoGAT: A Novel Psychological Measurement Paradigm through Interactive Fiction Games with LLM Agents

ACL 2024long

Psychological measurement is essential for mental health, self-understanding, and personal development. Traditional methods, such as self-report scales and psychologist interviews, often face challenges with engagement and accessibility. While game-based and LLM-based tools have been explored to imp…

Cited by 11SourcePDFScholar
2024

Smooth Diffusion: Crafting Smooth Latent Spaces in Diffusion Models

CVPR 2024poster

Recently diffusion models have made remarkable progress in text-to-image (T2I) generation synthesizing images with high fidelity and diverse contents. Despite this advancement latent space smoothness within diffusion models remains largely unexplored. Smooth latent spaces ensure that a perturbation…

2023

Adaptive Rotated Convolution for Rotated Object Detection

ICCV 2023poster

Rotated object detection aims to identify and locate objects in images with arbitrary orientation. In this scenario, the oriented directions of objects vary considerably across different images, while multiple orientations of objects exist within an image. This intrinsic characteristic makes it chal…

Cited by 117PDFcodeScholar
2023

Dynamic Perceiver for Efficient Visual Recognition

ICCV 2023poster

Early exiting has become a promising approach to im- proving the inference efficiency of deep networks. By structuring models with multiple classifiers (exits), predictions for "easy" samples can be generated at earlier exits, negating the need for executing deeper layers. Current multi-exit network…

Cited by 36PDFcodeScholar
2023

Learning to Estimate 3-D States of Deformable Linear Objects from Single-Frame Occluded Point Clouds

ICRA 2023poster

Accurately and robustly estimating the state of deformable linear objects (DLOs), such as ropes and wires, is crucial for DLO manipulation and other applications. However, it remains a challenging open issue due to the high dimensionality of the state space, frequent occlusions, and noises. This pap…

Cited by 19SourceScholar
2023

Rank-DETR for High Quality Object Detection

NeurIPS 2023poster

Modern detection transformers (DETRs) use a set of object queries to predict a list of bounding boxes, sort them by their classification confidence scores, and select the top-ranked predictions as the final detection results for the given input image. A highly performant object detector requires acc…

2022

Latency-aware Spatial-wise Dynamic Networks

NeurIPS 2022accept

Spatial-wise dynamic convolution has become a promising approach to improving the inference efficiency of deep networks. By allocating more computation to the most informative pixels, such an adaptive inference paradigm reduces the spatial redundancy in image features and saves a considerable amount…

2022

Learning to Weight Samples for Dynamic Early-Exiting Networks

ECCV 2022poster

"Early exiting is an effective paradigm for improving the inference efficiency of deep networks. By constructing classifiers with varying resource demands (the exits), such networks allow easy samples to be output at early exits, removing the need for executing deeper layers. While existing works ma…