← Search

Lanyun Zhu

14 accepted papers

2026

CamGeo: Sparse Camera-Conditioned Image-to-Video Generation with 3D Geometry Priors

ICML 2026poster

Sparse camera-conditioned image-to-video generation presents a pivotal challenge: synthesizing geometrically consistent 3D motion from minimal pose cues. Existing methods, which largely rely on dense supervision or naive interpolation, suffer from severe pose drift and motion discontinuities due to …

Cited by 0SourceScholar
2026

Multi-Agent VLMs Guided Self-Training with PNU Loss for Low-Resource Offensive Content Detection

AAAI 2026technical

Accurate detection of offensive content on social media demands high-quality labeled data; however, such data is often scarce due to the low prevalence of offensive instances and the high cost of manual annotation. To address this low-resource challenge, we propose a self-training framework that lev

Cited by 0SourcePDFScholar
2025

CPCF: A Cross-Prompt Contrastive Framework for Referring Multimodal Large Language Models

ICML 2025poster

Referring MLLMs extend conventional multimodal large language models by allowing them to receive referring visual prompts and generate responses tailored to the indicated regions. However, these models often suffer from suboptimal performance due to incorrect responses tailored to misleading areas a…

Cited by 0SourcePDFScholar
2025

POPEN: Preference-Based Optimization and Ensemble for LVLM-Based Reasoning Segmentation

CVPR 2025poster

Existing LVLM-based reasoning segmentation methods often suffer from imprecise segmentation results and hallucinations in their text responses. This paper introduces POPEN, a novel framework designed to address these issues and achieve improved results. POPEN includes a preference-based optimization…

Cited by 2SourcePDFScholar
2025

Retrv-R1: A Reasoning-Driven MLLM Framework for Universal and Efficient Multimodal Retrieval

NeurIPS 2025poster

The success of DeepSeek-R1 demonstrates the immense potential of using reinforcement learning (RL) to enhance LLMs' reasoning capabilities. This paper introduces Retrv-R1, the first R1-style MLLM specifically designed for multimodal universal retrieval, achieving higher performance by employing step…

Cited by 0SourceScholar
2025

Unlocking the Power of SAM 2 for Few-Shot Segmentation

ICML 2025poster

Few-Shot Segmentation (FSS) aims to learn class-agnostic segmentation on few classes to segment arbitrary classes, but at the risk of overfitting. To address this, some methods use the well-learned knowledge of foundation models (e.g., SAM) to simplify the learning process. Recently, SAM 2 has exten…

2024

Addressing Background Context Bias in Few-Shot Segmentation through Iterative Modulation

CVPR 2024poster

Existing few-shot segmentation methods usually extract foreground prototypes from support images to guide query image segmentation. However different background contexts of support and query images can cause their foreground features to be misaligned. This phenomenon known as background context bias…

Cited by 17SourcePDFScholar
2024

Discrete Latent Perspective Learning for Segmentation and Detection

ICML 2024spotlight

In this paper, we address the challenge of Perspective-Invariant Learning in machine learning and computer vision, which involves enabling a network to understand images from varying perspectives to achieve consistent semantic interpretation. While standard approaches rely on the labor-intensive col…

Cited by 9SourcePDFScholar
2024

Hybrid Mamba for Few-Shot Segmentation

NeurIPS 2024poster

Many few-shot segmentation (FSS) methods use cross attention to fuse support foreground (FG) into query features, regardless of the quadratic complexity. A recent advance Mamba can also well capture intra-sequence dependencies, yet the complexity is only linear. Hence, we aim to devise a cross (atte…

2024

LLaFS: When Large Language Models Meet Few-Shot Segmentation

CVPR 2024poster

This paper proposes LLaFS the first attempt to leverage large language models (LLMs) in few-shot segmentation. In contrast to the conventional few-shot segmentation methods that only rely on the limited and biased information from the annotated support images LLaFS leverages the vast prior knowledge…

Cited by 44SourcePDFScholar
2023

Continual Semantic Segmentation With Automatic Memory Sample Selection

CVPR 2023poster

Continual Semantic Segmentation (CSS) extends static semantic segmentation by incrementally introducing new classes for training. To alleviate the catastrophic forgetting issue in CSS, a memory buffer that stores a small number of samples from the previous classes is constructed for replay. However,…

Cited by 57SourcePDFScholar
2023

Deep3DSketch: 3D Modeling from Free-Hand Sketches with View- and Structural-Aware Adversarial Training

ICASSP 2023accepted

This work aims to investigate the problem of 3D modeling using single free-hand sketches, which is one of the most natural ways we humans express ideas. Although sketch-based 3D modeling can drastically make the 3D modeling process more accessible, the sparsity and ambiguity of sketches bring signif…

Cited by 0SourceScholar
2021

Learning Statistical Texture for Semantic Segmentation

CVPR 2021poster

Existing semantic segmentation works mainly focus on learning the contextual information in high-level semantic features with CNNs. In order to maintain a precise boundary, low-level texture features are directly skip-connected into the deeper layers. Nevertheless, texture features are not only abou…

Cited by 177PDFcodeScholar