← Search

Haiyun Guo

14 accepted papers

2026

PixCLIP: Towards Fine-grained Vision-Language Understanding via Any-granularity Pixel-Text Alignment

ICML 2026poster

While CLIP has achieved strong performance across vision–language tasks, fine-grained image–text alignment remains challenging. Recent efforts improve textual granularity by leveraging long, detailed descriptions and replacing CLIP’s text encoder with LLM, but often overlook the visual-side bottlene…

Cited by 0SourceScholar
2026

R-Diverse: Mitigating Diversity Illusion in Self-Play LLM Training

ICML 2026poster

Self-play bootstraps LLM reasoning through an iterative Challenger–Solver loop: the Challenger is trained to generate questions that target the Solver's capabilities, and the Solver is optimized on the generated data to expand its reasoning skills. However, existing frameworks like R-Zero often exhi…

Cited by 0SourceScholar
2026

ReCALL: Recalibrating Capability Degradation for MLLM-based Composed Image Retrieval

CVPR 2026

Composed Image Retrieval (CIR) aims to retrieve target images based on a hybrid query comprising a reference image and a modification text. Early dual-tower Vision-Language Models (VLMs) struggle with cross-modality compositional reasoning required for this task. While adapting generative Multimodal

Cited by 0SourcecodeScholar
2026

WISER: Wider Search, Deeper Thinking, and Adaptive Fusion for Training-Free Zero-Shot Composed Image Retrieval

CVPR 2026

Zero-Shot Composed Image Retrieval (ZS-CIR) aims to retrieve target images given a multimodal query (comprising a reference image and a modification text), without training on annotated triplets. Existing methods typically convert the multimodal query into a single modality--either as an edited capt

Cited by 0SourcecodeScholar
2025

Cracking the Code of Hallucination in LVLMs with Vision-aware Head Divergence

ACL 2025long

Large vision-language models (LVLMs) have made substantial progress in integrating large language models (LLMs) with visual inputs, enabling advanced multimodal reasoning. Despite their success, a persistent challenge is hallucination—where generated text fails to accurately reflect visual content—u…

2025

PhysVLM: Enabling Visual Language Models to Understand Robotic Physical Reachability

CVPR 2025poster

Understanding the environment and a robot's physical reachability is crucial for task execution. While state-of-the-art vision-language models (VLMs) excel in environmental perception, they often generate inaccurate or impractical responses in embodied visual reasoning tasks due to a lack of underst…

2025

Steering LVLMs via Sparse Autoencoder for Hallucination Mitigation

EMNLP 2025

Large vision-language models (LVLMs) have achieved remarkable performance on multimodal tasks. However, they still suffer from hallucinations, generating text inconsistent with visual input, posing significant risks in real-world applications. Existing approaches to address this issue focus on incor

2024

SEEKR: Selective Attention-Guided Knowledge Retention for Continual Learning of Large Language Models

EMNLP 2024main

Continual learning (CL) is crucial for language models to dynamically adapt to the evolving real-world demands. To mitigate the catastrophic forgetting problem in CL, data replay has been proven a simple and effective strategy, and the subsequent data-replay-based distillation can further enhance th…

2024

WaveMo: Learning Wavefront Modulations to See Through Scattering

CVPR 2024poster

Imaging through scattering media is a fundamental and pervasive challenge in fields ranging from medical diagnostics to astronomy. A promising strategy to overcome this challenge is wavefront modulation which induces measurement diversity during image acquisition. Despite its importance designing op…

2023

ZBS: Zero-Shot Background Subtraction via Instance-Level Background Modeling and Foreground Selection

CVPR 2023poster

Background subtraction (BGS) aims to extract all moving objects in the video frames to obtain binary foreground segmentation masks. Deep learning has been widely used in this field. Compared with supervised-based BGS methods, unsupervised methods have better generalization. However, previous unsuper…

2022

PASS: Part-Aware Self-Supervised Pre-training for Person Re-identification

ECCV 2022poster

"In person re-identification (ReID), very recent researches have validated pre-training the models on unlabelled person images is much better than on ImageNet. However, these researches directly apply the existing self-supervised learning (SSL) methods designed for image classification to ReID witho…

2020

Adaptive Variance Based Label Distribution Learning For Facial Age Estimation

ECCV 2020poster

Estimating age from a single facial image is a classic and challenging topic in computer vision. One of its most intractable issues is label ambiguity, i.e., face images from adjacent age of the same person are often indistinguishable. Some existing methods adopt distribution learning to tackle this…

Cited by 78SourcePDFScholar
2020

Identity-Guided Human Semantic Parsing for Person Re-Identification

ECCV 2020poster

Existing alignment-based methods have to employ the pre-trained human parsing models to achieve the pixel-level alignment, and cannot identify the personal belongings (e.g., backpacks and reticule) which are crucial to person re-ID. In this paper, we propose the identity-guided human semantic parsin…

2019

Semantic Alignment: Finding Semantically Consistent Ground-Truth for Facial Landmark Detection

CVPR 2019poster

Recently, deep learning based facial landmark detection has achieved great success. Despite this, we notice that the semantic ambiguity greatly degrades the detection performance. Specifically, the semantic ambiguity means that some landmarks (e.g. those evenly distributed along the face contour) do…

Cited by 74PDFScholar