← Search

Sunan He

4 accepted papers

2025

EvdCLIP: Improving Vision-Language Retrieval with Entity Visual Descriptions from Large Language Models

AAAI 2025technical

Vision-language retrieval (VLR) has attracted significant attention in both academia and industry, which involves using text (or images) as queries to retrieve corresponding images (or text). However, existing methods often neglect the rich visual semantics knowledge of entities, thus leading to inc…

Cited by 0SourcePDFScholar
2024

Vision-Language Pre-training with Object Contrastive Learning for 3D Scene Understanding

AAAI 2024technical

In recent years, vision language pre-training frameworks have made significant progress in natural language processing and computer vision, achieving remarkable performance improvement on various downstream tasks. However, when extended to point cloud data, existing works mainly focus on building ta…

2023

D3G: Exploring Gaussian Prior for Temporal Sentence Grounding with Glance Annotation

ICCV 2023poster

Temporal sentence grounding (TSG) aims to locate a specific moment from an untrimmed video with a given natural language query. Recently, weakly supervised methods still have a large performance gap compared to fully supervised ones, while the latter requires laborious timestamp annotations. In this…

Cited by 15PDFcodeScholar
2023

Open-Vocabulary Multi-Label Classification via Multi-Modal Knowledge Transfer

AAAI 2023technical

Real-world recognition system often encounters the challenge of unseen labels. To identify such unseen labels, multi-label zero-shot learning (ML-ZSL) focuses on transferring knowledge by a pre-trained textual label embedding (e.g., GloVe). However, such methods only exploit single-modal knowledge f…