← Search

Shiyuan Huang

10 accepted papers

2024

Personalized Video Comment Generation

EMNLP 2024finding

Generating personalized responses, particularly in the context of video, poses a unique challenge for language models. This paper introduces the novel task of Personalized Video Comment Generation (PVCG), aiming to predict user comments tailored to both the input video and the user’s comment history…

2023

DiGeo: Discriminative Geometry-Aware Learning for Generalized Few-Shot Object Detection

CVPR 2023poster

Generalized few-shot object detection aims to achieve precise detection on both base classes with abundant annotations and novel classes with limited training data. Existing approaches enhance few-shot generalization with the sacrifice of base-class performance, or maintain high precision in base-cl…

2023

Supervised Masked Knowledge Distillation for Few-Shot Transformers

CVPR 2023poster

Vision Transformers (ViTs) emerge to achieve impressive performance on many data-abundant computer vision tasks by capturing long-range dependencies among local features. However, under few-shot learning (FSL) settings on small datasets with only a few labeled data, ViT tends to overfit and suffers…

2023

TempCLR: Temporal Alignment Representation with Contrastive Learning

ICLR 2023poster

Video representation learning has been successful in video-text pre-training for zero-shot transfer, where each sentence is trained to be close to the paired video clips in a common feature space. For long videos, given a paragraph of description where the sentences describe different segments of th…

2023

Towards Fast Adaptation of Pretrained Contrastive Models for Multi-Channel Video-Language Retrieval

CVPR 2023poster

Multi-channel video-language retrieval require models to understand information from different channels (e.g. video+question, video+speech) to correctly link a video with a textual response or query. Fortunately, contrastive multimodal models are shown to be highly effective at aligning entities in…

2022

Few-Shot End-to-End Object Detection via Constantly Concentrated Encoding across Heads

ECCV 2022poster

"Few-shot object detection (FSOD) aims to detect objects of new classes and learn effective models without exhaustive annotation. The end-to-end detection framework has been proposed to generate sparse proposals and set a stack of detection heads to improve the performance. For each proposal, the pr…

Cited by 20SourcePDFScholar
2022

Few-Shot Object Detection With Fully Cross-Transformer

CVPR 2022oral

Few-shot object detection (FSOD), with the aim to detect novel objects using very few training examples, has recently attracted great research interest in the community. Metric-learning based methods have been demonstrated to be effective for this task using a two-branch based siamese network, and c…

Cited by 193PDFcodeScholar
2022

Meta Faster R-CNN: Towards Accurate Few-Shot Object Detection with Attentive Feature Alignment

AAAI 2022technical

Few-shot object detection (FSOD) aims to detect objects using only a few examples. How to adapt state-of-the-art object detectors to the few-shot domain remains challenging. Object proposal is a key ingredient in modern object detectors. However, the quality of proposals generated for few-shot class…

2022

Task-Adaptive Negative Envision for Few-Shot Open-Set Recognition

CVPR 2022poster

We study the problem of few-shot open-set recognition (FSOR), which learns a recognition system capable of both fast adaptation to new classes with limited labeled examples and rejection of unknown negative samples. Traditional large-scale open-set methods have been shown ineffective for FSOR proble…

Cited by 50PDFcodeScholar
2021

Query Adaptive Few-Shot Object Detection With Heterogeneous Graph Convolutional Networks

ICCV 2021poster

Few-shot object detection (FSOD) aims to detect never-seen objects using few examples. This field sees recent improvement owing to the meta-learning techniques by learning how to match between the query image and few-shot class examples, such that the learned model can generalize to few-shot novel c…

Cited by 149PDFcodeScholar