← Search

Guanhong Wang

3 accepted papers

2024

MovieChat: From Dense Token to Sparse Memory for Long Video Understanding

CVPR 2024poster

Recently integrating video foundation models and large language models to build a video understanding system can overcome the limitations of specific pre-defined vision tasks. Yet existing systems can only handle videos with very few frames. For long videos the computation complexity memory cost and…

2024

Sam-Guided Enhanced Fine-Grained Encoding with Mixed Semantic Learning for Medical Image Captioning

ICASSP 2024accepted

With the development of multimodality and large language models, the deep learning-based technique for medical image captioning holds the potential to offer valuable diagnostic recommendations. However, current generic text and image pre-trained models do not yield satisfactory results when it comes…

Cited by 0Source ↗Scholar ↗
2024

Solving the Catastrophic Forgetting Problem in Generalized Category Discovery

CVPR 2024poster

Generalized Category Discovery (GCD) aims to identify a mix of known and novel categories within unlabeled data sets providing a more realistic setting for image recognition. Essentially GCD needs to remember existing patterns thoroughly to recognize novel categories. Recent state-of-the-art method…