← Search

Haoyu Song

4 accepted papers

2026

RGB-Event based Pedestrian Attribute Recognition: A Benchmark Dataset and An Asymmetric RWKV Fusion Framework

CVPR 2026

Existing pedestrian attribute recognition methods are generally developed based on RGB frame cameras. However, these approaches are constrained by the limitations of RGB cameras, such as sensitivity to lighting conditions and motion blur, which hinder their performance. Furthermore, current attribut

Cited by 0SourcecodeScholar
2023

Visually-Augmented Language Modeling

ICLR 2023poster

Human language is grounded on multimodal knowledge including visual knowledge like colors, sizes, and shapes. However, current large-scale pre-trained language models rely on the text-only self-supervised training with massive text data, which precludes them from utilizing relevant visual informatio…

2022

CLIP Models are Few-Shot Learners: Empirical Studies on VQA and Visual Entailment

ACL 2022long

CLIP has shown a remarkable zero-shot capability on a wide range of vision tasks. Previously, CLIP is only regarded as a powerful visual encoder. However, after being pre-trained by language supervision from a large amount of image-caption pairs, CLIP itself should also have acquired some few-shot a…

2021

BoB: BERT Over BERT for Training Persona-based Dialogue Models from Limited Personalized Data

ACL 2021long

Maintaining a consistent persona is essential for dialogue agents. Although tremendous advancements have been brought, the limited-scale of annotated personalized dialogue datasets is still a barrier towards training robust and consistent persona-based dialogue models. This work shows how this chall…