Benjamin Yao — accepted AI-conference papers

2024

Open Vocabulary Multi-Label Video Classification

Rohit Gupta*, Mamshad Nayeem Rizve, Jayakrishnan Unnikrishnan, Ashish Tawari, Son Tran, Mubarak Shah +2

ECCV 2024poster

"Pre-trained vision-language models (VLMs) have enabled significant progress in open vocabulary computer vision tasks such as image classification, object detection and image segmentation. Some recent works have focused on extending VLMs to open vocabulary single label action classification in video…

Cited by 2 Source ↗PDF ↗Scholar ↗

2024

X-Former: Unifying Contrastive and Reconstruction Learning for MLLMs

Sirnam Swetha*, Jinyu Yang, Tal Neiman, Mamshad Nayeem Rizve, Son Tran, Benjamin Yao +2

ECCV 2024poster

"Recent advancements in Multimodal Large Language Models (MLLMs) have revolutionized the field of vision-language understanding by integrating visual perception capabilities into Large Language Models (LLMs). The prevailing trend in this field involves the utilization of a vision encoder derived fro…

Cited by 2 Source ↗PDF ↗Scholar ↗

2022

Joint Goal Segmentation and Goal Success Prediction on Multi-Domain Conversations

Meiguo Wang, Benjamin Yao, Bin Guo, Xiaohu Liu, Yu Zhang, Tuan-Hung Pham +1

COLING 2022main

To evaluate the performance of a multi-domain goal-oriented Dialogue System (DS), it is important to understand what the users’ goals are for the conversations and whether those goals are successfully achieved. The success rate of goals directly correlates with user satisfaction and perceived useful…

Cited by 2 Source ↗PDF ↗Scholar ↗