← Search

Wan-Yi Lin

2 accepted papers

2024

Federated Text-driven Prompt Generation for Vision-Language Models

ICLR 2024poster

Prompt learning for vision-language models, e.g., CoOp, has shown great success in adapting CLIP to different downstream tasks, making it a promising solution for federated learning due to computational reasons. Existing prompt learning techniques replace hand-crafted text prompts with learned vecto…

Cited by 11SourcePDFScholar
2021

Defending Multimodal Fusion Models Against Single-Source Adversaries

CVPR 2021poster

Beyond achieving high performance across many vision tasks, multimodal models are expected to be robust to single-source faults due to the availability of redundant information between modalities. In this paper, we investigate the robustness of multimodal neural networks against worst-case (i.e., ad…

Cited by 44PDFScholar