Yilun Li

Divergence-enhanced Knowledge-guided Context Optimization for Visual-Language Prompt Tuning

Prompt tuning vision-language models like CLIP has shown great potential in learning transferable representations for various downstream tasks. The main issue is how to mitigate the over-fitting problem on downstream tasks with limited training samples. While knowledge-guided context optimization ha…