Eric I Chang

SDPT: Synchronous Dual Prompt Tuning for Fusion-based Visual-Language Pre-trained Models

"Prompt tuning methods have achieved remarkable success in parameter-efficient fine-tuning on large pre-trained models. However, their application to dual-modal fusion-based visual-language pre-trained models (VLPMs), such as GLIP, has encountered issues. Existing prompt tuning methods have not effe…