Tony Zhang

Snapshot Prompt Ensemble for Parameter-Efficient Soft Prompt Transfer

Soft Prompt Transfer(SPT) uses well-trained soft prompts as initialization to improve prompt tuning efficiency. However, most methods in SPT learn only a single and task-specific prompt for each source task. It may not be suitable for the target task and results in poor transferability on target tas…