2023
SamToNe: Improving Contrastive Loss for Dual Encoder Retrieval Models with Same Tower Negatives
ACL 2023findings
Dual encoders have been used for retrieval tasks and representation learning with good results. A standard way to train dual encoders is using a contrastive loss with in-batch negatives. In this work, we propose an improved contrastive learning objective by adding queries or documents from the same…