2022
Salient Phrase Aware Dense Retrieval: Can a Dense Retriever Imitate a Sparse One?
EMNLP 2022finding
Despite their recent popularity and well-known advantages, dense retrievers still lag behind sparse methods such as BM25 in their ability to reliably match salient phrases and rare entities in the query and to generalize to out-of-domain data. It has been argued that this is an inherent limitation o…