← Search

Shunyu Zhang

3 accepted papers

2024

Knowledge Enhanced Pre-training for Cross-lingual Dense Retrieval

COLING 2024main

In recent years, multilingual pre-trained language models (mPLMs) have achieved significant progress in cross-lingual dense retrieval. However, most mPLMs neglect the importance of knowledge. Knowledge always conveys similar semantic concepts in a language-agnostic manner, while query-passage pairs…

Cited by 0SourcePDFScholar
2023

Modeling Sequential Sentence Relation to Improve Cross-lingual Dense Retrieval

ICLR 2023poster

Recently multi-lingual pre-trained language models (PLM) such as mBERT and XLM-R have achieved impressive strides in cross-lingual dense retrieval. Despite its successes, they are general-purpose PLM while the multilingual PLM tailored for cross-lingual retrieval is still unexplored. Motivated by an…

2022

Multi-View Document Representation Learning for Open-Domain Dense Retrieval

ACL 2022long

Dense retrieval has achieved impressive advances in first-stage retrieval from a large-scale document collection, which is built on bi-encoder architecture to produce single vector representation of query and document. However, a document can usually answer multiple potential queries from different…

Cited by 65SourcePDFScholar