← Search

Jiduan Liu

3 accepted papers

2023

RankCSE: Unsupervised Sentence Representations Learning via Learning to Rank

ACL 2023long

Unsupervised sentence representation learning is one of the fundamental problems in natural language processing with various downstream applications. Recently, contrastive learning has been widely adopted which derives high-quality sentence representations by pulling similar semantics closer and pus…

2023

Retrieval-based Knowledge Transfer: An Effective Approach for Extreme Large Language Model Compression

EMNLP 2023long findings

Large-scale pre-trained language models (LLMs) have demonstrated exceptional performance in various natural language processing (NLP) tasks. However, the massive size of these models poses huge challenges for their deployment in real-world applications. While numerous model compression techniques ha…

Cited by 0SourceScholar
2022

GNN-encoder: Learning a Dual-encoder Architecture via Graph Neural Networks for Dense Passage Retrieval

EMNLP 2022finding

Recently, retrieval models based on dense representations are dominant in passage retrieval tasks, due to their outstanding ability in terms of capturing semantics of input text compared to the traditional sparse vector space models. A common practice of dense retrieval models is to exploit a dual-e…

Cited by 4SourcePDFScholar