← Search

Junhan Yang

2 accepted papers

2023

Longtriever: a Pre-trained Long Text Encoder for Dense Document Retrieval

EMNLP 2023long main

Pre-trained language models (PLMs) have achieved the preeminent position in dense retrieval due to their powerful capacity in modeling intrinsic semantics. However, most existing PLM-based retrieval models encounter substantial computational costs and are infeasible for processing long documents. In…

Cited by 0SourceScholar
2021

GraphFormers: GNN-nested Transformers for Representation Learning on Textual Graph

NeurIPS 2021poster

The representation learning on textual graph is to generate low-dimensional embeddings for the nodes based on the individual textual features and the neighbourhood information. Recent breakthroughs on pretrained language models and graph neural networks push forward the development of corresponding…