← Search

Zhiguo Yu

2 accepted papers

2023

Pre-trained Language Models Can be Fully Zero-Shot Learners

ACL 2023long

How can we extend a pre-trained model to many language understanding tasks, without labeled or additional unlabeled data? Pre-trained language models (PLMs) have been effective for a wide range of NLP tasks. However, existing approaches either require fine-tuning on downstream labeled datasets or ma…

2022

Compressing Sentence Representation for Semantic Retrieval via Homomorphic Projective Distillation

ACL 2022findings

How to learn highly compact yet effective sentence representation? Pre-trained language models have been effective in many NLP tasks. However, these models are often huge and produce large sentence embeddings. Moreover, there is a big performance gap between large and small models. In this paper, we…