Ruihang Miao

Learning to Compress: Unlocking the Potential of Large Language Models for Text Representation

Text representation plays a critical role in tasks like clustering, retrieval, and other downstream applications. With the emergence of large language models (LLMs), there is increasing interest in harnessing their capabilities for this purpose. However, most of the LLMs are inherently causal and op