Xuanrui Gou

LightRetriever: A LLM-based Text Retrieval Architecture with Extremely Faster Query Inference

Large Language Models (LLMs)-based text retrieval retrieves documents relevant to search queries based on vector similarities. Documents are pre-encoded offline, while queries arrive in real-time, necessitating an efficient online query encoder. Although LLMs significantly enhance retrieval capabili…