Retaining Key Information under High Compression Ratios: Query-Guided Compressor for LLMs
The growing popularity of Large Language Models has sparked interest in context compression for Large Language Models (LLMs). However, the performance of previous methods degrades dramatically as compression ratios increase, sometimes even falling to the closed-book level. This decline can be attrib…