← Search

Chong-Yan Chen

2 accepted papers

2025

FLRC: Fine-grained Low-Rank Compressor for Efficient LLM Inference

EMNLP 2025

Although large language models (LLM) have achieved remarkable performance, their enormous parameter counts hinder deployment on resource-constrained hardware. Low-rank compression can reduce both memory usage and computational demand, but applying a uniform compression ratio across all layers often

Cited by 0SourcePDFScholar
2025

Palu: KV-Cache Compression with Low-Rank Projection

ICLR 2025poster

Post-training KV-Cache compression methods typically either sample a subset of effectual tokens or quantize the data into lower numerical bit width. However, these methods cannot exploit redundancy in the hidden dimension of the KV tenors. This paper presents a hidden dimension compression approach…