← Search

Kuan Zhu

6 accepted papers

2026

Improving Generalization in LLM Structured Pruning via Function-Aware Neuron Grouping

AAAI 2026technical

Large Language Models (LLMs) demonstrate impressive performance across natural language tasks but incur substantial computational and storage costs due to their scale. Post-training structured pruning offers an efficient solution. However, when few-shot calibration sets fail to adequately reflect th

Cited by 0SourcePDFScholar
2026

ReST-KV: Robust KV Cache Eviction with Layer-wise Output Reconstruction and Spatial-Temporal Smoothing

ICLR 2026poster

Large language models (LLMs) face growing challenges in efficient generative inference due to the increasing memory demands of Key-Value (KV) caches, especially for long sequences. Existing eviction methods typically retain KV pairs with high attention weights but overlook the impact of attention re…

Cited by 0SourcecodeScholar
2025

Cracking the Code of Hallucination in LVLMs with Vision-aware Head Divergence

ACL 2025long

Large vision-language models (LVLMs) have made substantial progress in integrating large language models (LLMs) with visual inputs, enabling advanced multimodal reasoning. Despite their success, a persistent challenge is hallucination—where generated text fails to accurately reflect visual content—u…

2024

SEEKR: Selective Attention-Guided Knowledge Retention for Continual Learning of Large Language Models

EMNLP 2024main

Continual learning (CL) is crucial for language models to dynamically adapt to the evolving real-world demands. To mitigate the catastrophic forgetting problem in CL, data replay has been proven a simple and effective strategy, and the subsequent data-replay-based distillation can further enhance th…

2022

PASS: Part-Aware Self-Supervised Pre-training for Person Re-identification

ECCV 2022poster

"In person re-identification (ReID), very recent researches have validated pre-training the models on unlabelled person images is much better than on ImageNet. However, these researches directly apply the existing self-supervised learning (SSL) methods designed for image classification to ReID witho…

2020

Identity-Guided Human Semantic Parsing for Person Re-Identification

ECCV 2020poster

Existing alignment-based methods have to employ the pre-trained human parsing models to achieve the pixel-level alignment, and cannot identify the personal belongings (e.g., backpacks and reticule) which are crucial to person re-ID. In this paper, we propose the identity-guided human semantic parsin…