← Search

Zhanyue Qin

3 accepted papers

2026

How Stable is the Next Token? A Geometric View of LLM Prediction Stability

ICLR 2026poster

Large Language Models (LLMs) exhibit impressive capabilities yet suffer from sensitivity to slight input context variations, hampering reliability. Conventional metrics like accuracy and perplexity fail to assess local prediction robustness, as normalized output probabilities can obscure the underly…

Cited by 0SourceScholar
2024

Pruning via Merging: Compressing LLMs via Manifold Alignment Based Layer Merging

EMNLP 2024main

While large language models (LLMs) excel in many domains, their complexity and scale challenge deployment in resource-limited environments. Current compression techniques, such as parameter pruning, often fail to effectively utilize the knowledge from pruned parameters. To address these challenges,…

2024

UNO Arena for Evaluating Sequential Decision-Making Capability of Large Language Models

EMNLP 2024main

Sequential decision-making refers to algorithms that take into account the dynamics of the environment, where early decisions affect subsequent decisions. With large language models (LLMs) demonstrating powerful capabilities between tasks, we can’t help but ask: Can Current LLMs Effectively Make Seq…

Cited by 2SourcePDFScholar