2025
OrthoRank: Token Selection via Sink Token Orthogonality for Efficient LLM inference
ICML 2025poster
Attention mechanisms are central to the success of large language models (LLMs), enabling them to capture intricate token dependencies and implicitly assign importance to each token. Recent studies have revealed the sink token, which receives disproportionately high attention despite their limited s…