2025
Brevity is the soul of sustainability: Characterizing LLM response lengths
ACL 2025finding
A significant portion of the energy consumed by Large Language Models (LLMs) arises from their inference processes; hence developing energy-efficient methods for inference is crucial. While several techniques exist for inference optimization, output compression remains relatively unexplored, with on…