Inez Hua

Unveiling Environmental Impacts of Large Language Model Serving: A Functional Unit View

Large language models (LLMs) offer powerful capabilities but come with significant environmental impact, particularly in carbon emissions. Existing studies benchmark carbon emissions but lack a standardized basis for comparison across different model configurations. To address this, we introduce the…