2024
Sprout: Green Generative AI with Carbon-Efficient LLM Inference
EMNLP 2024main
The rapid advancement of generative AI has heightened environmental concerns, particularly regarding carbon emissions. Our framework, Sprout, addresses these challenges by reducing the carbon footprint of inference in large language models (LLMs). Sprout introduces “generation directives” to guide t…