Max Meuer

Divergent Token Metrics: Measuring degradation to prune away LLM components – and optimize quantization

Large Language Models (LLMs) have reshaped natural language processing with their impressive capabilities. However, their ever-increasing size has raised concerns about their effective deployment and the need for LLM compression. This study introduces the Divergent Token Metrics (DTMs), a novel appr…