Oliver Bentham

Beyond Perplexity: Multi-dimensional Safety Evaluation of LLM Compression

Increasingly, model compression techniques enable large language models (LLMs) to be deployed in real-world applications. As a result of this momentum towards local deployment, compressed LLMs will interact with a large population. Prior work on compression typically prioritize preserving perplexity…