2024
Information Parity: Measuring and Predicting the Multilingual Capabilities of Language Models
EMNLP 2024finding
Large Language Models (LLMs) are increasingly deployed in user-facing applications worldwide, necessitating handling multiple languages across various tasks. We propose a metric called Information Parity (IP) that can predict an LLM’s capabilities across multiple languages in a task-agnostic manner.…