Shreshta Bhat

Polyglot or Not? Measuring Multilingual Encyclopedic Knowledge in Foundation Models

In this work, we assess the ability of foundation models to recall encyclopedic knowledge across a wide range of linguistic contexts. To support this, we: 1) produce a 20-language dataset that contains 303k factual associations paired with counterfactuals, 2) evaluate 5 models in a multilingual test…