← Search

Yuli Slavutsky

5 accepted papers

2024

CONTESTS: a Framework for Consistency Testing of Span Probabilities in Language Models

EMNLP 2024main

Although language model scores are often treated as probabilities, their reliability as probability estimators has mainly been studied through calibration, overlooking other aspects. In particular, it is unclear whether language models produce the same value for different ways of assigning joint pro…

Cited by 0SourcePDFScholar
2024

Class Distribution Shifts in Zero-Shot Learning: Learning Robust Representations

NeurIPS 2024poster

Zero-shot learning methods typically assume that the new, unseen classes encountered during deployment come from the same distribution as the the classes in the training set. However, real-world scenarios often involve class distribution shifts (e.g., in age or gender for person identification), pos…