← Search

Guergana K Savova

2 accepted papers

2025

WorldMedQA-V: a multilingual, multimodal medical examination dataset for multimodal language models evaluation

NAACL 2025findings

Multimodal/vision language models (VLMs) are increasingly being deployed in healthcare settings worldwide, necessitating robust benchmarks to ensure their safety, efficacy, and fairness. Multiple-choice question and answer (QA) datasets derived from national medical examinations have long served as…

2023

Measuring Pointwise $\mathcal{V}$-Usable Information In-Context-ly

EMNLP 2023long findings

In-context learning (ICL) is a new learning paradigm that has gained popularity along with the development of large language models. In this work, we adapt a recently proposed hardness metric, pointwise $\mathcal{V}$-usable information (PVI), to an in-context version (in-context PVI). Compared to th…

Cited by 0SourcecodeScholar