← Search

Nikolaj Munch

2 accepted papers

2024

Cross-Care: Assessing the Healthcare Implications of Pre-training Data on Language Model Bias

NeurIPS 2024poster

Large language models (LLMs) are increasingly essential in processing natural languages, yet their application is frequently compromised by biases and inaccuracies originating in their training data. In this study, we introduce \textbf{Cross-Care}, the first benchmark framework dedicated to assessin…

2024

Language Models are Surprisingly Fragile to Drug Names in Biomedical Benchmarks

EMNLP 2024finding

Medical knowledge is context-dependent and requires consistent reasoning across various natural language expressions of semantically equivalent phrases. This is particularly crucial for drug names, where patients often use brand names like Advil or Tylenol instead of their generic equivalents. To st…