Jackson Pond

Language Models are Surprisingly Fragile to Drug Names in Biomedical Benchmarks

Medical knowledge is context-dependent and requires consistent reasoning across various natural language expressions of semantically equivalent phrases. This is particularly crucial for drug names, where patients often use brand names like Advil or Tylenol instead of their generic equivalents. To st…