2025
Two Steps from Hell: Compositionality on Chemical LMs
EMNLP 2025
This paper investigates compositionality in chemical language models (ChemLLMs). We introduce STEPS, a benchmark with compositional questions that reflect intricate chemical structures and reactions, to evaluate models’ understanding of chemical language. Our approach focuses on identifying and anal