Tamsin Emily James

Exploring the Limits of Fine-grained LLM-based Physics Inference via Premise Removal Interventions

Language models (LMs) can hallucinate when performing complex mathematical reasoning. Physics provides a rich domain for assessing their mathematical capabilities, where physical context requires that any symbolic manipulation satisfies complex semantics (e.g., units, tensorial order). In this work,…