← Search

Mandar Sharma

2 accepted papers

2024

Laying Anchors: Semantically Priming Numerals in Language Modeling

NAACL 2024findings

Off-the-shelf pre-trained language models have become the de facto standard in NLP pipelines for a multitude of downstream tasks. However, the inability of these models to properly encode numerals limits their performance on tasks requiring numeric comprehension. We introduce strategies to semantica…

2023

Learning Non-linguistic Skills without Sacrificing Linguistic Proficiency

ACL 2023long

The field of Math-NLP has witnessed significant growth in recent years, motivated by the desire to expand LLM performance to the leaning of non-linguistic notions (numerals, and subsequently, arithmetic reasoning). However, non-linguistic skill injection typically comes at a cost for LLMs: it leads…