← Search

Sagnik Ray Choudhury

5 accepted papers

2025

BAGELS: Benchmarking the Automated Generation and Extraction of Limitations from Scholarly Text

EMNLP 2025

In scientific research, “limitations” refer to the shortcomings, constraints, or weaknesses of a study. A transparent reporting of such limitations can enhance the quality and reproducibility of research and improve public trust in science. However, authors often underreport limitations in their pap

2022

Can Edge Probing Tests Reveal Linguistic Knowledge in QA Models?

COLING 2022main

There have been many efforts to try to understand what grammatical knowledge (e.g., ability to understand the part of speech of a token) is encoded in large pre-trained language models (LM). This is done through ‘Edge Probing’ (EP) tests: supervised classification tasks to predict the grammatical pr…

Cited by 3SourcePDFScholar
2022

Machine Reading, Fast and Slow: When Do Models “Understand” Language?

COLING 2022main

Two of the most fundamental issues in Natural Language Understanding (NLU) at present are: (a) how it can established whether deep learning-based models score highly on NLU benchmarks for the ”right” reasons; and (b) what those reasons would even be. We investigate the behavior of reading comprehens…

Cited by 17SourcePDFScholar
2021

Intent Features for Rich Natural Language Understanding

NAACL 2021industry

Complex natural language understanding modules in dialog systems have a richer understanding of user utterances, and thus are critical in providing a better user experience. However, these models are often created from scratch, for specific clients and use cases and require the annotation of large d…