← Search

Nikita Bhutani

11 accepted papers

2026

Same Content, Different Representations: A Controlled Study for Table QA

ICLR 2026poster

Table Question Answering (Table QA) in real-world settings must operate over both structured databases and semi-structured tables containing textual fields. However, existing benchmarks are tied to fixed data formats and have not systematically examined how representation itself affects model perfor…

Cited by 0SourcecodeScholar
2025

Efficient Context Selection for Long-Context QA: No Tuning, No Iteration, Just Adaptive‐k

EMNLP 2025

Retrieval-augmented generation (RAG) and long-context language models (LCLMs) both address context limitations of LLMs in open-domain QA. However, optimal external context to retrieve remains an open problem: fixed retrieval budgets risk wasting tokens or omitting key evidence. Existing adaptive met

Cited by 0SourcePDFScholar
2025

Evaluating Bias in LLMs for Job-Resume Matching: Gender, Race, and Education

NAACL 2025industry

Large Language Models (LLMs) offer the potential to automate hiring by matching job descriptions with candidate resumes, streamlining recruitment processes, and reducing operational costs. However, biases inherent in these models may lead to unfair hiring practices, reinforcing societal prejudices a…

2025

From Single to Multi: How LLMs Hallucinate in Multi-Document Summarization

NAACL 2025findings

Although many studies have investigated and reduced hallucinations in large language models (LLMs) for single-document tasks, research on hallucination in multi-document summarization (MDS) tasks remains largely unexplored. Specifically, it is unclear how the challenges arising from handling multipl…

2025

Holistic Reasoning with Long-Context LMs: A Benchmark for Database Operations on Massive Textual Data

ICLR 2025poster

The rapid increase in textual information means we need more efficient methods to sift through, organize, and understand it all. While retrieval-augmented generation (RAG) models excel in accessing information from large document collections, they struggle with complex tasks that require aggregation…

Cited by 1SourcePDFScholar
2025

Natural Language Processing for Human Resources: A Survey

NAACL 2025industry

Advances in Natural Language Processing (NLP) have the potential to transform HR processes, from recruitment to employee management. While recent breakthroughs in NLP have generated significant interest in its industrial applications, a comprehensive overview of how NLP can be applied across HR acti…

2024

Retrieval Helps or Hurts? A Deeper Dive into the Efficacy of Retrieval Augmentation to Language Models

NAACL 2024long

While large language models (LMs) demonstrate remarkable performance, they encounter challenges in providing accurate responses when queried for information beyond their pre-trained memorization. Although augmenting them with relevant external information can mitigate these issues, failure to consid…

2024

XATU: A Fine-grained Instruction-based Benchmark for Explainable Text Updates

COLING 2024main

Text editing is a crucial task of modifying text to better align with user intents. However, existing text editing benchmark datasets contain only coarse-grained instructions and lack explainability, thus resulting in outputs that deviate from the intended changes outlined in the gold reference. To…

2022

Can Edge Probing Tests Reveal Linguistic Knowledge in QA Models?

COLING 2022main

There have been many efforts to try to understand what grammatical knowledge (e.g., ability to understand the part of speech of a token) is encoded in large pre-trained language models (LM). This is done through ‘Edge Probing’ (EP) tests: supervised classification tasks to predict the grammatical pr…

Cited by 3SourcePDFScholar
2022

Low-resource Entity Set Expansion: A Comprehensive Study on User-generated Text

NAACL 2022findings

Entity set expansion (ESE) aims at obtaining a more complete set of entities given a textual corpus and a seed set of entities of a concept. Although it is a critical task in many NLP applications, existing benchmarks are limited to well-formed text (e.g., Wikipedia) and well-defined concepts (e.g.,…