← Search

Anirban Majumder

3 accepted papers

2026

PRECISE: Reducing the Bias of LLM Evaluations Using Prediction-Powered Ranking Estimation

AAAI 2026technical

Evaluating the quality of search systems traditionally requires a significant number of human relevance annotations. In recent times, several systems have explored the usage of Large Language Models (LLMs) as automated judges for this task while their inherent biases prevent direct use for metric es

Cited by 0SourcePDFScholar
2024

PEARL: Preference Extraction with Exemplar Augmentation and Retrieval with LLM Agents

EMNLP 2024industry

Identifying preferences of customers in their shopping journey is a pivotal aspect in providing product recommendations. The task becomes increasingly challenging when there is a multi-turn conversation between the user and a shopping assistant chatbot. In this paper, we tackle a novel and complex p…

2023

PROTEGE: Prompt-based Diverse Question Generation from Web Articles

EMNLP 2023long findings

Rich and diverse knowledge bases (KB) are foundational building blocks for online knowledge sharing communities such as StackOverflow and Quora, and applications such as conversational assistants (aka chatbots). A popular format for knowledge bases is question-answer pairs (or FAQs), where questions…

Cited by 0SourceScholar