Saurabh Kumar Pandey — accepted AI-conference papers

2026

Measuring Meta-Cultural Competency: A Spectral Framework for LLM Knowledge Structures

Sougata Saha, Madhur Jindal, Saurabh Kumar Pandey, Mahardika Ihsani, Alham Fikri Aji, Monojit Choudhury

ICML 2026poster

Most existing cultural evaluation frameworks for large language models (LLMs) focus on matching model outputs to ground-truth answers, primarily measuring factual cultural awareness. This overlooks whether models internalize broader cultural structure and pluralism. We introduce a spectral-analysis-…

Cited by 0 Source ↗Scholar ↗

2025

CULTURALLY YOURS: A Reading Assistant for Cross-Cultural Content

Saurabh Kumar Pandey, Harshit Budhiraja, Sougata Saha, Monojit Choudhury

COLING 2025system demonstrations

Users from diverse cultural backgrounds frequently face challenges in understanding content from various online sources that are written by people from a different culture. This paper presents CULTURALLY YOURS (CY), a first-of-its-kind cultural reading assistant tool designed to identify culture-spe…

Cited by 2 Source ↗PDF ↗code ↗Scholar ↗

2025

Meta-Cultural Competence: Climbing the Right Hill of Cultural Awareness

Sougata Saha, Saurabh Kumar Pandey, Monojit Choudhury

NAACL 2025long

Numerous recent studies have shown that Large Language Models (LLMs) are biased towards a Western and Anglo-centric worldview, which compromises their usefulness in non-Western cultural settings. However, “culture” is a complex, multifaceted topic, and its awareness, representation, and modeling in…

Cited by 0 Source ↗PDF ↗Scholar ↗

2025

Reading between the Lines: Can LLMs Identify Cross-Cultural Communication Gaps?

Sougata Saha, Saurabh Kumar Pandey, Harshit Gupta, Monojit Choudhury

NAACL 2025long

In a rapidly globalizing and digital world, content such as book and product reviews created by people from diverse cultures are read and consumed by others from different corners of the world. In this paper, we investigate the extent and patterns of gaps in understandability of book reviews due to…

Cited by 0 Source ↗PDF ↗code ↗Scholar ↗

2025

SMAB: MAB based word Sensitivity Estimation Framework and its Applications in Adversarial Text Generation

Saurabh Kumar Pandey, Sachin Vashistha, Debrup Das, Somak Aditya, Monojit Choudhury

NAACL 2025long

To understand the complexity of sequence classification tasks, Hahn et al. (2021) proposed sensitivity as the number of disjoint subsets of the input sequence that can each be individually changed to change the output. Though effective, calculating sensitivity at scale using this framework is costly…

Cited by 0 Source ↗PDF ↗code ↗Scholar ↗

2024

Evaluating ChatGPT against Functionality Tests for Hate Speech Detection

Mithun Das, Saurabh Kumar Pandey, Animesh Mukherjee

COLING 2024main

Large language models like ChatGPT have recently shown a great promise in performing several tasks, including hate speech detection. However, it is crucial to comprehend the limitations of these models to build robust hate speech detection systems. To bridge this gap, our study aims to evaluate the…

Cited by 4 Source ↗PDF ↗Scholar ↗

2023

CONTRASTE: Supervised Contrastive Pre-training With Aspect-based Prompts For Aspect Sentiment Triplet Extraction

Rajdeep Mukherjee, Nithish Kannen, Saurabh Kumar Pandey, Pawan Goyal

EMNLP 2023long findings

Existing works on Aspect Sentiment Triplet Extraction (ASTE) explicitly focus on developing more efficient fine-tuning techniques for the task. Instead, our motivation is to come up with a generic approach that can improve the downstream performances of multiple ABSA tasks simultaneously. Towards th…

Cited by 0 Source ↗code ↗Scholar ↗