← Search

Manish Shrivastava

18 accepted papers

2025

Analyzing (In)Abilities of SAEs via Formal Languages

NAACL 2025long

Autoencoders have been used for finding interpretable and disentangled features underlying neural network representations in both image and text domains. While the efficacy and pitfalls of such methods are well-studied in vision, there is a lack of corresponding results, both qualitative and quantit…

2025

BRIGHTER: BRIdging the Gap in Human-Annotated Textual Emotion Recognition Datasets for 28 Languages

ACL 2025long

People worldwide use language in subtle and complex ways to express emotions. Although emotion recognition–an umbrella term for several NLP tasks–impacts various applications within NLP and beyond, most work in this area has focused on high-resource languages. This has led to significant disparities…

2025

Correlating instruction-tuning (in multimodal models) with vision-language processing (in the brain)

ICLR 2025poster

Transformer-based language models, though not explicitly trained to mimic brain recordings, have demonstrated surprising alignment with brain activity. Progress in these models—through increased size, instruction-tuning, and multimodality—has led to better representational alignment with neural data…

2025

MAPWise: Evaluating Vision-Language Models for Advanced Map Queries

NAACL 2025long

Vision-language models (VLMs) excel at tasks requiring joint understanding of visual and linguistic information. A particularly promising yet under-explored application for these models lies in answering questions based on various kinds of maps. This study investigates the efficacy of VLMs in answer…

2025

TabXEval: Why this is a Bad Table? An eXhaustive Rubric for Table Evaluation

ACL 2025finding

Evaluating tables qualitatively and quantitatively poses a significant challenge, as standard metrics often overlook subtle structural and content-level discrepancies. To address this, we propose a rubric-based evaluation framework that integrates multi-level structural descriptors with fine-grained…

2025

Why should only High-Resource-Languages have all the fun? Pivot Based Evaluation in Low Resource Setting

COLING 2025main

Evaluating machine translation (MT) systems for low-resource languages has long been a challenge due to the limited availability of evaluation metrics and resources. As a result, researchers in this space have relied primarily on lexical-based metrics like BLEU, TER, and ChrF, which lack semantic ev…

2024

Knowledge-Aware Reasoning over Multimodal Semi-structured Tables

EMNLP 2024finding

Existing datasets for tabular question answering typically focus exclusively on text within cells. However, real-world data is inherently multimodal, often blending images such as symbols, faces, icons, patterns, and charts with textual content in tables. With the evolution of AI models capable of m…

Cited by 3SourcePDFScholar
2024

SemRel2024: A Collection of Semantic Textual Relatedness Datasets for 13 Languages

ACL 2024findings

Exploring and quantifying semantic relatedness is central to representing language and holds significant implications across various NLP tasks. While earlier NLP research primarily focused on semantic similarity, often within the English language context, we instead investigate the broader phenomeno…

2024

TeClass: A Human-Annotated Relevance-based Headline Classification and Generation Dataset for Telugu

COLING 2024main

News headline generation is a crucial task in increasing productivity for both the readers and producers of news. This task can easily be aided by automated News headline-generation models. However, the presence of irrelevant headlines in scraped news articles results in sub-optimal performance of g…

2023

PMIndiaSum: Multilingual and Cross-lingual Headline Summarization for Languages in India

EMNLP 2023long findings

This paper introduces PMIndiaSum, a multilingual and massively parallel summarization corpus focused on languages in India. Our corpus provides a training and testing ground for four language families, 14 languages, and the largest to date with 196 language pairs. We detail our construction workflow…

Cited by 0SourcecodeScholar
2023

X-RiSAWOZ: High-Quality End-to-End Multilingual Dialogue Datasets and Few-shot Agents

ACL 2023findings

Task-oriented dialogue research has mainly focused on a few popular languages like English and Chinese, due to the high dataset creation cost for a new language. To reduce the cost, we apply manual editing to automatically translated data. We create a new multilingual benchmark, X-RiSAWOZ, by transl…

2022

Bilingual Tabular Inference: A Case Study on Indic Languages

NAACL 2022long

Existing research on Tabular Natural Language Inference (TNLI) exclusively examines the task in a monolingual setting where the tabular premise and hypothesis are in the same language. However, due to the uneven distribution of text resources on the web across languages, it is common to have the tab…

Cited by 1SourcePDFScholar
2022

Diverse Multi-Answer Retrieval with Determinantal Point Processes

COLING 2022main

Often questions provided to open-domain question answering systems are ambiguous. Traditional QA systems that provide a single answer are incapable of answering ambiguous questions since the question may be interpreted in several ways and may have multiple distinct answers. In this paper, we address…

Cited by 1SourcePDFScholar
2022

DocInfer: Document-level Natural Language Inference using Optimal Evidence Selection

EMNLP 2022main

We present DocInfer - a novel, end-to-end Document-level Natural Language Inference model that builds a hierarchical document graph enriched through inter-sentence relations (topical, entity-based, concept-based), performs paragraph pruning using the novel SubGraph Pooling layer, followed by optimal…

2022

Leveraging Data Recasting to Enhance Tabular Reasoning

EMNLP 2022finding

Creating challenging tabular inference data is essential for learning complex reasoning. Prior work has mostly relied on two data generation strategies. The first is human annotation, which yields linguistically diverse data but is difficult to scale. The second category for creation is synthetic ge…

Cited by 7SourcePDFScholar
2022

SyMCoM - Syntactic Measure of Code Mixing A Study Of English-Hindi Code-Mixing

ACL 2022findings

Code mixing is the linguistic phenomenon where bilingual speakers tend to switch between two or more languages in conversations. Recent work on code-mixing in computational settings has leveraged social media code mixed texts to train NLP models. For capturing the variety of code mixing in, and acro…

Cited by 8SourcePDFScholar
2020

AbuseAnalyzer: Abuse Detection, Severity and Target Prediction for Gab Posts

COLING 2020main

While extensive popularity of online social media platforms has made information dissemination faster, it has also resulted in widespread online abuse of different types like hate speech, offensive language, sexist and racist opinions, etc. Detection and curtailment of such abusive content is critic…

2020

Creation of Corpus and analysis in Code-Mixed Kannada-English Twitter data for Emotion Prediction

COLING 2020main

Emotion prediction is a critical task in the field of Natural Language Processing (NLP). There has been a significant amount of work done in emotion prediction for resource-rich languages. There has been work done on code-mixed social media corpus but not on emotion prediction of Kannada-English cod…