← Search

Mitesh Khapra

8 accepted papers

2024

How Good is Zero-Shot MT Evaluation for Low Resource Indian Languages?

ACL 2024short

While machine translation evaluation has been studied primarily for high-resource languages, there has been a recent interest in evaluation for low-resource languages due to the increasing availability of data and models. In this paper, we focus on a zero-shot evaluation setting focusing on low-reso…

2024

IndicVoices: Towards building an Inclusive Multilingual Speech Dataset for Indian Languages

ACL 2024findings

We present INDICVOICES, a dataset of natural and spontaneous speech containing a total of 7348 hours of read (9%), extempore (74%) and conversational (17%) audio from 16237 speakers covering 145 Indian districts and 22 languages. Of these 7348 hours, 1639 hours have already been transcribed, with a…

2022

Active Evaluation: Efficient NLG Evaluation with Few Pairwise Comparisons

ACL 2022long

Recent studies have shown the advantages of evaluating NLG systems using pairwise comparisons as opposed to direct assessment. Given k systems, a naive approach for identifying the top-ranked system would be to uniformly obtain pairwise comparisons from all k \choose 2 pairs of systems. However, thi…

2022

IndicBART: A Pre-trained Model for Indic Natural Language Generation

ACL 2022findings

In this paper, we study pre-trained sequence-to-sequence models for a group of related languages, with a focus on Indic languages. We present IndicBART, a multilingual, sequence-to-sequence pre-trained model focusing on 11 Indic languages and English. IndicBART utilizes the orthographic similarity b…

2022

Input-specific Attention Subnetworks for Adversarial Detection

ACL 2022findings

Self-attention heads are characteristic of Transformer models and have been well studied for interpretability and pruning. In this work, we demonstrate an altogether different utility of attention heads, namely for adversarial detection. Specifically, we propose a method to construct input-specific…

2022

OpenHands: Making Sign Language Recognition Accessible with Pose-based Pretrained Models across Languages

ACL 2022long

AI technologies for Natural Languages have made tremendous progress recently. However, commensurate progress has not been made on Sign Languages, in particular, in recognizing signs as individual words or as complete sentences. We introduce OpenHands, a library where we take four key ideas from the…

Cited by 59SourcePDFScholar
2018

On Controllable Sparse Alternatives to Softmax

NeurIPS 2018poster

Converting an n-dimensional vector to a probability distribution over n objects is a commonly used component in many machine learning tasks like multiclass classification, multilabel classification, attention mechanisms etc. For this, several probability mapping functions have been proposed and empl…

Cited by 76SourcePDFScholar