← Search

Rishav Hada

5 accepted papers

2024

MEGAVERSE: Benchmarking Large Language Models Across Languages, Modalities, Models and Tasks

NAACL 2024long

There has been a surge in LLM evaluation research to understand LLM capabilities and limitations. However, much of this research has been confined to English, leaving LLM building and evaluation for non-English languages relatively unexplored. Several new LLMs have been introduced recently, necessit…

2024

METAL: Towards Multilingual Meta-Evaluation

NAACL 2024findings

With the rising human-like precision of Large Language Models (LLMs) in numerous tasks, their utilization in a variety of real-world applications is becoming more prevalent. Several studies have shown that LLMs excel on many standard NLP benchmarks. However, it is challenging to evaluate LLMs due to…

2023

"Fifty Shades of Bias": Normative Ratings of Gender Bias in GPT Generated English Text

EMNLP 2023long main

Language serves as a powerful tool for the manifestation of societal belief systems. In doing so, it also perpetuates the prevalent biases in our society. Gender bias is one of the most pervasive biases in our society and is seen in online and offline discourses. With LLMs increasingly gaining human…

Cited by 0SourceScholar
2023

MEGA: Multilingual Evaluation of Generative AI

EMNLP 2023long main

Generative AI models have shown impressive performance on many Natural Language Processing tasks such as language understanding, reasoning, and language generation. An important question being asked by the AI community today is about the capabilities and limits of these models, and it is clear that…

Cited by 0SourceScholar
2021

Ruddit: Norms of Offensiveness for English Reddit Comments

ACL 2021long

On social media platforms, hateful and offensive language negatively impact the mental well-being of users and the participation of people from diverse backgrounds. Automatic methods to detect offensive language have largely relied on datasets with categorical labels. However, comments can vary in t…