← Search

Aaran Arulraj

2 accepted papers

2024

MMLU-Pro: A More Robust and Challenging Multi-Task Language Understanding Benchmark

NeurIPS 2024spotlight

In the age of large-scale language models, benchmarks like the Massive Multitask Language Understanding (MMLU) have been pivotal in pushing the boundaries of what AI can achieve in language comprehension and reasoning across diverse domains. However, as models continue to improve, their performance…

Cited by 269SourcePDFScholar
2024

VideoScore: Building Automatic Metrics to Simulate Fine-grained Human Feedback for Video Generation

EMNLP 2024main

The recent years have witnessed great advances in video generation. However, the development of automatic video metrics is lagging significantly behind. None of the existing metric is able to provide reliable scores over generated videos. The main barrier is the lack of large-scale human-annotated d…