MEGAVERSE: Benchmarking Large Language Models Across Languages, Modalities, Models and Tasks
There has been a surge in LLM evaluation research to understand LLM capabilities and limitations. However, much of this research has been confined to English, leaving LLM building and evaluation for non-English languages relatively unexplored. Several new LLMs have been introduced recently, necessit…