← Search

Karmanya Aggarwal

2 accepted papers

2023

FIREBALL: A Dataset of Dungeons and Dragons Actual-Play with Structured Game State Information

ACL 2023long

Dungeons & Dragons (D&D) is a tabletop roleplaying game with complex natural language interactions between players and hidden state information. Recent work has shown that large language models (LLMs) that have access to state information can generate higher quality game turns than LLMs that use dia…

2021

Does Putting a Linguist in the Loop Improve NLU Data Collection?

EMNLP 2021finding

Many crowdsourced NLP datasets contain systematic artifacts that are identified only after data collection is complete. Earlier identification of these issues should make it easier to create high-quality training and evaluation data. We attempt this by evaluating protocols in which expert linguists…

Cited by 46SourcePDFScholar