Manan Goenka

Ditch the Gold Standard: Re-evaluating Conversational Question Answering

Conversational question answering aims to provide natural-language answers to users in information-seeking conversations. Existing conversational QA benchmarks compare models with pre-collected human-human conversations, using ground-truth answers provided in conversational history. It remains uncle…