Gareth Jones — accepted AI-conference papers

2022

Achieving Reliable Human Assessment of Open-Domain Dialogue Systems

Tianbo Ji, Yvette Graham, Gareth Jones, Chenyang Lyu, Qun Liu

ACL 2022long

Evaluation of open-domain dialogue systems is highly challenging and development of better techniques is highlighted time and again as desperately needed. Despite substantial efforts to carry out reliable live evaluation of systems in recent competitions, annotations have been abandoned and reported…

Cited by 47 Source ↗PDF ↗code ↗Scholar ↗

2020

100,000 Podcasts: A Spoken English Document Corpus

Ann Clifton, Sravana Reddy, Yongze Yu, Aasish Pappu, Rezvaneh Rezapour, Hamed Bonab +5

COLING 2020main

Podcasts are a large and growing repository of spoken audio. As an audio format, podcasts are more varied in style and production type than broadcast news, contain more genres than typically studied in video data, and are more varied in style and format than previous corpora of conversations. When t…

Cited by 126 Source ↗PDF ↗code ↗Scholar ↗