← Search

Geoffrey Scoutheeten

2 accepted papers

2021

Data-QuestEval: A Referenceless Metric for Data-to-Text Semantic Evaluation

EMNLP 2021main

QuestEval is a reference-less metric used in text-to-text tasks, that compares the generated summaries directly to the source text, by automatically asking and answering questions. Its adaptation to Data-to-Text tasks is not straightforward, as it requires multimodal Question Generation and Answerin…

2021

Separating Retention from Extraction in the Evaluation of End-to-end Relation Extraction

EMNLP 2021main

State-of-the-art NLP models can adopt shallow heuristics that limit their generalization capability (McCoy et al., 2019). Such heuristics include lexical overlap with the training set in Named-Entity Recognition (Taille et al., 2020) and Event or Type heuristics in Relation Extraction (Rosenman et a…