Mingying Yu

BenchIE: A Framework for Multi-Faceted Fact-Based Open Information Extraction Evaluation

Intrinsic evaluations of OIE systems are carried out either manually—with human evaluators judging the correctness of extractions—or automatically, on standardized benchmarks. The latter, while much more cost-effective, is less reliable, primarily because of the incompleteness of the existing OIE be…