BATS: BenchmArking Text Simplicity 🦇
Christin Kreutz, Fabian Haak, Björn Engelmann, Philipp Schaer
Abstract
Evaluation of text simplification currently focuses on the difference of a source text to its simplified variant. Datasets for this evaluation base on a specific topic and group of readers for which is simplified. The broad applicability of text simplification and specifics that come with intended target audiences (e.g., children compared to adult non-experts) are disregarded. An explainable assessment of the overall simplicity of text is missing. This work is BenchmArking Text Simplicity (BATS): we provide an explainable method to assess practical and concrete rules from literature describing features of simplicity and complexity of text. Our experiments on 15 datasets for text simplification highlight differences in features that are important in different domains of text and for different intended target audiences.
BibTeX
@inproceedings{kreutz-etal-2024-bats,
title = "{BATS}: {B}enchm{A}rking Text Simplicity 🦇",
author = {Kreutz, Christin and
Haak, Fabian and
Engelmann, Bj{\"o}rn and
Schaer, Philipp},
editor = "Ku, Lun-Wei and
Martins, Andre and
Srikumar, Vivek",
booktitle = "Findings of the Association for Computational Linguistics: ACL 2024",
month = aug,
year = "2024",
address = "Bangkok, Thailand",
publisher = "Association for Computational Linguistics",
url = "https://aclanthology.org/2024.findings-acl.712/",
doi = "10.18653/v1/2024.findings-acl.712",
pages = "11968--11989"
}