De-Identification of Sensitive Personal Data in Datasets Derived from IIT-CDIP
Stefan Larson, Nicole Cornehl Lima, Santiago Pedroza Diaz, Amogh Manoj Joshi, Siddharth Betala, Jamiu Tunde Suleiman, Yash Mathur, Kaushal Kumar Prajapati
Abstract
The IIT-CDIP document collection is the source of several widely used and publicly accessible document understanding datasets. In this paper, manual inspection of 5 datasets derived from IIT-CDIP uncovers the presence of thousands of instances of sensitive personal data, including US Social Security Numbers (SSNs), birth places and dates, and home addresses of individuals. The presence of such sensitive personal data in commonly-used and publicly available datasets is startling and has ethical and potentially legal implications; we believe such sensitive data ought to be removed from the internet. Thus, in this paper, we develop a modular data de-identification pipeline that replaces sensitive data with synthetic, but realistic, data. Via experiments, we demonstrate that this de-identification method preserves the utility of the de-identified documents so that they can continue be used in various document understanding applications. We will release redacted versions of these datasets publicly.
BibTeX
@inproceedings{larson-etal-2024-de,
title = "De-Identification of Sensitive Personal Data in Datasets Derived from {IIT}-{CDIP}",
author = "Larson, Stefan and
Lima, Nicole Cornehl and
Diaz, Santiago Pedroza and
Joshi, Amogh Manoj and
Betala, Siddharth and
Suleiman, Jamiu Tunde and
Mathur, Yash and
Prajapati, Kaushal Kumar and
Alakraa, Ramla and
Shen, Junjie and
Okotore, Temi and
Leach, Kevin",
editor = "Al-Onaizan, Yaser and
Bansal, Mohit and
Chen, Yun-Nung",
booktitle = "Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing",
month = nov,
year = "2024",
address = "Miami, Florida, USA",
publisher = "Association for Computational Linguistics",
url = "https://aclanthology.org/2024.emnlp-main.1198/",
doi = "10.18653/v1/2024.emnlp-main.1198",
pages = "21494--21505"
}