EMNLP 2021finding118 citations
Progressive Transformer-Based Generation of Radiology Reports
Farhad Nooralahzadeh, Nicolas Perez Gonzalez, Thomas Frauenfelder, Koji Fujimoto, Michael Krauthammer
Abstract
Inspired by Curriculum Learning, we propose a consecutive (i.e., image-to-text-to-text) generation framework where we divide the problem of radiology report generation into two steps. Contrary to generating the full radiology report from the image at once, the model generates global concepts from the image in the first step and then reforms them into finer and coherent texts using transformer-based architecture. We follow the transformer-based sequence-to-sequence paradigm at each step. We improve upon the state-of-the-art on two benchmark datasets.
BibTeX
@inproceedings{nooralahzadeh-etal-2021-progressive-transformer,
title = "Progressive Transformer-Based Generation of Radiology Reports",
author = "Nooralahzadeh, Farhad and
Perez Gonzalez, Nicolas and
Frauenfelder, Thomas and
Fujimoto, Koji and
Krauthammer, Michael",
editor = "Moens, Marie-Francine and
Huang, Xuanjing and
Specia, Lucia and
Yih, Scott Wen-tau",
booktitle = "Findings of the Association for Computational Linguistics: EMNLP 2021",
month = nov,
year = "2021",
address = "Punta Cana, Dominican Republic",
publisher = "Association for Computational Linguistics",
url = "https://aclanthology.org/2021.findings-emnlp.241/",
doi = "10.18653/v1/2021.findings-emnlp.241",
pages = "2824--2832"
}