← Search

Sebastian Joseph

3 accepted papers

2024

FactPICO: Factuality Evaluation for Plain Language Summarization of Medical Evidence

ACL 2024long

Plain language summarization with LLMs can be useful for improving textual accessibility of technical content. But how factual are these summaries in a high-stakes domain like medicine? This paper presents FactPICO, a factuality benchmark for plain language summarization of medical texts describing…

2024

InfoLossQA: Characterizing and Recovering Information Loss in Text Simplification

ACL 2024long

Text simplification aims to make technical texts more accessible to laypeople but often results in deletion of information and vagueness. This work proposes InfoLossQA, a framework to characterize and recover simplification-induced information loss in form of question-and-answer (QA) pairs. Building…

2023

Summarizing, Simplifying, and Synthesizing Medical Evidence using GPT-3 (with Varying Success)

ACL 2023short

Large language models, particularly GPT-3, are able to produce high quality summaries ofgeneral domain news articles in few- and zero-shot settings. However, it is unclear if such models are similarly capable in more specialized domains such as biomedicine. In this paper we enlist domain experts (in…