← Search

Jan Trienes

4 accepted papers

2025

Behavioral Analysis of Information Salience in Large Language Models

ACL 2025finding

Large Language Models (LLMs) excel at text summarization, a task that requires models to select content based on its importance. However, the exact notion of salience that LLMs have internalized remains unclear. To bridge this gap, we introduce an explainable framework to systematically derive and i…

2024

Comprehensive Study on German Language Models for Clinical and Biomedical Text Understanding

COLING 2024main

Recent advances in natural language processing (NLP) can be largely attributed to the advent of pre-trained language models such as BERT and RoBERTa. While these models demonstrate remarkable performance on general datasets, they can struggle in specialized domains such as medicine, where unique dom…

Cited by 7SourcePDFScholar
2024

FactPICO: Factuality Evaluation for Plain Language Summarization of Medical Evidence

ACL 2024long

Plain language summarization with LLMs can be useful for improving textual accessibility of technical content. But how factual are these summaries in a high-stakes domain like medicine? This paper presents FactPICO, a factuality benchmark for plain language summarization of medical texts describing…

2024

InfoLossQA: Characterizing and Recovering Information Loss in Text Simplification

ACL 2024long

Text simplification aims to make technical texts more accessible to laypeople but often results in deletion of information and vagueness. This work proposes InfoLossQA, a framework to characterize and recover simplification-induced information loss in form of question-and-answer (QA) pairs. Building…