← Search

Benjamin Sznajder

5 accepted papers

2025

InspectorRAGet: An Introspection Platform for RAG Evaluation

NAACL 2025system demonstrations

Large Language Models (LLM) have become a popular approach for implementing Retrieval Augmented Generation (RAG) systems, and a significant amount of effort has been spent on building good models and metrics. In spite of increased recognition of the need for rigorous evaluation of RAG systems, few t…

2024

Label-Efficient Model Selection for Text Generation

ACL 2024long

Model selection for a given target task can be costly, as it may entail extensive annotation of the quality of outputs of different models. We introduce DiffUse, an efficient method to make an informed decision between candidate text generation models based on preference annotations. DiffUse reduces…

Cited by 4SourcePDFScholar
2023

The Benefits of Bad Advice: Autocontrastive Decoding across Model Layers

ACL 2023long

Applying language models to natural language processing tasks typically relies on the representations in the final model layer, as intermediate hidden layer representations are presumed to be less informative. In this work, we argue that due to the gradual improvement across model layers, additional…

2021

TWEETSUMM - A Dialog Summarization Dataset for Customer Service

EMNLP 2021finding

In a typical customer service chat scenario, customers contact a support center to ask for help or raise complaints, and human agents try to solve the issues. In most cases, at the end of the conversation, agents are asked to write a short summary emphasizing the problem and the proposed solution, u…

2021

Using Question Answering Rewards to Improve Abstractive Summarization

EMNLP 2021finding

Neural abstractive summarization models have drastically improved in the recent years. However, the summaries generated by these models generally suffer from issues such as: not capturing the critical facts in source documents, and containing facts that are inconsistent with the source documents. In…