← Search

Ori Shapira

11 accepted papers

2025

Measuring the Effect of Transcription Noise on Downstream Language Understanding Tasks

ACL 2025long

With the increasing prevalence of recorded human speech, spoken language understanding (SLU) is essential for its efficient processing. In order to process the speech, it is commonly transcribed using automatic speech recognition technology. This speech-to-text transition introduces errors into the…

2024

Quality Matters: Evaluating Synthetic Data for Tool-Using LLMs

EMNLP 2024main

Training large language models (LLMs) for external tool usage is a rapidly expanding field, with recent research focusing on generating synthetic data to address the shortage of available data. However, the absence of systematic data quality checks poses complications for properly training and testi…

Cited by 1SourcePDFScholar
2024

The Power of Summary-Source Alignments

ACL 2024findings

Multi-document summarization (MDS) is a challenging task, often decomposed to subtasks of salience and redundancy detection, followed by text generation.In this context, alignment of corresponding sentences between a reference summary and its source documents has been leveraged to generate training…

2023

OpenAsp: A Benchmark for Multi-document Open Aspect-based Summarization

EMNLP 2023long main

The performance of automatic summarization models has improved dramatically in recent years. Yet, there is still a gap in meeting specific information needs of users in real-world scenarios, particularly when a targeted summary is sought, such as in the useful aspect-based summarization setting targ…

Cited by 0SourcecodeScholar
2023

Re-Examining Summarization Evaluation across Multiple Quality Criteria

EMNLP 2023short findings

The common practice for assessing automatic evaluation metrics is to measure the correlation between their induced system rankings and those obtained by reliable human evaluation, where a higher correlation indicates a better metric. Yet, an intricate setting arises when an NLP task is evaluated by…

Cited by 0SourceScholar
2022

Interactive Query-Assisted Summarization via Deep Reinforcement Learning

NAACL 2022long

Interactive summarization is a task that facilitates user-guided exploration of information within a document set. While one would like to employ state of the art neural models to improve the quality of interactive summarization, many such technologies cannot ingest the full document set or cannot o…

2022

McPhraSy: Multi-Context Phrase Similarity and Clustering

EMNLP 2022finding

Phrase similarity is a key component of many NLP applications. Current phrase similarity methods focus on embedding the phrase itself and use the phrase context only during training of the pretrained model. To better leverage the information in the context, we propose McPhraSy (Multi-context Phrase…

Cited by 5SourcePDFScholar
2022

Proposition-Level Clustering for Multi-Document Summarization

NAACL 2022long

Text clustering methods were traditionally incorporated into multi-document summarization (MDS) as a means for coping with considerable information repetition. Particularly, clusters were leveraged to indicate information saliency as well as to avoid redundancy. Such prior methods focused on cluster…

2021

Extending Multi-Document Summarization Evaluation to the Interactive Setting

NAACL 2021long

Allowing users to interact with multi-document summarizers is a promising direction towards improving and customizing summary results. Different ideas for interactive summarization have been proposed in previous work but these solutions are highly divergent and incomparable. In this paper, we develo…

2021

iFacetSum: Coreference-based Interactive Faceted Summarization for Multi-Document Exploration

EMNLP 2021system demonstrations

We introduce iFᴀᴄᴇᴛSᴜᴍ, a web application for exploring topical document collections. iFᴀᴄᴇᴛSᴜᴍ integrates interactive summarization together with faceted search, by providing a novel faceted navigation scheme that yields abstractive summaries for the user’s selections. This approach offers both a c…