← Search

Shubhra Kanti Karmaker Santu

5 accepted papers

2023

TELeR: A General Taxonomy of LLM Prompts for Benchmarking Complex Tasks

EMNLP 2023short findings

While LLMs have shown great success in understanding and generating text in traditional conversational settings, their potential for performing ill-defined complex tasks is largely under-studied and yet to be benchmarked. However, conducting such benchmarking studies is challenging because of the l…

Cited by 0SourceScholar
2022

Learning to Generate Overlap Summaries through Noisy Synthetic Data

EMNLP 2022main

Semantic Overlap Summarization (SOS) is a novel and relatively under-explored seq-to-seq task which entails summarizing common information from multiple alternate narratives. One of the major challenges for solving this task is the lack of existing datasets for supervised training. To address this c…

Cited by 4SourcePDFScholar
2022

SEM-F1: an Automatic Way for Semantic Evaluation of Multi-Narrative Overlap Summaries at Scale

EMNLP 2022main

Recent work has introduced an important yet relatively under-explored NLP task called Semantic Overlap Summarization (SOS) that entails generating a summary from multiple alternative narratives which conveys the common information provided by those narratives. Previous work also published a benchmar…

Cited by 6SourcePDFScholar
2022

Semantic Overlap Summarization among Multiple Alternative Narratives: An Exploratory Study

COLING 2022main

In this paper, we introduce an important yet relatively unexplored NLP task called Semantic Overlap Summarization (SOS), which entails generating a single summary from multiple alternative narratives which can convey the common information provided by those narratives. As no benchmark dataset is rea…

Cited by 12SourcePDFScholar