← Search

Santu Karmaker

4 accepted papers

2025

Benchmarking LLMs on Semantic Overlap Summarization

EMNLP 2025

Semantic Overlap Summarization (SOS) is a multi-document summarization task focused on extracting the common information shared cross alternative narratives which is a capability that is critical for trustworthy generation in domains such as news, law, and healthcare. We benchmark popular Large Lang

2025

LLMs as Meta-Reviewers’ Assistants: A Case Study

NAACL 2025long

One of the most important yet onerous tasks in the academic peer-reviewing process is composing meta-reviews, which involves assimilating diverse opinions from multiple expert peers, formulating one’s self-judgment as a senior expert, and then summarizing all these perspectives into a concise holist…

2025

Teaching an Old LLM Secure Coding: Localized Preference Optimization on Distilled Preferences

ACL 2025long

LLM generated code often contains security issues. We address two key challenges in improving secure code generation. First, obtaining high quality training data covering a broad set of security issues is critical. To address this, we introduce a method for distilling a preference dataset of insecur…

2024

ALIGN-SIM: A Task-Free Test Bed for Evaluating and Interpreting Sentence Embeddings through Semantic Similarity Alignment

EMNLP 2024finding

Sentence embeddings play a pivotal role in a wide range of NLP tasks, yet evaluating and interpreting these real-valued vectors remains an open challenge to date, especially in a task-free setting. To address this challenge, we introduce a novel task-free test bed for evaluating and interpreting sen…

Cited by 2SourcePDFScholar