← Search

Siffi Singh

5 accepted papers

2024

Can Your Model Tell a Negation from an Implicature? Unravelling Challenges With Intent Encoders

ACL 2024long

Conversational systems often rely on embedding models for intent classification and intent clustering tasks. The advent of Large Language Models (LLMs), which enable instructional embeddings allowing one to adjust semantics over the embedding space using prompts, are being viewed as a panacea for th…

Cited by 2SourcePDFScholar
2024

MAGID: An Automated Pipeline for Generating Synthetic Multi-modal Datasets

NAACL 2024long

Development of multimodal interactive systems is hindered by the lack of rich, multimodal (text, images) conversational data, which is needed in large quantities for LLMs. Previous approaches augment textual dialogues with retrieved images, posing privacy, diversity, and quality constraints. In this…

2024

TofuEval: Evaluating Hallucinations of LLMs on Topic-Focused Dialogue Summarization

NAACL 2024long

Single document news summarization has seen substantial progress on faithfulness in recent years, driven by research on the evaluation of factual consistency, or hallucinations. We ask whether these advances carry over to other text summarization domains. We propose a new evaluation benchmark on top…

2023

Enhancing Abstractiveness of Summarization Models through Calibrated Distillation

EMNLP 2023long findings

In this paper, we propose a novel approach named DisCal to enhance the level of abstractiveness (measured by n-gram overlap) without sacrificing the informativeness (measured by ROUGE) of generated summaries. DisCal exposes diverse pseudo summaries with two supervision to the student model. Firstly,…

Cited by 0SourceScholar
2022

A Relation Extraction Dataset for Knowledge Extraction from Web Tables

COLING 2022main

Relational web-tables are significant sources of structural information that are widely used for relation extraction and population of facts into knowledge graphs. To transform the web-table data into knowledge, we need to identify the relations that exist between column pairs. Currently, there are…