← Search

Prasetya Utama

3 accepted papers

2022

Falsesum: Generating Document-level NLI Examples for Recognizing Factual Inconsistency in Summarization

NAACL 2022long

Neural abstractive summarization models are prone to generate summaries that are factually inconsistent with their source documents. Previous work has introduced the task of recognizing such factual inconsistency as a downstream application of natural language inference (NLI). However, state-of-the-…

2022

IMPLI: Investigating NLI Models’ Performance on Figurative Language

ACL 2022long

Natural language inference (NLI) has been widely used as a task to train and evaluate models for language understanding. However, the ability of NLI models to perform inferences requiring understanding of figurative language such as idioms and metaphors remains understudied. We introduce the IMPLI (…

2021

Avoiding Inference Heuristics in Few-shot Prompt-based Finetuning

EMNLP 2021main

Recent prompt-based approaches allow pretrained language models to achieve strong performances on few-shot finetuning by reformulating downstream tasks as a language modeling problem. In this work, we demonstrate that, despite its advantages on low data regimes, finetuned prompt-based models for sen…