← Search

Luca Cagliero

8 accepted papers

2026

Benchmarking Visual LLMs Resilience to Unanswerable Questions on Visually Rich Documents

AAAI 2026technical

The evolution of Visual Large Language Models (VLLMs) has revolutionized the automatic understanding of Visually Rich Documents (VRDs), which contain both textual and visual elements. Although VLLMs excel in Visual Question Answering (VQA) on multi-page VRDs, their ability to detect unanswerable que

Cited by 0SourcePDFScholar
2025

Detecting and Mitigating Challenges in Zero-Shot Video Summarization with Video LLMs

ACL 2025finding

Video summarization aims to generate a condensed textual version of an original video. Summaries may consist of either plain text or a shortlist of salient events, possibly including temporal or spatial references. Video Large Language Models (VLLMs) exhibit impressive zero-shot capabilities in vide…

2025

It is not a piece of cake for GPT: Explaining Textual Entailment Recognition in the presence of Figurative Language

COLING 2025main

Textual Entailment Recognition (TER) aims to predict whether a pair of premise-hypothesis sentences represents an entailment, a contradiction, or none of the above. Addressing TER in the presence of figurative language is particularly challenging because words are used in a way that deviates from th…

Cited by 1SourcePDFScholar
2025

SQUAB: Evaluating LLM robustness to Ambiguous and Unanswerable Questions in Semantic Parsing

EMNLP 2025

Large Language Models (LLMs) have demonstrated robust performance in Semantic Parsing (SP) for well-defined queries with unambiguous intent and answerable responses. However, practical user questions frequently deviate from these ideal conditions, challenging the applicability of existing benchmarks

2024

3MVRD: Multimodal Multi-task Multi-teacher Visually-Rich Form Document Understanding

ACL 2024findings

This paper presents a groundbreaking multimodal, multi-task, multi-teacher joint-grained knowledge distillation model for visually-rich form document understanding. The model is designed to leverage insights from both fine-grained and coarse-grained levels by facilitating a nuanced correlation betwe…

2024

Beyond Accuracy Optimization: Computer Vision Losses for Large Language Model Fine-Tuning

EMNLP 2024finding

Large Language Models (LLMs) have demonstrated impressive performance across various tasks. However, current training approaches combine standard cross-entropy loss with extensive data, human feedback, or ad hoc methods to enhance performance. These solutions are often not scalable or feasible due t…

2023

Exploring Subgroup Performance in End-to-End Speech Models

ICASSP 2023accepted

End-to-End Spoken Language Understanding models are generally evaluated according to their overall accuracy, or separately on (a priori defined) data subgroups of interest. We propose a technique for analyzing model performance at the subgroup level, which considers all subgroups that can be defined…

Cited by 0SourceScholar
2023

QATCH: Benchmarking SQL-centric tasks with Table Representation Learning Models on Your Data

NeurIPS 2023poster

Table Representation Learning (TRL) models are commonly pre-trained on large open-domain datasets comprising millions of tables and then used to address downstream tasks. Choosing the right TRL model to use on proprietary data can be challenging, as the best results depend on the content domain, sch…