← Search

Begoña Altuna

2 accepted papers

2024

A Multi-layered Approach to Physical Commonsense Understanding: Creation and Evaluation of an Italian Dataset

COLING 2024main

In this paper, we explore physical commonsense reasoning of large language models (LLMs) and propose a specific methodology to evaluate low-level understanding of the physical world. Specifically, the goal is to create a test set to analyze physical commonsense reasoning in large language models for…

Cited by 2SourcePDFScholar
2023

This is not a Dataset: A Large Negation Benchmark to Challenge Large Language Models

EMNLP 2023long main

Although large language models (LLMs) have apparently acquired a certain level of grammatical knowledge and the ability to make generalizations, they fail to interpret negation, a crucial step in Natural Language Processing. We try to clarify the reasons for the sub-optimal performance of LLMs under…

Cited by 0SourcecodeScholar