← Search

Fatemeh Shiri

2 accepted papers

2024

An Empirical Analysis on Spatial Reasoning Capabilities of Large Multimodal Models

EMNLP 2024main

Large Multimodal Models (LMMs) have achieved strong performance across a range of vision and language tasks. However, their spatial reasoning capabilities are under-investigated. In this paper, we construct a novel VQA dataset, Spatial-MM, to comprehensively study LMMs’ spatial understanding and rea…

2024

Direct Evaluation of Chain-of-Thought in Multi-hop Reasoning with Knowledge Graphs

ACL 2024findings

Large language models (LLMs) have demonstrated strong reasoning abilities when prompted to generate chain-of-thought (CoT) explanations alongside answers. However, previous research on evaluating LLMs has solely focused on answer accuracy, neglecting the correctness of the generated CoT. In this pap…