GePBench: Evaluating Fundamental Geometric Perception for Multimodal Large Language Models
Shangyu Xing, Changhao Xiang, Xinyu Liu, Zhangtai Wu, Zhen Wu, Yue YIfan, Yuteng Han, Fei Zhao
Abstract
Geometric shapes play important roles in both physical world and human cognition. While multimodal large language models (MLLMs) have made significant advancements in visual understanding, their abilities to recognize geometric shapes and their spatial relationships, which we term geometric perception, are not explicitly and systematically explored. To address this gap, we introduce GePBench, a novel benchmark specifically designed to assess the geometric perception capabilities of MLLMs. Our extensive evaluations reveal that even the current state-of-the-art MLLMs exhibit significant deficiencies in geometric perception tasks. Furthermore, we show that models trained with GePBench data demonstrate considerable improvements on a wide range of downstream tasks, highlighting the critical role of geometric perception in enabling advanced multimodal applications. Our code and datasets will be publicly available.
BibTeX
@inproceedings{
xing2026gepbench,
title={Ge{PB}ench: Evaluating Fundamental Geometric Perception for Multimodal Large Language Models},
author={Shangyu Xing and Changhao Xiang and Xinyu Liu and Zhangtai Wu and Zhen Wu and Yue YIfan and Yuteng Han and Fei Zhao and Xinyu Dai},
booktitle={Forty-third International Conference on Machine Learning},
year={2026},
url={https://openreview.net/forum?id=NMn3qzg6hQ}
}