ICML 2026poster0 citations

Position: Reasoning After Perception Means Reasoning Without Vision

Hongcheng Gao, Zihao Huang, Jingyi Tang, Lin Xu, Xinhao Li, Haoyang Li, Yue Liu, Minhua Lin

Abstract

A common belief in multimodal research is that the perceptual weaknesses of vision--language models can be compensated by stronger language reasoning (e.g., chain-of-thought, in-context learning, or external tools). We challenge this assumption. We argue that for a broad class of visual tasks hard to specify in language, failures stem from a structural fatality where the temporal decision of \textit{when} to reason strictly dictates the spatial constraint of where reasoning takes place. When visual reasoning is deferred to language generation, current architectures do not merely delay computation; they displace it from the continuous visual representation to a discrete textual space. Consequently, the sequential "Perception-then-Reasoning" paradigm degenerates perception into a passive, one-off feature encoding process, rendering it functionally equivalent to "Reasoning-in-Text-Space", where task-critical spatial signals are collapsed before reasoning begins. We substantiate this claim with the Turing Eye Test (TET): tasks that must be resolved in visual space and are hard to verbalize; results show text-only reasoning cannot remedy these perceptual failures. Our findings suggest rethinking the architectural divide: shifting from reasoning \textit{about} perception to reasoning within perception. This facilitates actively reasoning-driven perception that operates directly on pixel-level visual representations, rather than within a collapsed textual space.

VisionMultimodal
BibTeX
@inproceedings{icml2026_positionreasonin,
  title = {Position: Reasoning After Perception Means Reasoning Without Vision},
  author = {Hongcheng Gao and Zihao Huang and Jingyi Tang and Lin Xu and Xinhao Li and Haoyang Li and Yue Liu and Minhua Lin and Xinlong Yang and Taihang Hu and Ge Wu and Baolong Bi and Hongyu Chen and Zhiqi Huang and Wentao Zhang},
  booktitle = {ICML 2026},
  year = {2026}
}