Engaging Mind and Body: An Immersive BCI Paradigm with Motion-Panoramic Virtual Reality
Lianchi Zhang, Mengxi Lei, Jingting Zhang, Zonghai Huang, Rui Huang, Hong Cheng
Abstract
Brain-computer interface (BCI) is an important technology in developing the closed-loop brain training system for cognitive functional rehabilitation. Most of existing BCI paradigms have not ensured desired immersiveness of mind and body, thereby limiting participants’ engagement in training tasks. In this paper, we propose a sensory-immersive BCI paradigm for decision-making with a novel motion-panoramic virtual-reality system, aiming for deep involvement of both mind and body in brain functional training. This paradigm integrates visual, auditory and motion multi-sensory stimulation by using the Gait Real-time Analysis Interactive Lab system to implement the modified ultimatum game for decision making. The designed paradigm is validated through three experimental studies, including the event-related potentials analysis, power spectral density analysis and the brain network analysis. They demonstrate that the designed paradigm can achieve better performance in motor-cognitive interaction and multi-sensory coordination, by effectively enhancing brain activation in visual, auditory, and motor processing regions, which can result in more effective activation of decision-making areas like the prefrontal cortex. Compared to the existing paradigm, our paradigm can increase the number of high-intensity functional connections in the brain regions of participants by 62.8% (from 86 to 140), and the number of effective functional connections increased by 90.5% (from 252 to 480).
BibTeX
@inproceedings{iros2025_engagingmindandb,
title = {Engaging Mind and Body: An Immersive BCI Paradigm with Motion-Panoramic Virtual Reality},
author = {Lianchi Zhang and Mengxi Lei and Jingting Zhang and Zonghai Huang and Rui Huang and Hong Cheng},
booktitle = {IROS 2025},
year = {2025}
}