Riemannian Graph Convolutional Network for Skeleton-Based Two-Person Interaction Recognition

Rui Wang; Zihao Bi; Chen Hu; Xiaoning Song; Xiao-Jun Wu; Nicu Sebe; Ziheng Chen

IJCAI 20260 citations

Riemannian Graph Convolutional Network for Skeleton-Based Two-Person Interaction Recognition

Rui Wang, Zihao Bi, Chen Hu, Xiaoning Song, Xiao-Jun Wu, Nicu Sebe, Ziheng Chen

Abstract

In the field of skeleton-based human action recognition, Graph Convolutional Networks (GCNs) have become a dominant framework. However, existing GCN-based approaches often treat the sequences of two-person interaction as separate entities, ignoring the inherent semantic dependencies and spatial correlations between interacting subjects. Furthermore, high-order skeleton representations naturally exhibit non-Euclidean structures, where Euclidean deep learning models are inherently limited in explicitly capturing and preserving such geometric information. As a countermeasure, we propose a Riemannian Graph Convolutional Network (RGCN) that operates on the Symmetric Positive Definite (SPD) manifolds. Specifically, we model high-order skeletal statistics via Gaussian embedding and propose a Riemannian network to capture inter-subject interactions and global correlations. The proposed RGCN is instantiated under three SPD geometries, and its effectiveness is validated through extensive experiments on three interaction benchmarks. Extensive experimental results show that RGCN provides a competitive and geometrically grounded alternative for skeleton-based interaction recognition.

Computer Vision: Action and behavior recognitionComputer Vision: Machine learning for visionMachine Learning: Deep learning architecturesMachine Learning: Geometric learning

BibTeX

@inproceedings{ijcai2026_riemanniangraphc,
  title = {Riemannian Graph Convolutional Network for Skeleton-Based Two-Person Interaction Recognition},
  author = {Rui Wang and Zihao Bi and Chen Hu and Xiaoning Song and Xiao-Jun Wu and Nicu Sebe and Ziheng Chen},
  booktitle = {IJCAI 2026},
  year = {2026}
}