RA-L 20250 citations

A Physiotherapy Video Matching Method Supporting Arbitrary Camera Placement via Angle-of-Limb-Based Posture Structures

Jiunn-Wu Lin, Yao-Sheng Chou, Yun-Pin Huang, Min-Hsiung Hung, Ming-Hung Kao, Jia Ji, Lin-Yi Jiang, Pi-Wei Chen

Abstract

The “Hospital at Home” initiative transforms medical service automation through modern technologies. This letter revisits remote physiotherapy, allowing convalescents to record exercises using mobile devices from arbitrary angles. To address this, we propose a physiotherapy video matching method that accurately aligns movements from unconstrained viewpoints. The task is formulated as an optimization problem and solved using a modular pipeline. We introduce the Angle-of-Limb-based Posture Structure (ALPS) and the Camera-Angle-Free (CAFE) transformation to counter camera-angle differences. We also develop the Three-phase ALPS Matching Algorithm (TALMA) for matching movements between mentor and convalescent videos. Real-world experiments show our method outperforms existing solutions in both precision and practicality, with a time deviation of less than 0.07 seconds from expert annotations.

BibTeX
@inproceedings{ral2025_aphysiotherapyvi,
  title = {A Physiotherapy Video Matching Method Supporting Arbitrary Camera Placement via Angle-of-Limb-Based Posture Structures},
  author = {Jiunn-Wu Lin and Yao-Sheng Chou and Yun-Pin Huang and Min-Hsiung Hung and Ming-Hung Kao and Jia Ji and Lin-Yi Jiang and Pi-Wei Chen and Chao-Chun Chen},
  booktitle = {RA-L 2025},
  year = {2025}
}