HHI-Assist: A Dataset and Benchmark of Human-Human Interaction in Physical Assistance Scenario
Saeed Saadatnejad, Reyhaneh HosseiniNejad, Jose A. Barreiros, Katherine M. Tsui, Alexandre Alahi
Abstract
The increasing labor shortage and aging population underline the need for assistive robots to support human care recipients. To enable safe and responsive assistance, robots require accurate human motion prediction in physical interaction scenarios. However, this remains a challenging task due to the variability of assistive settings and the complexity of coupled dynamics in physical interactions. In this work, we address these challenges through two key contributions: (1) <bold xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">HHI-Assist</b>, a dataset comprising motion capture clips of human-human interactions in assistive tasks; and (2) a conditional Transformer-based denoising diffusion model for predicting the poses of interacting agents. Our model effectively captures the coupled dynamics between caregivers and care receivers, demonstrating improvements over baselines and strong generalization to unseen scenarios. By advancing interaction-aware motion prediction and introducing a new dataset, our work has the potential to significantly enhance robotic assistance policies. The dataset and code are available at: <uri xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">https://sites.google.com/view/hhi-assist/home</uri>.
BibTeX
@inproceedings{ral2025_hhiassistadatase,
title = {HHI-Assist: A Dataset and Benchmark of Human-Human Interaction in Physical Assistance Scenario},
author = {Saeed Saadatnejad and Reyhaneh HosseiniNejad and Jose A. Barreiros and Katherine M. Tsui and Alexandre Alahi},
booktitle = {RA-L 2025},
year = {2025}
}