8 accepted papers
Robot teleoperation plays a crucial role in collecting data for large-scale imitation learning. Inferring operator's hand pose is crucial for vision-based teleoperation, and current solutions either rely on additional neural network training or hardware to infer the operator's wrist pose. To our kno…
Tele-homecare has become a promising approach to meet the growing demand for elderly and disability care. In such a context, ensuring human-robot interaction safety during teleoperation poses a critical challenge. Existing teleoperation control approaches focus solely on the robot’s end-effector tra
This study presents a safety-aware shared control strategy that combines proximity sensing and force guidance to achieve precise and stable teleoperation under dynamic interference. Based on the sensing information of the proximity sensor, a safety-aware controller is designed to enable the manipula
Despite the success of 6D pose estimation in bin-picking scenarios, existing methods still struggle to produce accurate prediction results for symmetry objects in real-world scenarios. The primary bottlenecks include 1) the ambiguity in keypoints caused by object symmetries; and 2) the domain gap be…
Object rearranging is one of the most common deformable manipulation tasks, where the robot needs to rearrange a deformable object into a goal configuration. Previous studies focus on designing an expert system for each specific task by model-based or data-driven approaches and the application scena…
In this letter, we address the problem of forecasting the trajectory of an egocentric camera wearer (ego-person) in crowded spaces. The trajectory forecasting ability learned from the data of different camera wearers walking around in the real world can be transferred to assist visually impaired peo
The ability to compute a quality index for manipulation tasks, in different configurations, has been widely used in robotics. However, it is poorly explored in human manipulation and physical human-robot collaboration (pHRC). Existing works that evaluate efficiency of human manipulation often focus
We present a manipulation planning algorithm for a robot to keep an object stable under changing external forces. We particularly focus on the case where a human may be applying forceful operations, e.g. cutting or drilling, on an object that the robot is holding. The planner produces an efficient p…