← Search

Ruolin Ye

10 accepted papers

2026

RAG-Diff: Adapting Diffusion Policies to Dynamic Constraints with Retrieval-Augmented Guidance

RSS 2026poster

Robots operating in unstructured environments must satisfy dynamic constraints that can change across tasks and even within a single execution. While diffusion policies can learn multimodal behaviors from demonstrations, adapting a trained policy at runtime to newly encountered or evolving constrain…

Cited by 0SourceScholar
2025

OpenRoboCare: A Multimodal Multi-Task Expert Demonstration Dataset for Robot Caregiving

IROS 2025

We present OpenRoboCare, a multimodal dataset for robot caregiving, capturing expert occupational therapist demonstrations of Activities of Daily Living (ADLs). Caregiving tasks involve complex physical human-robot interactions, requiring precise perception under occlusions, safe physical contact, a

Cited by 3SourceScholar
2024

MORPHeus: a Multimodal One-armed Robot-assisted Peeling System with Human Users In-the-loop

ICRA 2024poster

Meal preparation is an important instrumental activity of daily living (IADL). While existing research has explored robotic assistance in meal preparation tasks such as cutting and cooking, the crucial task of peeling has received less attention. Robot-assisted peeling, conventionally a bimanual tas…

Cited by 5SourceScholar
2024

REPeat: A Real2Sim2Real Approach for Pre-acquisition of Soft Food Items in Robot-assisted Feeding

IROS 2024poster

The paper presents REPeat, a Real2Sim2Real framework designed to enhance bite acquisition in robot-assisted feeding for soft foods. It uses ‘pre-acquisition actions’ such as pushing, cutting, and flipping to improve the success rate of bite acquisition actions such as skewering, scooping, and twirli…

Cited by 4SourceScholar
2023

ClothPose: A Real-world Benchmark for Visual Analysis of Garment Pose via An Indirect Recording Solution

ICCV 2023oral

Garments are important and pervasive in daily life. However, visual analysis on them for pose estimation is challenging because it requires recovering the complete configurations of garments, which is difficult, if not impossible, to annotate in the real world. In this work, we propose a recording s…

Cited by 6PDFScholar
2023

Demonstrating RFUniverse: A Multiphysics Simulation Platform for Embodied AI

RSS 2023poster

Multiphysics phenomena, the coupling effects involving different aspects of physics laws, are pervasive in the real world and can often be encountered when performing everyday household tasks. Intelligent agents which seek to assist or replace human laborers will need to learn to cope with such phe…

2023

GarmentTracking: Category-Level Garment Pose Tracking

CVPR 2023poster

Garments are important to humans. A visual system that can estimate and track the complete garment pose can be useful for many downstream tasks and real-world applications. In this work, we present a complete package to address the category-level garment pose tracking task: (1) A recording system VR…

2023

Visual-Tactile Sensing for In-Hand Object Reconstruction

CVPR 2023poster

Tactile sensing is one of the modalities human rely on heavily to perceive the world. Working with vision, this modality refines local geometry structure, measures deformation at contact area, and indicates hand-object contact state. With the availability of open-source tactile sensors such as DIGIT…

Cited by 24SourcePDFScholar
2022

RCare World: A Human-centric Simulation World for Caregiving Robots

IROS 2022poster

We present RCareWorld, a human-centric simulation world for physical and social robotic caregiving designed with inputs from stakeholders. RCareWorld has realistic human models of care recipients with mobility limitations and caregivers, home environments with multiple levels of accessibility and as…

Cited by 43SourceScholar
2021

H2O: A Benchmark for Visual Human-Human Object Handover Analysis

ICCV 2021poster

Object handover is a common human collaboration behavior that attracts attention from researchers in Robotics and Cognitive Science. Though visual perception plays an important role in the object handover task, the whole handover process has been specifically explored. In this work, we propose a nov…

Cited by 31PDFScholar