← Search

Shiyang Lu

8 accepted papers

2023

ARMBench: An Object-centric Benchmark Dataset for Robotic Manipulation

ICRA 2023poster

This paper introduces Amazon Robotic Manipulation Benchmark (ARMBench), a large-scale, object-centric benchmark dataset for robotic manipulation in the context of a warehouse. Automation of operations in modern warehouses requires a robotic manipulator to deal with a wide variety of objects, unstruc…

Cited by 29SourceScholar
2023

Context-Aware Entity Grounding with Open-Vocabulary 3D Scene Graphs

CoRL 2023poster

We present an Open-Vocabulary 3D Scene Graph (OVSG), a formal framework for grounding a variety of entities, such as object instances, agents, and regions, with free-form text-based queries. Unlike conventional semantic-based object localization approaches, our system facilitates context-aware entit…

Cited by 29SourcecodeScholar
2023

OVIR-3D: Open-Vocabulary 3D Instance Retrieval Without Training on 3D Data

CoRL 2023poster

This work presents OVIR-3D, a straightforward yet effective method for open-vocabulary 3D object instance retrieval without using any 3D data for training. Given a language query, the proposed method is able to return a ranked set of 3D object instance segments based on the feature similarity of the…

Cited by 61SourcecodeScholar
2023

Real2Sim2Real Transfer for Control of Cable-Driven Robots Via a Differentiable Physics Engine

IROS 2023poster

Tensegrity robots, composed of rigid rods and flexible cables, exhibit high strength-to-weight ratios and significant deformations, which enable them to navigate unstructured terrains and survive harsh impacts. They are hard to control, however, due to high dimensionality, complex dynamics, and a co…

Cited by 11SourceScholar
2023

Self-Supervised Learning of Object Segmentation from Unlabeled RGB-D Videos

ICRA 2023poster

This work proposes a self-supervised learning system for segmenting rigid objects in RGB images. The proposed pipeline is trained on unlabeled RGB-D videos of static objects, which can be captured with a camera carried by a mobile robot. A key feature of the self-supervised training process is a gra…

Cited by 0SourceScholar
2022

Online Object Model Reconstruction and Reuse for Lifelong Improvement of Robot Manipulation

ICRA 2022poster

This work proposes a robotic pipeline for picking and constrained placement of objects without geometric shape priors. Compared to recent efforts developed for similar tasks, where every object was assumed to be novel, the proposed system recognizes previously manipulated objects and per-forms onlin…

Cited by 16SourceScholar
2020

Safe and Effective Picking Paths in Clutter given Discrete Distributions of Object Poses

IROS 2020poster

Picking an item in the presence of other objects can be challenging as it involves occlusions and partial views. Given object models, one approach is to perform object pose estimation and use the most likely candidate pose per object to pick the target without collisions. This approach, however, ign…

Cited by 9SourceScholar
2019

Factored Pose Estimation of Articulated Objects using Efficient Nonparametric Belief Propagation

ICRA 2019poster

Robots working in human environments often encounter a wide range of articulated objects, such as tools, cabinets, and other jointed objects. Such articulated objects can take an infinite number of possible poses, as a point in a potentially high-dimensional continuous space. A robot must perceive t…

Cited by 48SourceScholar