← Search

Shanyu Rong

5 accepted papers

2026

Action-Sketcher: From Reasoning to Action via Visual Sketches for Robotic Manipulation

CVPR 2026

Long-horizon robotic manipulation is increasingly important for real-world deployment, requiring spatial disambiguation in complex layouts and temporal resilience under dynamic interaction. However, existing end-to-end and hierarchical Vision-Language-Action (VLA) policies often rely on text-only cu

Cited by 0SourcecodeScholar
2026

SaPaVe: Towards Active Perception and Manipulation in Vision-Language Action Models for Robotics

CVPR 2026

Active perception and manipulation are crucial for robots to interact with complex scenes. Existing methods struggle to unify semantic-driven perception actively with robust, viewpoint-invariant execution accordingly. To this end, we propose SaPaVe, an end-to-end framework that jointly learns these

Cited by 0SourceScholar
2026

TIGeR: Tool-Integrated Geometric Reasoning in Vision-Language Models for Robotics

ICRA 2026poster

Vision-Language Models (VLMs) have shown remarkable capabilities in spatial reasoning, yet they remain fundamentally limited to qualitative assessments and lack the computational precision required for real-world robotics. Current approaches fail to leverage metric information from depth sensors and…

2025

CordViP: Correspondence-based Visuomotor Policy for Dexterous Manipulation in Real-World

RSS 2025poster

Achieving human-level dexterity in robots is a key objective in the field of robotic manipulation. Recent advancements in 3D-based imitation learning have shown promising results, providing an effective pathway to achieve this goal. However, obtaining high-quality 3D representations presents two key…

Cited by 2PDFScholar
2025

RoboRefer: Towards Spatial Referring with Reasoning in Vision-Language Models for Robotics

NeurIPS 2025poster

Spatial referring is a fundamental capability of embodied robots to interact with the 3D physical world. However, even with the powerful pretrained VLMs, recent approaches are still not qualified to accurately understand the complex 3D scenes and dynamically reason about the instruction-indicated lo…

Cited by 0SourceScholar