← Search

Mingjie Pan

6 accepted papers

2025

CheckManual: A New Challenge and Benchmark for Manual-based Appliance Manipulation

CVPR 2025highlight

Correct use of electrical appliances has significantly improved human life quality. Unlike simple tools that can be manipulated with common sense, different parts of electrical appliances have specific functions defined by manufacturers. If we want the robot to heat bread by microwave, we should ena…

Cited by 0SourcePDFScholar
2025

LiDAR-LLM: Exploring the Potential of Large Language Models for 3D LiDAR Understanding

AAAI 2025technical

Recently, Large Language Models (LLMs) and Multimodal Large Language Models (MLLMs) have shown promise in instruction following and image understanding. While these models are powerful, they have not yet been developed to comprehend the more challenging 3D geometric and physical scenes, especially w…

2025

OmniManip: Towards General Robotic Manipulation via Object-Centric Interaction Primitives as Spatial Constraints

CVPR 2025highlight

The development of general robotic systems capable of manipulating in unstructured environments is a significant challenge. While Vision-Language Models(VLM) excel in high-level commonsense reasoning, they lack the fine-grained 3D spatial understanding required for precise manipulation tasks. Fine-…

Cited by 8SourcePDFScholar
2024

Exploring Sparse Visual Prompt for Domain Adaptive Dense Prediction

AAAI 2024technical

The visual prompts have provided an efficient manner in addressing visual cross-domain problems. Previous works introduce domain prompts to tackle the classification Test-Time Adaptation (TTA) problem by placing image-level prompts on the input and fine-tuning prompts for each target domain. However…

2024

RenderOcc: Vision-Centric 3D Occupancy Prediction with 2D Rendering Supervision

ICRA 2024poster

3D occupancy prediction holds significant promise in the fields of robot perception and autonomous driving, which quantifies 3D scenes into grid cells with semantic labels. Recent works mainly utilize complete occupancy labels in 3D voxel space for supervision. However, the expensive annotation proc…

Cited by 85SourcecodeScholar
2023

Cloud-Device Collaborative Adaptation to Continual Changing Environments in the Real-World

CVPR 2023poster

When facing changing environments in the real world, the lightweight model on client devices suffer from severe performance drop under distribution shifts. The main limitations of existing device model lie in: (1) unable to update due to the computation limit of the device, (2) limited generalizatio…

Cited by 20SourcePDFScholar