← Search

Tai-Yu Pan

8 accepted papers

2025

Learning 3D Perception from Others' Predictions

ICLR 2025poster

Accurate 3D object detection in real-world environments requires a huge amount of annotated data with high quality. Acquiring such data is tedious and expensive, and often needs repeated effort when a new sensor is adopted or when the detector is deployed in a new environment. We investigate a new s…

Cited by 1SourcePDFScholar
2025

Transfer Your Perspective: Controllable 3D Generation from Any Viewpoint in a Driving Scene

CVPR 2025poster

Self-driving cars relying solely on ego-centric perception face limitations in sensing, often failing to detect occluded, faraway objects. Collaborative autonomous driving (CAV) seems like a promising direction, but collecting data for development is non-trivial. It requires placing multiple sensor-…

Cited by 0SourcePDFScholar
2024

Pre-training LiDAR-based 3D Object Detectors through Colorization

ICLR 2024poster

Accurate 3D object detection and understanding for self-driving cars heavily relies on LiDAR point clouds, necessitating large amounts of labeled data to train. In this work, we introduce an innovative pre-training approach, Grounded Point Colorization (GPC), to bridge the gap between data and label…

2022

Learning with Free Object Segments for Long-Tailed Instance Segmentation

ECCV 2022poster

"One fundamental challenge in building an instance segmentation model for a large number of classes in complex scenes is the lack of training examples, especially for rare objects. In this paper, we explore the possibility to increase the training examples without laborious data collection and annot…

2022

One Step at a Time: Long-Horizon Vision-and-Language Navigation With Milestones

CVPR 2022poster

We study the problem of developing autonomous agents that can follow human instructions to infer and perform a sequence of actions to complete the underlying task. Significant progress has been made in recent years, especially for tasks with short horizons. However, when it comes to long-horizon tas…

Cited by 33PDFcodeScholar
2021

MosaicOS: A Simple and Effective Use of Object-Centric Images for Long-Tailed Object Detection

ICCV 2021poster

Many objects do not appear frequently enough in complex scenes (e.g., certain handbags in living rooms) for training an accurate object detector, but are often found frequently by themselves (e.g., in product images). Yet, these object-centric images are not effectively leveraged for improving objec…

Cited by 50PDFcodeScholar
2021

On Model Calibration for Long-Tailed Object Detection and Instance Segmentation

NeurIPS 2021poster

Vanilla models for object detection and instance segmentation suffer from the heavy bias toward detecting frequent objects in the long-tailed setting. Existing methods address this issue mostly during training, e.g., by re-sampling or re-weighting. In this paper, we investigate a largely overlooked…