← Search

James Tu

12 accepted papers

2025

FOMO-3D: Using Vision Foundation Models for Long-Tailed 3D Object Detection

CoRL 2025poster

In order to navigate complex traffic environments, self-driving vehicles must recognize many semantic classes pertaining to vulnerable road users or traffic control devices. However, many safety-critical objects (e.g., construction worker) appear infrequently in nominal traffic conditions, leading…

Cited by 0SourceScholar
2023

Adv3D: Generating Safety-Critical 3D Objects through Closed-Loop Simulation

CoRL 2023poster

Self-driving vehicles (SDVs) must be rigorously tested on a wide range of scenarios to ensure safe deployment. The industry typically relies on closed-loop simulation to evaluate how the SDV interacts on a corpus of synthetic and real scenarios and to verify good performance. However, they primarily…

Cited by 7SourceScholar
2023

Learning Realistic Traffic Agents in Closed-loop

CoRL 2023poster

Realistic traffic simulation is crucial for developing self-driving software in a safe and scalable manner prior to real-world deployment. Typically, imitation learning (IL) is used to learn human-like traffic agents directly from real-world observations collected offline, but without explicit speci…

Cited by 19SourceScholar
2023

MixSim: A Hierarchical Framework for Mixed Reality Traffic Simulation

CVPR 2023poster

The prevailing way to test a self-driving vehicle (SDV) in simulation involves non-reactive open-loop replay of real world scenarios. However, in order to safely deploy SDVs to the real world, we need to evaluate them in closed-loop. Towards this goal, we propose to leverage the wealth of interestin…

Cited by 39SourcePDFScholar
2023

Towards Scalable Coverage-Based Testing of Autonomous Vehicles

CoRL 2023poster

To deploy autonomous vehicles(AVs) in the real world, developers must understand the conditions in which the system can operate safely. To do this in a scalable manner, AVs are often tested in simulation on parameterized scenarios. In this context, it’s important to build a testing framework that pa…

Cited by 4SourceScholar
2021

AdvSim: Generating Safety-Critical Scenarios for Self-Driving Vehicles

CVPR 2021poster

As self-driving systems become better, simulating scenarios where the autonomy stack may fail becomes more important. Traditionally, those scenarios are generated for a few scenes with respect to the planning module that takes ground-truth actor states as input. This does not scale and cannot identi…

Cited by 194PDFScholar
2021

Adversarial Attacks on Multi-Agent Communication

ICCV 2021poster

Growing at a fast pace, modern autonomous systems will soon be deployed at scale, opening up the possibility for cooperative multi-agent systems. Sharing information and distributing workloads allow autonomous agents to better perform tasks and increase computation efficiency. However, shared inform…

Cited by 71PDFScholar
2021

Diverse Complexity Measures for Dataset Curation in Self-Driving

IROS 2021poster

Modern self-driving systems heavily rely on deep learning. As a consequence, their performance is influenced significantly by the quality and richness of the training data. Data collection platforms can generate many hours of raw data on a daily basis, however, it is not feasible to label everything…

Cited by 16SourceScholar
2021

Exploring Adversarial Robustness of Multi-sensor Perception Systems in Self Driving

CoRL 2021poster

Modern self-driving perception systems have been shown to improve upon processing complementary inputs such as LiDAR with images. In isolation, 2D images have been found to be extremely vulnerable to adversarial attacks. Yet, there are limited studies on the adversarial robustness of multi-modal mod…

Cited by 94SourceScholar
2020

Physically Realizable Adversarial Examples for LiDAR Object Detection

CVPR 2020poster

Modern autonomous driving systems rely heavily on deep learning models to process point cloud sensory data; meanwhile, deep models have been shown to be susceptible to adversarial attacks with visually imperceptible perturbations. Despite the fact that this poses a security concern for the self-driv…

Cited by 287PDFScholar