RayFusion: Ray Fusion Enhanced Collaborative Visual Perception
Shaohong Wang, Bin Lu, Xinyu Xiao, Hanzhi Zhong, Bowen Pang, Tong Wang, Zhiyu Xiang, Hangguan Shan
Abstract
Collaborative visual perception methods have gained widespread attention in the autonomous driving community in recent years due to their ability to address sensor limitation problems. However, the absence of explicit depth information often makes it difficult for camera-based perception systems, e.g., 3D object detection, to generate accurate predictions. To alleviate the ambiguity in depth estimation, we propose RayFusion, a ray-based fusion method for collaborative visual perception. Using ray occupancy information from collaborators, RayFusion reduces redundancy and false positive predictions along camera rays, enhancing the detection performance of purely camera-based collaborative perception systems. Comprehensive experiments show that our method consistently outperforms existing state-of-the-art models, substantially advancing the performance of collaborative visual perception. Our code will be made publicly available.
BibTeX
@inproceedings{
wang2025rayfusion,
title={RayFusion: Ray Fusion Enhanced Collaborative Visual Perception},
author={Shaohong Wang and Bin Lu and Xinyu Xiao and Hanzhi Zhong and Bowen Pang and Tong Wang and Zhiyu Xiang and Hangguan Shan and Eryun Liu},
booktitle={The Thirty-ninth Annual Conference on Neural Information Processing Systems},
year={2025},
url={https://openreview.net/forum?id=eK61hWzAAl}
}