Pengfei Xing

Open-Vocabulary 3D Semantic Segmentation with Text-to-Image Diffusion Models

"In this paper, we investigate the use of diffusion models which are pre-trained on large-scale image-caption pairs for open-vocabulary 3D semantic understanding. We propose a novel method, namely Diff2Scene, which leverages frozen representations from text-image generative models, along with salien…