A Comprehensive Survey of Interaction Techniques in 3D Scene Generation
Yuqi Li, Siwei Meng, Chuanguang Yang, Weilun Feng, Junming Liu, Zhulin An, Yikai Wang, Yingli Tian
Abstract
The rapid evolution of 3D scene generation has revolutionized content creation across domains such as gaming, film production, and architectural visualization. Within this landscape, interaction techniques serve as the pivotal bridge connecting user intent with generative models, enabling precise control, real-time feedback, and personalized customization of complex 3D scenes. Existing literature reviews predominantly focus on general generative paradigms or are limited to specific subdomains such as single-object modeling, often overlooking the systematic classification of interaction mechanisms. To bridge this gap, this survey presents a comprehensive survey of interaction techniques in 3D scene generation. We propose a unified taxonomy that categorizes existing methods into three primary paradigms: Interactive Generation, Interactive Editing, and Embodied Interaction. For each category, we analyze representative methods in terms of controllability, interaction granularity, and physical consistency, and discuss their advantages and limitations. We further summarize commonly used datasets and evaluation protocols for interactive 3D scene generation. Finally, we discuss future directions toward more physically grounded, multi-modal, and human-centered interactive 3D scene generation systems.
BibTeX
@inproceedings{ijcai2026_acomprehensivesu,
title = {A Comprehensive Survey of Interaction Techniques in 3D Scene Generation},
author = {Yuqi Li and Siwei Meng and Chuanguang Yang and Weilun Feng and Junming Liu and Zhulin An and Yikai Wang and Yingli Tian},
booktitle = {IJCAI 2026},
year = {2026}
}