Mixed Gaussian Splatting for High-Quality Rendering and Reconstruction

Abstract

3D Gaussian Splatting (3DGS) has demonstrated impressive novel view synthesis with rapid rendering speed. Current works explore its application to geometric reconstruction to fully release the potential of 3DGS. However, a trade-off exists between the rendering and the reconstruction when representing real-world scenes, as achieving detailed surface reconstruction can often compromise the rendering quality. To address this issue, we introduce Mixed Gaussian Splatting (MixedGS) which combines 2D Gaussians for accurate surface reconstruction and 3D Gaussians for high-fidelity rendering. With anchor point initialization, 3D neural Gaussians derivation, contribution-based densification and joint supervision, our method effectively leverages the advantages of both 2D and 3D Gaussian primitives while mitigating their limitations. We demonstrate on diverse real-world scenes that our method achieves competitive rendering quality and detailed geometry reconstruction at the same time.