Fast inter-frame coding for dynamic meshes via supervoxel-based shape matching

Abstract

The MPEG-3DGH group is developing a new standard for dynamic mesh encoding, known as Video-based Dynamic Mesh Coding (V-DMC). One of the main challenges in the V-DMC encoding process is extracting temporally corresponding information required for the inter-frame coding when dealing with inputs that have time-varying connectivity. To provide an efficient and effective solution, we propose a fast supervoxel-based base mesh generation method complient with V-DMC inter-frame coding. Our method includes four steps: 1) Initial supervoxel segmentation on two given frames; 2) Supervoxel-based shape matching to extract an initial correspondence set; 3) Refined supervoxel segmentation and shape matching with the assistance of the initial correspondence set, which outputs a refined correspondence set with more correspondence vertices and higher accuracy; 4) Generation of inter-frame base meshes using the refined correspondence set. Experiments on the MPEG V-DMC test sequences demonstrate that our method achieves BD-rate improvements over the VDMC v6.0 in terms of D1, D2, Luma, Cb, and Cr metrics by -9.2%, -9.3%, -14.1%, -14.6%, and -9.7%, respectively. Additionally, the proposed method only increases the encoding time from 100% to 105% while suppressing the decoding time from 100% to 99%.