CVPR 2024poster0 citations

Neural Modes: Self-supervised Learning of Nonlinear Modal Subspaces

Jiahong Wang, Yinwei Du, Stelian Coros, Bernhard Thomaszewski

Abstract

We propose a self-supervised approach for learning physics-based subspaces for real-time simulation. Existing learning-based methods construct subspaces by approximating pre-defined simulation data in a purely geometric way. However this approach tends to produce high-energy configurations leads to entangled latent space dimensions and generalizes poorly beyond the training set. To overcome these limitations we propose a self-supervised approach that directly minimizes the system's mechanical energy during training. We show that our method leads to learned subspaces that reflect physical equilibrium constraints resolve overfitting issues of previous methods and offer interpretable latent space parameters.

BibTeX
@inproceedings{cvpr2024_neuralmodesselfs,
  title = {Neural Modes: Self-supervised Learning of Nonlinear Modal Subspaces},
  author = {Jiahong Wang and Yinwei Du and Stelian Coros and Bernhard Thomaszewski},
  booktitle = {CVPR 2024},
  year = {2024}
}
Neural Modes: Self-supervised Learning of Nonlinear Modal Subspaces · CVPR 2024