Wonseok Oh

Hearing Hands: Generating Sounds from Physical Interactions in 3D Scenes

We study the problem of making 3D scene reconstructions interactive by asking the following question: can we predict the sounds of human hands physically interacting with a scene? First, we record a video of a human manipulating objects within a 3D scene using their hands. We then use these action-s…