Sanket Kumar Thakur

Audio-Visual Inpainting: Reconstructing Missing Visual Information with Sound

We tackle audio-visual inpainting, the problem of completing an image in such a way to be consistent with the sound associated to the scene. To this end, we propose a multimodal, audio-visual inpainting method (AVIN), and show how to leverage sound to reconstruct semantically consistent images. AVIN…