Changan Chen*

Action2Sound: Ambient-Aware Generation of Action Sounds from Egocentric Videos

"Generating realistic audio for human actions is important for many applications, such as creating sound effects for films or virtual reality games. Existing approaches implicitly assume total correspondence between the video and audio during training, yet many sounds happen off-screen and have weak…