Haozheng Pei

Clink! Chop! Thud! - Learning Object Sounds from Real-World Interactions

Can a model distinguish between the sound of a spoon hitting a hardwood floor versus a carpeted one? Everyday object interactions produce sounds unique to the objects involved. We introduce the sounding object detection task to evaluate a model's ability to link these sounds to the objects directly…