Event-Based Visual Microphone

Matthew Howard; Keigo Hirakawa

ICASSP 2023accepted0 citations

Event-Based Visual Microphone

Abstract

We propose event-based visual microphone (EBVM), a passive electro-optical technique for capturing audio signals remotely using an event camera. The event-based camera records local deformations of a surface induced by the sound propagation by observing the changes in specular reflections at each pixel. Interpreting the timings of the specular incidences deduced from the event stream as signal level-crossings, we reconstruct the audio signal by imposing Fourier sparsity. The recovered audio signal is qualitatively comparable to or better than the prior art (intensity-based visual microphone), with three orders of magnitude lower data throughput.

BibTeX

@inproceedings{icassp2023_eventbasedvisual,
  title = {Event-Based Visual Microphone},
  author = {Matthew Howard and Keigo Hirakawa},
  booktitle = {ICASSP 2023},
  year = {2023}
}