Low-Latency Human-Computer Auditory Interface Based on Real-Time Vision Analysis
Florian Scalvini, Camille Bordeau, Maxime Ambard, Cyrille Migniot, Julien Dubois
Abstract
This paper proposes a visuo-auditory substitution method to assist visually impaired people in scene understanding. Our approach focuses on person localisation in the user’s vicinity in order to ease urban walking. Since a real-time and low-latency is required in this context for user’s security, we propose an embedded system. The processing is based on a lightweight convolutional neural network to perform an efficient 2D person localisation. This measurement is enhanced with the corresponding person depth information, and is then transcribed into a stereophonic signal via a head-related transfer function. A GPU-based implementation is presented that enables a real-time processing to be reached at 23 frames/s on a 640x480 video stream. We show with an experiment that this method allows for a real-time accurate audio-based localization.
BibTeX
@inproceedings{icassp2022_lowlatencyhumanc,
title = {Low-Latency Human-Computer Auditory Interface Based on Real-Time Vision Analysis},
author = {Florian Scalvini and Camille Bordeau and Maxime Ambard and Cyrille Migniot and Julien Dubois},
booktitle = {ICASSP 2022},
year = {2022}
}