Deepspace: Dynamic Spatial and Source CUE Based Source Separation for Dialog Enhancement
Aaron Master, Lie Lu, Jonas Samuelsson, Heidi-Maria Lehtonen, Scott Norcross, Nathan Swedlow, Audrey Howard
Abstract
Dialog Enhancement (DE) is a feature which allows a user to increase the level of dialog in TV or movie content relative to nondialog sounds. When only the original mix is available, DE is "unguided," and requires source separation. In this paper, we describe the DeepSpace system, which performs source separation using both dynamic spatial cues and source cues to support unguided DE. Its technologies include spatio-level filtering (SLF) and deep-learning based dialog classification and denoising. Using subjective listening tests, we show that DeepSpace demonstrates significantly improved overall performance relative to state-of-the-art systems available for testing. We explore the feasibility of using existing automated metrics to evaluate unguided DE systems.
BibTeX
@inproceedings{icassp2023_deepspacedynamic,
title = {Deepspace: Dynamic Spatial and Source CUE Based Source Separation for Dialog Enhancement},
author = {Aaron Master and Lie Lu and Jonas Samuelsson and Heidi-Maria Lehtonen and Scott Norcross and Nathan Swedlow and Audrey Howard},
booktitle = {ICASSP 2023},
year = {2023}
}