Investigation into Joint Optimization of Single Channel Speech Enhancement and Acoustic Modeling for Robust ASR

Tobias Menne; Ralf Schlüter; Hermann Ney

ICASSP 2019accepted0 citations

Investigation into Joint Optimization of Single Channel Speech Enhancement and Acoustic Modeling for Robust ASR

Tobias Menne, Ralf Schlüter, Hermann Ney

Abstract

This paper investigates the joint optimization of single channel speech enhancement and the acoustic model of a hybrid DNN-HMM system for noise robust ASR. Two enhancement methods are investigated. A masking of the noisy speech signal with a speech mask estimated by a DNN based mask estimator, as well as a parametric Wiener filter employing a DNN based noise estimator and a DNN based frame wise estimation of the filter parameters. Those components are jointly optimized with the acoustic model of the ASR system. It is shown that the Wiener filter approach can be used to improve the performance of a state-of-the-art single-channel ASR system on the single channel track of the CHiME-4 data, where the WER of the real evaluation set is reduced from 11.6 % to 10.5 %.

BibTeX

@inproceedings{icassp2019_investigationint,
  title = {Investigation into Joint Optimization of Single Channel Speech Enhancement and Acoustic Modeling for Robust ASR},
  author = {Tobias Menne and Ralf Schlüter and Hermann Ney},
  booktitle = {ICASSP 2019},
  year = {2019}
}