Pairwise learning using multi-lingual bottleneck features for low-resource query-by-example spoken term detection

Yougen Yuan; Cheung-Chi Leung; Lei Xie; Hongjie Chen; Bin Ma; Haizhou Li

ICASSP 2017accepted0 citations

Pairwise learning using multi-lingual bottleneck features for low-resource query-by-example spoken term detection

Yougen Yuan, Cheung-Chi Leung, Lei Xie, Hongjie Chen, Bin Ma, Haizhou Li

Abstract

We propose to use a feature representation obtained by pairwise learning in a low-resource language for query-by-example spoken term detection (QbE-STD). We assume that word pairs identified by humans are available in the low-resource target language. The word pairs are parameterized by a multi-lingual bottleneck feature (BNF) extractor that is trained using transcribed data in high-resource languages. The multi-lingual BNFs of the word pairs are used as an initial feature representation to train an autoencoder (AE). We extract features from an internal hidden layer of the pairwise trained AE to perform acoustic pattern matching for QbE-STD. Our experiments on the TIMIT and Switchboard corpora show that the pairwise learning brings 7.61% and 8.75% relative improvements in mean average precision (MAP) respectively over the initial feature representation.

BibTeX

@inproceedings{icassp2017_pairwiselearning,
  title = {Pairwise learning using multi-lingual bottleneck features for low-resource query-by-example spoken term detection},
  author = {Yougen Yuan and Cheung-Chi Leung and Lei Xie and Hongjie Chen and Bin Ma and Haizhou Li},
  booktitle = {ICASSP 2017},
  year = {2017}
}