Predicting Tongue Motion in Unlabeled Ultrasound Video Using 3D Convolutional Neural Networks

Chengrui Wu; Shicheng Chen; Guorui Sheng; Pierre Roussel; Bruce Denby

ICASSP 2018accepted0 citations

Predicting Tongue Motion in Unlabeled Ultrasound Video Using 3D Convolutional Neural Networks

Chengrui Wu, Shicheng Chen, Guorui Sheng, Pierre Roussel, Bruce Denby

Abstract

A 3-dimensional convolutional neural network is trained on unlabeled ultrasound video to predict an upcoming tongue image from previous ones. The network obtains results superior to those of simpler predictors and provides a starting point for exploiting the higher-level representation of the tongue learned by the system in a variety of applications in speech research. This work is believed to be the first application of convolutional neural networks to unlabeled ultrasound video for the purpose of predicting tongue movement.

BibTeX

@inproceedings{icassp2018_predictingtongue,
  title = {Predicting Tongue Motion in Unlabeled Ultrasound Video Using 3D Convolutional Neural Networks},
  author = {Chengrui Wu and Shicheng Chen and Guorui Sheng and Pierre Roussel and Bruce Denby},
  booktitle = {ICASSP 2018},
  year = {2018}
}