Direct, Near Real Time Animation of a 3D Tongue Model Using Non-Invasive Ultrasound Images

Shicheng Chen; Yifeng Zheng; Chengrui Wu; Guorui Sheng; Pierre Roussel; Bruce Denby

ICASSP 2018accepted0 citations

Direct, Near Real Time Animation of a 3D Tongue Model Using Non-Invasive Ultrasound Images

Shicheng Chen, Yifeng Zheng, Chengrui Wu, Guorui Sheng, Pierre Roussel, Bruce Denby

Abstract

A new technique for representing speech articulation with an ultrasound-driven finite element model of the tongue is presented. By using a snake contour extraction algorithm with anatomically motivated constraints and a common coordinate system between the ultrasound and the tongue model, it is possible for the first time to obtain a realistic 3D simulation of the tongue directly from a non-invasive sensor (ultrasound), without mapping through any intermediate sensor modalities, and at near real-time frame rates.

BibTeX

@inproceedings{icassp2018_directnearrealti,
  title = {Direct, Near Real Time Animation of a 3D Tongue Model Using Non-Invasive Ultrasound Images},
  author = {Shicheng Chen and Yifeng Zheng and Chengrui Wu and Guorui Sheng and Pierre Roussel and Bruce Denby},
  booktitle = {ICASSP 2018},
  year = {2018}
}