IJCAI 2020poster0 citations

End-to-End Signal Factorization for Speech: Identity, Content, and Style

Jennifer Williams

Abstract

Preliminary experiments in this dissertation show that it is possible to factorize specific types of information from the speech signal in an abstract embedding space using machine learning. This information includes characteristics of the recording environment, speaking style, and speech quality. Based on these findings, a new technique is proposed to factorize multiple types of information from the speech signal simultaneously using a combination of state-of-the-art machine learning methods for speech processing. Successful speech signal factorization will lead to advances across many speech technologies, including improved speaker identification, detection of speech audio deep fakes, and controllable expression in speech synthesis.

Natural Language Processing: SpeechMachine Learning: Deep LearningMachine Learning: Multi-instanceMulti-labelMulti-view learningMultidisciplinary Topics and Applications: Security and Privacy
BibTeX
@inproceedings{ijcai2020p746,
  title     = {End-to-End Signal Factorization for Speech: Identity, Content, and Style},
  author    = {Williams, Jennifer},
  booktitle = {Proceedings of the Twenty-Ninth International Joint Conference on
               Artificial Intelligence, {IJCAI-20}},
  publisher = {International Joint Conferences on Artificial Intelligence Organization},
  editor    = {Christian Bessiere},
  pages     = {5212--5213},
  year      = {2020},
  month     = {7},
  note      = {Doctoral Consortium},
  doi       = {10.24963/ijcai.2020/746},
  url       = {https://doi.org/10.24963/ijcai.2020/746},
}