Maciej Grabias

Contrastive Prediction Strategies for Unsupervised Segmentation and Categorization of Phonemes and Words

We identify a performance trade-off between the tasks of phoneme categorization and phoneme and word segmentation in several self-supervised learning algorithms based on Contrastive Predictive Coding (CPC). Our experiments suggest that context building networks, albeit necessary for high performance…