← Search

Ulme Wennberg

2 accepted papers

2022

Wavebender GAN: An Architecture for Phonetically Meaningful Speech Manipulation

ICASSP 2022accepted

Deep learning has revolutionised synthetic speech quality. However, it has thus far delivered little value to the speech science community. The new methods do not meet the controllability demands that practitioners in this area require e.g.: in listening tests with manipulated speech stimuli. Instea…

Cited by 10SourceScholar
2021

The Case for Translation-Invariant Self-Attention in Transformer-Based Language Models

ACL 2021short

Mechanisms for encoding positional information are central for transformer-based language models. In this paper, we analyze the position embeddings of existing language models, finding strong evidence of translation invariance, both for the embeddings themselves and for their effect on self-attentio…