Transplayer: Timbre Style Transfer with Flexible Timbre Control
Yuxuan Wu, Yifan He, Xinlu Liu, Yi Wang, Roger B. Dannenberg
Abstract
Music timbre style transfer aims at replacing the instrument timbre in a solo recording with another instrument, while preserving the musical content. Existing GAN-based methods can only achieve timbre style transfer between two given timbres. Inspired by the practice in voice conversion, we propose TransPlayer, which uses an autoencoder model with one-hot representations of instruments as the condition, and a Diffwave model trained especially for music synthesis. We evaluate our model in both the one-to-one transfer task and the many-to-many transfer task. The results prove that our method is able to provide one-to-one style transfer outputs comparable with the existing GAN-based method, and can transfer among multiple timbres with only one single model.
BibTeX
@inproceedings{icassp2023_transplayertimbr,
title = {Transplayer: Timbre Style Transfer with Flexible Timbre Control},
author = {Yuxuan Wu and Yifan He and Xinlu Liu and Yi Wang and Roger B. Dannenberg},
booktitle = {ICASSP 2023},
year = {2023}
}