Evaluating Salience Representations for Cross-modal Retrieval of Western Classical Music Recordings
Frank Zalkow, Stefan Balke, Meinard Müller
Abstract
In this paper, we consider a cross-modal retrieval scenario of Western classical music. Given a short monophonic musical theme in symbolic notation as query, the objective is to find relevant audio recordings in a database. A major challenge of this retrieval task is the possible difference in the degree of polyphony between the monophonic query and the music recordings. Previous studies for popular music addressed this issue by performing the cross-modal comparison based on predominant melodies extracted from the recordings. For Western classical music, however, this approach is problematic since the underlying assumption of a single pre-dominant melody is often violated. Instead of extracting the melody explicitly, another strategy is to perform the cross-modal comparison directly on the basis of melody-enhanced salience representations. As the main contribution of this paper, we evaluate several conceptually different salience representations for our cross-modal retrieval scenario. Our extensive experimental results, which have been made available on a website, comprise more than 2000 musical themes and 100 hours of audio recordings.
BibTeX
@inproceedings{icassp2019_evaluatingsalien,
title = {Evaluating Salience Representations for Cross-modal Retrieval of Western Classical Music Recordings},
author = {Frank Zalkow and Stefan Balke and Meinard Müller},
booktitle = {ICASSP 2019},
year = {2019}
}