Improving Deep Learning Sound Events Classifiers Using Gram Matrix Feature-Wise Correlations

Antonio Joia Neto; André G. C. Pacheco; Diogo Carbonera Luvizon

ICASSP 2021accepted0 citations

Improving Deep Learning Sound Events Classifiers Using Gram Matrix Feature-Wise Correlations

Antonio Joia Neto, André G. C. Pacheco, Diogo Carbonera Luvizon

Abstract

In this paper, we propose a new Sound Event Classification (SEC) method which is inspired in recent works for out-of-distribution detection. In our method, we analyse all the activations of a generic CNN in order to produce feature representations using Gram Matrices. The similarity metrics are evaluated considering all possible classes, and the final prediction is defined as the class that minimizes the deviation with respect to the features seeing during training. The proposed approach can be applied to any CNN and our experimental evaluation of four different architectures on two datasets demonstrated that our method consistently improves the baseline models.

BibTeX

@inproceedings{icassp2021_improvingdeeplea,
  title = {Improving Deep Learning Sound Events Classifiers Using Gram Matrix Feature-Wise Correlations},
  author = {Antonio Joia Neto and André G. C. Pacheco and Diogo Carbonera Luvizon},
  booktitle = {ICASSP 2021},
  year = {2021}
}