Multi-Head Attention and GRU for Improved Match-Mismatch Classification of Speech Stimulus and EEG Response

Marvin Borsdorf; Saurav Pahuja; Gabriel Ivucic; Siqi Cai; Haizhou Li; Tanja Schultz

ICASSP 2023accepted0 citations

Multi-Head Attention and GRU for Improved Match-Mismatch Classification of Speech Stimulus and EEG Response

Marvin Borsdorf, Saurav Pahuja, Gabriel Ivucic, Siqi Cai, Haizhou Li, Tanja Schultz

Abstract

This work is based on the participation by the HyperAttention team in the Auditory EEG Decoding Challenge, 2023 (ICASSP 2023 Signal Processing Grand Challenge) task 1, which deals with the match-mismatch classification of speech stimuli and EEG responses of human listeners. We demonstrate the benefits of using mel-spectrograms instead of speech envelopes as input features as well as the effectiveness of Multi-Head Attention and GRU for EEG and speech processing. With a total score of 79.05 %, we reach the second place in the challenge.

BibTeX

@inproceedings{icassp2023_multiheadattenti,
  title = {Multi-Head Attention and GRU for Improved Match-Mismatch Classification of Speech Stimulus and EEG Response},
  author = {Marvin Borsdorf and Saurav Pahuja and Gabriel Ivucic and Siqi Cai and Haizhou Li and Tanja Schultz},
  booktitle = {ICASSP 2023},
  year = {2023}
}