← Search

Mostafa El-Khamy

8 accepted papers

2020

T-GSA: Transformer with Gaussian-Weighted Self-Attention for Speech Enhancement

ICASSP 2020accepted

Transformer neural networks (TNN) demonstrated state-ofart performance on many natural language processing (NLP) tasks, replacing recurrent neural networks (RNNs), such as LSTMs or GRUs. However, TNNs did not perform well in speech enhancement, whose contextual nature is different than NLP tasks, li…

Cited by 0SourceScholar
2019

Jointly Sparse Convolutional Neural Networks in Dual Spatial-winograd Domains

ICASSP 2019accepted

We consider the optimization of deep convolutional neural networks (CNNs) such that they provide good performance while having reduced complexity if deployed on either conventional systems with spatial-domain convolution or lower-complexity systems designed for Winograd convolution. The proposed fra…

Cited by 0SourceScholar
2018

Bridgenets: Student-Teacher Transfer Learning Based on Recursive Neural Networks and Its Application to Distant Speech Recognition

ICASSP 2018accepted

Despite the remarkable progress achieved on automatic speech recognition, recognizing far-field speeches mixed with various noise sources is still a challenging task. In this paper, we introduce novel student-teacher transfer learning, BridgeNet which can provide a solution to improve distant speech…

Cited by 0SourceScholar