Md Mafijul Islam Bhuiyan

Weight Excitation: Built-in Attention Mechanisms in Convolutional Neural Networks

We propose novel approaches for simultaneously identifying important weights of a convolutional neural network (ConvNet) and providing more attention to the important weights during training. More formally, we identify two characteristics of a weight, its magnitude and its location, which can be lin…