2021
SkipW: Resource Adaptable RNN with Strict Upper Computational Limit
ICLR 2021poster
We introduce Skip-Window, a method to allow recurrent neural networks (RNNs) to trade off accuracy for computational cost during the analysis of a sequence. Similarly to existing approaches, Skip-Window extends existing RNN cells by adding a mechanism to encourage the model to process fewer inputs.…