NeurIPS 2019poster19 citations
Neural Shuffle-Exchange Networks - Sequence Processing in O(n log n) Time
Karlis Freivalds, Emīls Ozoliņš, Agris Šostaks
Abstract
A key requirement in sequence to sequence processing is the modeling of long range dependencies. To this end, a vast majority of the state-of-the-art models use attention mechanism which is of O(n^2) complexity that leads to slow execution for long sequences.
BibTeX
@inproceedings{NEURIPS2019_9001ca42,
author = {Freivalds, Karlis and Ozoli\c{n}\v{s}, Em\={\i}ls and \v{S}ostaks, Agris},
booktitle = {Advances in Neural Information Processing Systems},
editor = {H. Wallach and H. Larochelle and A. Beygelzimer and F. d\textquotesingle Alch\'{e}-Buc and E. Fox and R. Garnett},
pages = {},
publisher = {Curran Associates, Inc.},
title = {Neural Shuffle-Exchange Networks - Sequence Processing in O(n log n) Time},
url = {https://proceedings.neurips.cc/paper_files/paper/2019/file/9001ca429212011f4a4fda6c778cc318-Paper.pdf},
volume = {32},
year = {2019}
}