Leonid Pugachev

Explain My Surprise: Learning Efficient Long-Term Memory by predicting uncertain outcomes

In many sequential tasks, a model needs to remember relevant events from the distant past to make correct predictions. Unfortunately, a straightforward application of gradient based training requires intermediate computations to be stored for every element of a sequence. This requires to store prohi…