← Search

Avichai Ben David

2 accepted papers

2022

On the Implicit Bias of Gradient Descent for Temporal Extrapolation

AISTATS 2022poster

When using recurrent neural networks (RNNs) it is common practice to apply trained models to sequences longer than those seen in training. This “extrapolating” usage deviates from the traditional statistical learning setup where guarantees are provided under the assumption that train and test distri…

Cited by 6SourcePDFScholar
2020

Regularizing Towards Permutation Invariance In Recurrent Models

NeurIPS 2020poster

In many machine learning problems the output should not depend on the order of the inputs. Such ``permutation invariant'' functions have been studied extensively recently. Here we argue that temporal architectures such as RNNs are highly relevant for such problems, despite the inherent dependence of…