← Search

Mojtaba Sahraee Ardakan

2 accepted papers

2020

Matrix Inference and Estimation in Multi-Layer Models

NeurIPS 2020poster

We consider the problem of estimating the input and hidden variables of a stochastic multi-layer neural network from an observation of the output. The hidden variables in each layer are represented as matrices with statistical interactions along both rows as well as columns. This problem applies to…

2019

Input-Output Equivalence of Unitary and Contractive RNNs

NeurIPS 2019poster

Unitary recurrent neural networks (URNNs) have been proposed as a method to overcome the vanishing and exploding gradient problem in modeling data with long-term dependencies. A basic question is how restrictive is the unitary constraint on the possible input-output mappings of such a network? This…