← Search

Arash Tavakoli

5 accepted papers

2022

On the Pitfalls of Heteroscedastic Uncertainty Estimation with Probabilistic Neural Networks

ICLR 2022poster

Capturing aleatoric uncertainty is a critical part of many machine learning systems. In deep learning, a common approach to this end is to train a neural network to estimate the parameters of a heteroscedastic Gaussian distribution by maximizing the logarithm of the likelihood function under the obs…

2021

Learning to Represent Action Values as a Hypergraph on the Action Vertices

ICLR 2021poster

Action-value estimation is a critical component of many reinforcement learning (RL) methods whereby sample complexity relies heavily on how fast a good estimator for action value can be learned. By viewing this problem through the lens of representation learning, good representations of both state a…

2019

Using a Logarithmic Mapping to Enable Lower Discount Factors in Reinforcement Learning

NeurIPS 2019oral

In an effort to better understand the different ways in which the discount factor affects the optimization process in reinforcement learning, we designed a set of experiments to study each effect in isolation. Our analysis reveals that the common perception that poor performance of low discount fact…