Augustine Mavor-Parker

How to Stay Curious while avoiding Noisy TVs using Aleatoric Uncertainty Estimation

When extrinsic rewards are sparse, artificial agents struggle to explore an environment. Curiosity, implemented as an intrinsic reward for prediction errors, can improve exploration but it is known to fail when faced with action-dependent noise sources (‘noisy TVs’). In an attempt to make exploring…