← Search

Nicolai Dorka

4 accepted papers

2023

Adaptively Calibrated Critic Estimates for Deep Reinforcement Learning

RA-L 2023

Accurate value estimates are important for off-policy reinforcement learning. Algorithms based on temporal difference learning typically are prone to an over- or underestimation bias building up over time. In this letter, we propose a general method called Adaptively Calibrated Critics (ACC) that us

Cited by 14SourcecodeScholar
2023

Dynamic Update-to-Data Ratio: Minimizing World Model Overfitting

ICLR 2023poster

Early stopping based on the validation set performance is a popular approach to find the right balance between under- and overfitting in the context of supervised learning. However, in reinforcement learning, even for supervised sub-problems such as world model learning, early stopping is not applic…

2023

Improving Deep Dynamics Models for Autonomous Vehicles with Multimodal Latent Mapping of Surfaces

IROS 2023poster

The safe deployment of autonomous vehicles relies on their ability to effectively react to environmental changes. This can require maneuvering on varying surfaces which is still a difficult problem, especially for slippery terrains. To address this issue we propose a new approach that learns a surfa…

Cited by 3SourceScholar