← Search

Jakob Hollenstein

3 accepted papers

2026

Dynamic Sparsity: Challenging Common Sparsity Assumptions for Learning World Models in Robotic Reinforcement Learning Benchmarks

AAAI 2026technical

The use of learned dynamics models, also known as world models, can improve the sample efficiency of reinforcement learning. Recent work suggests that the underlying causal graphs of such dynamics models are sparsely connected, with each of the future state variables depending only on a small subset

Cited by 0SourcePDFScholar
2024

Colored Noise in PPO: Improved Exploration and Performance through Correlated Action Sampling

AAAI 2024technical

Proximal Policy Optimization (PPO), a popular on-policy deep reinforcement learning method, employs a stochastic policy for exploration. In this paper, we propose a colored noise-based stochastic policy variant of PPO. Previous research highlighted the importance of temporal correlation in action no…

2023

Pink Noise Is All You Need: Colored Noise Exploration in Deep Reinforcement Learning

ICLR 2023top-25%

In off-policy deep reinforcement learning with continuous action spaces, exploration is often implemented by injecting action noise into the action selection process. Popular algorithms based on stochastic policies, such as SAC or MPO, inject white noise by sampling actions from uncorrelated Gaussia…

Cited by 51SourcePDFScholar