← Search

Justus Piater

13 accepted papers

2026

Dynamic Sparsity: Challenging Common Sparsity Assumptions for Learning World Models in Robotic Reinforcement Learning Benchmarks

AAAI 2026technical

The use of learned dynamics models, also known as world models, can improve the sample efficiency of reinforcement learning. Recent work suggests that the underlying causal graphs of such dynamics models are sparsely connected, with each of the future state variables depending only on a small subset

Cited by 0SourcePDFScholar
2024

Colored Noise in PPO: Improved Exploration and Performance through Correlated Action Sampling

AAAI 2024technical

Proximal Policy Optimization (PPO), a popular on-policy deep reinforcement learning method, employs a stochastic policy for exploration. In this paper, we propose a colored noise-based stochastic policy variant of PPO. Previous research highlighted the importance of temporal correlation in action no…

2024

Continual Domain Randomization

IROS 2024poster

Domain Randomization (DR) is commonly used for sim2real transfer of reinforcement learning (RL) policies in robotics. Most DR approaches require a simulator with a fixed set of tunable parameters from the start of the training, from which the parameters are randomized simultaneously to train a robus…

Cited by 2SourcecodeScholar
2024

Local Linearity is All You Need (in Data-Driven Teleoperation)

IROS 2024poster

One of the critical aspects of assistive robotics is to provide a control system of a high-dimensional robot from a low-dimensional user input (i.e. a 2D joystick). Data-driven teleoperation seeks to provide an intuitive user interface called an action map to map the low dimensional input to robot v…

Cited by 0SourceScholar
2015

Bottom-up learning of object categories, action effects and logical rules: From continuous manipulative exploration to symbolic planning

ICRA 2015poster

This work aims for bottom-up and autonomous development of symbolic planning operators from continuous interaction experience of a manipulator robot that explores the environment using its action repertoire. Development of the symbolic knowledge is achieved in two stages. In the first stage, the rob…

Cited by 139SourceScholar
2015

Using structural bootstrapping for object substitution in robotic executions of human-like manipulation tasks

IROS 2015poster

In this work we address the problem of finding replacements of missing objects that are needed for the execution of human-like manipulation tasks. This is a usual problem that is easily solved by humans provided their natural knowledge to find object substitutions: using a knife as a screwdriver or…

Cited by 24SourceScholar