← Search

Maximilian Karl

8 accepted papers

2025

LIMT: Language-Informed Multi-Task Visual World Models

ICRA 2025

Most recent successes in robot reinforcement learning involve learning a specialized single-task agent. However, robots capable of performing multiple tasks can be much more valuable in real-world applications. Multi-task reinforcement learning can be very challenging due to the increased sample com

Cited by 5SourceScholar
2024

Accurate Kinematic Modeling using Autoencoders on Differentiable Joints

ICRA 2024poster

In robotics and biomechanics, accurately determining joint parameters and computing the corresponding forward and inverse kinematics are critical yet often challenging tasks, especially when dealing with highly individualized and partly unknown systems. This paper unveils a cutting-edge kinematic op…

Cited by 1SourceScholar
2024

Constrained Latent Action Policies for Model-Based Offline Reinforcement Learning

NeurIPS 2024poster

In offline reinforcement learning, a policy is learned using a static dataset in the absence of costly feedback from the environment. In contrast to the online setting, only using static datasets poses additional challenges, such as policies generating out-of-distribution samples. Model-based offlin…

2024

Design and Implementation of a Robotic Testbench for Analyzing Pincer Grip Execution in Human Specimen Hands

ICRA 2024poster

This study presents an innovative test rig engineered to explore the kinematic and viscoelastic characteristics of human specimen hands. The rig features eight force-controlled motors linked to muscle tendons, enabling precise stimulation of hand specimens. Hand movements are monitored through an op…

Cited by 0SourceScholar
2024

On the Role of the Action Space in Robot Manipulation Learning and Sim-to-Real Transfer

RA-L 2024

We study the choice of action space in robot manipulation learning and sim-to-real transfer. We define metrics that assess the performance, and examine the emerging properties in the different action spaces. We train over 250 reinforcement learning (RL) agents in simulated reaching and pushing tasks

Cited by 32SourceScholar
2023

Action Inference by Maximising Evidence: Zero-Shot Imitation from Observation with World Models

NeurIPS 2023poster

Unlike most reinforcement learning agents which require an unrealistic amount of environment interactions to learn a new behaviour, humans excel at learning quickly by merely observing and imitating others. This ability highly depends on the fact that humans have a model of their own embodiment that…

2017

Deep Variational Bayes Filters: Unsupervised Learning of State Space Models from Raw Data

ICLR 2017poster

We introduce Deep Variational Bayes Filters (DVBF), a new method for unsupervised learning and identification of latent Markovian state space models. Leveraging recent advances in Stochastic Gradient Variational Bayes, DVBF can overcome intractable inference distributions via variational inference.…

Cited by 484SourcecodeScholar
2016

Stable reinforcement learning with autoencoders for tactile and visual data

IROS 2016poster

For many tasks, tactile or visual feedback is helpful or even crucial. However, designing controllers that take such high-dimensional feedback into account is non-trivial. Therefore, robots should be able to learn tactile skills through trial and error by using reinforcement learning algorithms. The…

Cited by 209SourceScholar