← Search

Christian Gumbsch

3 accepted papers

2025

SENSEI: Semantic Exploration Guided by Foundation Models to Learn Versatile World Models

ICML 2025poster

Exploration is a cornerstone of reinforcement learning (RL). Intrinsic motivation attempts to decouple exploration from external, task-based rewards. However, established approaches to intrinsic motivation that follow general principles such as information gain, often only uncover low-level interact…

Cited by 2SourcePDFScholar
2024

Learning Hierarchical World Models with Adaptive Temporal Abstractions from Discrete Latent Dynamics

ICLR 2024spotlight

Hierarchical world models can significantly improve model-based reinforcement learning (MBRL) and planning by enabling reasoning across multiple time scales. Nonetheless, the majority of state-of-the-art MBRL methods employ flat, non-hierarchical models. We propose Temporal Hierarchies from Invarian…

Cited by 16SourcePDFScholar
2021

Sparsely Changing Latent States for Prediction and Planning in Partially Observable Domains

NeurIPS 2021poster

A common approach to prediction and planning in partially observable domains is to use recurrent neural networks (RNNs), which ideally develop and maintain a latent memory about hidden, task-relevant factors. We hypothesize that many of these hidden factors in the physical world are constant over ti…