← Search

Clement Gehring

6 accepted papers

2024

Bridging State and History Representations: Understanding Self-Predictive RL

ICLR 2024poster

Representations are at the core of all deep reinforcement learning (RL) methods for both Markov decision processes (MDPs) and partially observable Markov decision processes (POMDPs). Many representation learning methods and theoretical frameworks have been developed to understand what constitutes an…

2024

Course Correcting Koopman Representations

ICLR 2024poster

Koopman representations aim to learn features of nonlinear dynamical systems (NLDS) which lead to linear dynamics in the latent space. Theoretically, such features can be used to simplify many problems in modeling and control of NLDS. In this work we study autoencoder formulations of this problem, a…

Cited by 2SourcePDFScholar
2024

Do Transformer World Models Give Better Policy Gradients?

ICML 2024poster

A natural approach for reinforcement learning is to predict future rewards by unrolling a neural network world model, and to backpropagate through the resulting computational graph to learn a control policy. However, this method often becomes impractical for long horizons, since typical world models…

Cited by 3SourcePDFScholar
2021

Understanding End-to-End Model-Based Reinforcement Learning Methods as Implicit Parameterization

NeurIPS 2021poster

Estimating the per-state expected cumulative rewards is a critical aspect of reinforcement learning approaches, however the experience is obtained, but standard deep neural-network function-approximation methods are often inefficient in this setting. An alternative approach, exemplified by value ite…

Cited by 6SourcePDFScholar
2018

Adaptable replanning with compressed linear action models for learning from demonstrations

CoRL 2018

We propose an adaptable and efficient model-based reinforcement learning approach well suited for continuous domains with sparse samples, a setting often encountered when learning from demonstrations. The flexibility of our method originates from the approximate transition models, estimated from dat

Cited by 0SourcePDFScholar
2018

Batched Large-scale Bayesian Optimization in High-dimensional Spaces

AISTATS 2018poster

Bayesian optimization (BO) has become an effective approach for black-box function optimization problems when function evaluations are expensive and the optimum can be achieved within a relatively small number of queries. However, many cases, such as the ones with high-dimensional inputs, may requir…

Cited by 0SourcePDFScholar