← Search

Philippe Preux

7 accepted papers

2021

Adversarially Guided Actor-Critic

ICLR 2021poster

Despite definite success in deep reinforcement learning problems, actor-critic algorithms are still confronted with sample inefficiency in complex environments, particularly in tasks where efficient exploration is a bottleneck. These methods consider a policy (the actor) and a value function (the cr…

2021

Don’t Do What Doesn’t Matter: Intrinsic Motivation with Action Usefulness

IJCAI 2021poster

Sparse rewards are double-edged training signals in reinforcement learning: easy to design but hard to optimize. Intrinsic motivation guidances have thus been developed toward alleviating the resulting exploration problem. They usually incentivize agents to look for new states through novelty sign…

2021

Learning Value Functions in Deep Policy Gradients using Residual Variance

ICLR 2021poster

Policy gradient algorithms have proven to be successful in diverse decision making and control tasks. However, these methods suffer from high sample complexity and instability issues. In this paper, we address these challenges by providing a different approach for training the critic in the actor-cr…

Cited by 24SourcePDFScholar
2021

There Is No Turning Back: A Self-Supervised Approach for Reversibility-Aware Reinforcement Learning

NeurIPS 2021poster

We propose to learn to distinguish reversible from irreversible actions for better informed decision-making in Reinforcement Learning (RL). From theoretical considerations, we show that approximate reversibility can be learned through a simple surrogate task: ranking randomly sampled trajectory even…

Cited by 24SourcePDFScholar
2018

Visual Reasoning with Multi-hop Feature Modulation

ECCV 2018poster

Recent breakthroughs in computer vision and natural language processing have spurred interest in challenging multi-modal tasks such as visual question-answering and visual dialogue. For such tasks, one successful approach is to condition image-based convolutional network computation on language via…