← Search

Aivar Sootla

4 accepted papers

2023

Timing is Everything: Learning to Act Selectively with Costly Actions and Budgetary Constraints

ICLR 2023poster

Many real-world settings involve costs for performing actions; transaction costs in financial systems and fuel costs being common examples. In these settings, performing actions at each time step quickly accumulates costs leading to vastly suboptimal outcomes. Additionally, repeatedly acting produce…

Cited by 7SourcePDFScholar
2022

Enhancing Safe Exploration Using Safety State Augmentation

NeurIPS 2022accept

Safe exploration is a challenging and important problem in model-free reinforcement learning (RL). Often the safety cost is sparse and unknown, which unavoidably leads to constraint violations - a phenomenon ideally to be avoided in safety-critical applications. We tackle this problem by augmenting…

Cited by 19SourcePDFScholar
2022

Reinforcement Learning in Presence of Discrete Markovian Context Evolution

ICLR 2022poster

We consider a context-dependent Reinforcement Learning (RL) setting, which is characterized by: a) an unknown finite number of not directly observable contexts; b) abrupt (discontinuous) context changes occurring during an episode; and c) Markovian context evolution. We argue that this challenging c…

Cited by 13SourcePDFScholar
2022

Saute RL: Almost Surely Safe Reinforcement Learning Using State Augmentation

ICML 2022spotlight

Satisfying safety constraints almost surely (or with probability one) can be critical for the deployment of Reinforcement Learning (RL) in real-life applications. For example, plane landing and take-off should ideally occur with probability one. We address the problem by introducing Safety Augmented…