← Search

Lorenzo Bisi

5 accepted papers

2023

Simultaneously Updating All Persistence Values in Reinforcement Learning

AAAI 2023technical

In Reinforcement Learning, the performance of learning agents is highly sensitive to the choice of time discretization. Agents acting at high frequencies have the best control opportunities, along with some drawbacks, such as possible inefficient exploration and vanishing of the action advantages. T…

2022

Finite Sample Analysis of Mean-Volatility Actor-Critic for Risk-Averse Reinforcement Learning

AISTATS 2022poster

The goal in the standard reinforcement learning problem is to find a policy that optimizes the expected return. However, such an objective is not adequate in a lot of real-life applications, like finance, where controlling the uncertainty of the outcome is imperative. The mean-volatility objective p…

2020

Control Frequency Adaptation via Action Persistence in Batch Reinforcement Learning

ICML 2020poster

The choice of the control frequency of a system has a relevant impact on the ability of reinforcement learning algorithms to learn a highly performing policy. In this paper, we introduce the notion of action persistence that consists in the repetition of an action for a fixed number of decision step…

2020

Risk-Averse Trust Region Optimization for Reward-Volatility Reduction

IJCAI 2020poster

The use of reinforcement learning in algorithmic trading is of growing interest, since it offers the opportunity of making profit through the development of autonomous artificial traders, that do not depend on hard-coded rules. In such a framework, keeping uncertainty under control is as important a…

Cited by 0SourcePDFScholar