← Search

Fabio Patrizi

7 accepted papers

2026

Model-Based Reinforcement Learning in Discrete-Action Non-Markovian Reward Decision Processes

IJCAI 2026

Many practical decision-making problems involve tasks whose success depends on the entire system history, rather than on achieving a state with desired properties. Markovian Reinforcement Learning (RL) can be inadequate for such tasks, while modeling them as non-Markovian reward decision processes (

Cited by 1Scholar
2024

Mimicking Behaviors in Separated Domains (Abstract Reprint)

AAAI 2024technical

Devising a strategy to make a system mimic behaviors from another system is a problem that naturally arises in many areas of Computer Science. In this work, we interpret this problem in the context of intelligent agents, from the perspective of LTLf, a formalism commonly used in AI for expressing fi…

Cited by 0SourcePDFScholar
2023

Exploiting Multiple Abstractions in Episodic RL via Reward Shaping

AAAI 2023technical

One major limitation to the applicability of Reinforcement Learning (RL) to many practical domains is the large number of samples required to learn an optimal policy. To address this problem and improve learning efficiency, we consider a linear hierarchy of abstraction layers of the Markov Decision…

2023

Monitoring Arithmetic Temporal Properties on Finite Traces

AAAI 2023technical

We study monitoring of linear-time arithmetic properties against finite traces generated by an unknown dynamic system. The monitoring state is determined by considering at once the trace prefix seen so far, and all its possible finite-length, future continuations. This makes monitoring at least as h…

Cited by 13SourcePDFScholar
2022

Situation Calculus for Controller Synthesis in Manufacturing Systems with First-Order State Representation (Extended Abstract)

IJCAI 2022poster

Manufacturing is transitioning from a mass production model to a service model in which facilities `bid' for previously unseen products. To decide whether to bid for a previously unseen product, a facility must be able to synthesize, on the fly, a process plan controller that delegates abstract manu…

Cited by 16SourcePDFScholar
2022

Verification and Monitoring for First-Order LTL with Persistence-Preserving Quantification over Finite and Infinite Traces

IJCAI 2022poster

We address the problem of model checking first-order dynamic systems where new objects can be injected in the active domain during execution. Notable examples are systems induced by a first-order action theory, e.g., expressed in the Situation Calculus. Recent results have shown that, under the st…

Cited by 21SourcePDFScholar