Markel Zubia — accepted AI-conference papers

2026

Missingness-MDPs: Bridging the Theory of Missing Data and POMDPs

Joshua Wendland, Markel Zubia, Roman Andriushchenko, Maris F. L. Galesloot, Milan Češka, Henrik von Kleist +3

IJCAI 2026

We introduce missingness-MDPs (miss-MDPs), a novel subclass of partially observable Markov decision processes (POMDPs) that incorporates the theory of missing data. A miss-MDP is a POMDP whose observation function is a missingness function, specifying the probability that individual state features a

Cited by 0 Scholar ↗

2025

Robust Transfer of Safety-Constrained Reinforcement Learning Agents

Markel Zubia, Thiago D. Simão, Nils Jansen

ICLR 2025poster

Reinforcement learning (RL) often relies on trial and error, which may cause undesirable outcomes. As a result, standard RL is inappropriate for safety-critical applications. To address this issue, one may train a safe agent in a controlled environment (where safety violations are allowed) and then…

Cited by 0 Source ↗PDF ↗Scholar ↗