Ryan Anderson

The Value Function Semi-Algebraic Set in Partially Observable Markov Decision Processes

We study the geometry of feasible value functions in infinite-horizon partially observable Markov decision processes (POMDPs) under memoryless stochastic policies. Our main contribution is a characterization of the feasible set of value functions as a semi-algebraic set, defined by explicit polynomi…