Ahana Deb

Offline RL in Regular Decision Processes: Sample Efficiency via Language Metrics

This work studies offline Reinforcement Learning (RL) in a class of non-Markovian environments called Regular Decision Processes (RDPs). In RDPs, the unknown dependency of future observations and rewards from the past interactions can be captured by some hidden finite-state automaton. For this reaso…