Compositional Behavioral Semantics and Metrics for State Abstraction in Reinforcement Learning
State abstraction plays a central role in scaling reinforcement learning to complex but structured systems. In studying such systems, a wide range of behavioral structures have been proposed in reinforcement learning, including value functions, invariants, bisimulation relations, and behavioral metr…