Hojin Ko

Beyond the Bellman Recursion: A Pontryagin-Guided Framework for Non-Exponential Discounting

Most value-based and actor-critic reinforcement learning methods rely on Bellman-style recursions, yet these recursions collapse under non-exponential discounting common in human preferences and survival processes. We show the breakdown is structural: exponential discounting sits at a fragile inters…