Sean R. Sinclair — accepted AI-conference papers

2026

Is Pure Exploitation Sufficient in Exogenous MDPs with Linear Function Approximation?

Hao Liang, Jiayu Cheng, Sean R. Sinclair, Yali Du

ICLR 2026poster

Exogenous MDPs (Exo-MDPs) capture sequential decision-making where uncertainty comes solely from exogenous inputs that evolve independently of the learner’s actions. This structure is especially common in operations research applications such as inventory control, energy storage, and resource alloca…

Cited by 0 Source ↗Scholar ↗

2023

Hindsight Learning for MDPs with Exogenous Inputs

Sean R. Sinclair, Felipe Vieira Frujeri, Ching-An Cheng, Luke Marshall, Hugo De Oliveira Barbalho, Jingling Li +3

ICML 2023poster

Many resource management problems require sequential decision-making under uncertainty, where the only uncertainty affecting the decision outcomes are exogenous variables outside the control of the decision-maker. We model these problems as Exo-MDPs (Markov Decision Processes with Exogenous Inputs)…

Cited by 26 Source ↗PDF ↗code ↗Scholar ↗