Ole J. Mengshoel

Graphical Models Meet Bandits: A Variational Thompson Sampling Approach

We propose a novel framework for structured bandits, which we call an influence diagram bandit. Our framework uses a graphical model to capture complex statistical dependencies between actions, latent variables, and observations; and thus unifies and extends many existing models, such as combinatori…