← Search

Will Overman

2 accepted papers

2022

Global Convergence of Multi-Agent Policy Gradient in Markov Potential Games

ICLR 2022poster

Potential games are arguably one of the most important and widely studied classes of normal form games. They define the archetypal setting of multi-agent coordination in which all agents utilities are perfectly aligned via a common potential function. Can this intuitive framework be transplanted in…

Cited by 160SourcePDFScholar
2022

Independent Natural Policy Gradient always converges in Markov Potential Games

AISTATS 2022poster

Natural policy gradient has emerged as one of the most successful algorithms for computing optimal policies in challenging Reinforcement Learning (RL) tasks, yet, very little was known about its convergence properties until recently. The picture becomes more blurry when it comes to multi-agent RL (M…

Cited by 64SourcePDFScholar