← Search

Ishan Durugkar

9 accepted papers

2023

DM²: Decentralized Multi-Agent Reinforcement Learning via Distribution Matching

AAAI 2023technical

Current approaches to multi-agent cooperation rely heavily on centralized mechanisms or explicit communication protocols to ensure convergence. This paper studies the problem of distributed multi-agent learning without resorting to centralized components or explicit communication. It examines the us…

2023

f-Policy Gradients: A General Framework for Goal-Conditioned RL using f-Divergences

NeurIPS 2023poster

Goal-Conditioned Reinforcement Learning (RL) problems often have access to sparse rewards where the agent receives a reward signal only when it has achieved the goal, making policy optimization a difficult problem. Several works augment this sparse reward with a learned dense reward function, but…

2021

Adversarial Intrinsic Motivation for Reinforcement Learning

NeurIPS 2021poster

Learning with an objective to minimize the mismatch with a reference distribution has been shown to be useful for generative modeling and imitation learning. In this paper, we investigate whether one such objective, the Wasserstein-1 distance between a policy's state visitation distribution and a ta…

2020

An Imitation from Observation Approach to Transfer Learning with Dynamics Mismatch

NeurIPS 2020poster

We examine the problem of transferring a policy learned in a source environment to a target environment with different dynamics, particularly in the case where it is critical to reduce the amount of interaction with the target environment during learning. This problem is particularly important in si…

2020

Balancing Individual Preferences and Shared Objectives in Multiagent Reinforcement Learning

IJCAI 2020poster

In multiagent reinforcement learning scenarios, it is often the case that independent agents must jointly learn to perform a cooperative task. This paper focuses on such a scenario in which agents have individual preferences regarding how to accomplish the shared task. We consider a framework for th…

Cited by 0SourcePDFScholar
2020

Reducing Sampling Error in Batch Temporal Difference Learning

ICML 2020poster

Temporal difference (TD) learning is one of the main foundations of modern reinforcement learning. This paper studies the use of TD(0), a canonical TD algorithm, to estimate the value function of a given policy from a batch of data. In this batch setting, we show that TD(0) may converge to an inaccu…

Cited by 16SourcePDFScholar
2018

Go for a Walk and Arrive at the Answer: Reasoning Over Paths in Knowledge Bases using Reinforcement Learning

ICLR 2018poster

Knowledge bases (KB), both automatically and manually constructed, are often incomplete --- many valid facts can be inferred from the KB by synthesizing existing information. A popular approach to KB completion is to infer new relations by combinatory reasoning over the information found along other…