← Search

Somjit Nath

5 accepted papers

2026

When does predictive inverse dynamics outperform behavior cloning?

ICML 2026poster

Behavior cloning (BC) is a practical offline imitation learning method, but it often fails when expert demonstrations are limited. Recent works have introduced a class of architectures named predictive inverse dynamics models (PIDM) that combine a future state predictor with an inverse dynamics mode…

Cited by 0SourceScholar
2023

Discovering Object-Centric Generalized Value Functions From Pixels

ICML 2023poster

Deep Reinforcement Learning has shown significant progress in extracting useful representations from high-dimensional inputs albeit using hand-crafted auxiliary tasks and pseudo rewards. Automatically learning such representations in an object-centric manner geared towards control and fast adaptatio…

2023

Prioritizing Samples in Reinforcement Learning with Reducible Loss

NeurIPS 2023poster

Most reinforcement learning algorithms take advantage of an experience replay buffer to repeatedly train on samples the agent has observed in the past. Not all samples carry the same amount of significance and simply assigning equal importance to each of the samples is a naïve strategy. In this pape…

Cited by 21SourcePDFScholar
2020

Training Recurrent Neural Networks Online by Learning Explicit State Variables

ICLR 2020poster

Recurrent neural networks (RNNs) allow an agent to construct a state-representation from a stream of experience, which is essential in partially observable problems. However, there are two primary issues one must overcome when training an RNN: the sensitivity of the learning algorithm's performance…

Cited by 6SourceScholar
2019

Two-Timescale Networks for Nonlinear Value Function Approximation

ICLR 2019poster

A key component for many reinforcement learning agents is to learn a value function, either for policy evaluation or control. Many of the algorithms for learning values, however, are designed for linear function approximation---with a fixed basis or fixed representation. Though there have been a few…

Cited by 57SourcePDFScholar