← Search

Toshinori Kitamura

5 accepted papers

2026

Emergence of Exploration in Policy Gradient Reinforcement Learning via Retrying

ICML 2026poster

In reinforcement learning (RL), agents benefit from exploration *only* because they repeatedly encounter similar states: trying different actions can improve performance or reduce uncertainty; without such retries, a greedy policy is optimal. We formalize this intuition with **ReMax**, an objective …

Cited by 0SourceScholar
2025

A Comprehensive Survey on Physical Risk Control in the Era of Foundation Model-enabled Robotics

IJCAI 2025

Recent Foundation Model-enabled robotics (FMRs) display greatly improved general-purpose skills, enabling more adaptable automation than conventional robotics. Their ability to handle diverse tasks thus creates new opportunities to replace human labor. However, unlike general foundation models, FMRs

Cited by 0SourcePDFScholar
2025

Near-Optimal Policy Identification in Robust Constrained Markov Decision Processes via Epigraph Form

ICLR 2025poster

Designing a safe policy for uncertain environments is crucial in real-world control systems. However, this challenge remains inadequately addressed within the Markov decision process (MDP) framework. This paper presents the first algorithm guaranteed to identify a near-optimal policy in a robust con…

2025

Provably Efficient RL under Episode-Wise Safety in Constrained MDPs with Linear Function Approximation

NeurIPS 2025spotlight

We study the reinforcement learning (RL) problem in a constrained Markov decision process (CMDP), where an agent explores the environment to maximize the expected cumulative reward while satisfying a single constraint on the expected total utility value in every episode. While this problem is well u…

Cited by 0SourceScholar
2023

Regularization and Variance-Weighted Regression Achieves Minimax Optimality in Linear MDPs: Theory and Practice

ICML 2023poster

Mirror descent value iteration (MDVI), an abstraction of Kullback-Leibler (KL) and entropy-regularized reinforcement learning (RL), has served as the basis for recent high-performing practical RL algorithms. However, despite the use of function approximation in practice, the theoretical understandin…