← Search

Anirban Majumdar

2 accepted papers

2026

About Time: Model-Free Reinforcement Learning with Timed Reward Machines

IJCAI 2026

Reward specification plays a central role in reinforcement learning (RL), guiding the agent’s behavior. To express non-Markovian rewards, formalisms such as reward machines have been introduced to capture dependencies on histories. However, traditional reward machines lack the ability to model preci

Cited by 0Scholar
2022

Distantly Supervised Aspect Clustering And Naming For E-Commerce Reviews

NAACL 2022industry

Product aspect extraction from reviews is a critical task for e-commerce services to understand customer preferences and pain points. While aspect phrases extraction and sentiment analysis have received a lot of attention, clustering of aspect phrases and assigning human readable names to clusters i…

Cited by 7SourcePDFScholar