← Search

Gopeshh Subbaraj

3 accepted papers

2025

Enabling Realtime Reinforcement Learning at Scale with Staggered Asynchronous Inference

ICLR 2025poster

Realtime environments change even as agents perform action inference and learning, thus requiring high interaction frequencies to effectively minimize regret. However, recent advances in machine learning involve larger neural networks with longer inference times, raising questions about their applic…

2025

Pretraining Generative Flow Networks with Inexpensive Rewards for Molecular Graph Generation

ICML 2025poster

Generative Flow Networks (GFlowNets) have recently emerged as a suitable framework for generating diverse and high-quality molecular structures by learning from rewards treated as unnormalized distributions. Previous works in this framework often restrict exploration by using predefined molecular fr…

2025

Seq-VCR: Preventing Collapse in Intermediate Transformer Representations for Enhanced Reasoning

ICLR 2025poster

Decoder-only Transformers often struggle with complex reasoning tasks, particularly arithmetic reasoning requiring multiple sequential operations. In this work, we identify representation collapse in the model’s intermediate layers as a key factor limiting their reasoning capabilities. To address th…