← Search

Siddarth Venkatraman

7 accepted papers

2025

Outsourced Diffusion Sampling: Efficient Posterior Inference in Latent Spaces of Generative Models

ICML 2025poster

Any well-behaved generative model over a variable $\mathbf{x}$ can be expressed as a deterministic transformation of an exogenous (‘*outsourced'*) Gaussian noise variable $\mathbf{z}$: $\mathbf{x}=f_\theta(\mathbf{z})$. In such a model (*eg*, a VAE, GAN, or continuous-time flow-based model), sampli…

Cited by 0SourcePDFScholar
2025

Trajectory Balance with Asynchrony: Decoupling Exploration and Learning for Fast, Scalable LLM Post-Training

NeurIPS 2025poster

Reinforcement learning (RL) is a critical component of large language model (LLM) post-training. However, on-policy algorithms used for post-training are not naturally robust to a diversified content of experience replay buffers, which asynchronous off-policy actors can efficiently populate in paral…

Cited by 0SourcecodeScholar
2024

Amortizing intractable inference in diffusion models for vision, language, and control

NeurIPS 2024poster

Diffusion models have emerged as effective distribution estimators in vision, language, and reinforcement learning, but their use as priors in downstream tasks poses an intractable posterior inference problem. This paper studies *amortized* sampling of the posterior over data, $\mathbf{x}\sim p^{\rm…

2024

Reasoning with Latent Diffusion in Offline Reinforcement Learning

ICLR 2024poster

Offline reinforcement learning (RL) holds promise as a means to learn high-reward policies from a static dataset, without the need for further environment interactions. However, a key challenge in offline RL lies in effectively stitching portions of suboptimal trajectories from the static dataset wh…

2023

Learning Temporally AbstractWorld Models without Online Experimentation

ICML 2023poster

Agents that can build temporally abstract representations of their environment are better able to understand their world and make plans on extended time scales, with limited computational power and modeling capacity. However, existing methods for automatically learning temporally abstract world mode…

Cited by 8SourcePDFScholar
2023

Multi-Alpha Soft Actor-Critic: Overcoming Stochastic Biases in Maximum Entropy Reinforcement Learning

ICRA 2023poster

The successful application of robotic control requires intelligent decision-making to handle the long tail of complex scenarios that arise in real-world environments. Recently, Deep Reinforcement Learning (DRL) has provided a data-driven framework to automatically learn effective policies in such co…

Cited by 3SourceScholar
2022

MLNav: Learning to Safely Navigate on Martian Terrains

RA-L 2022

We present <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">MLNav</i> , a learning-enhanced path planning framework for safety-critical and resource-limited systems operating in complex environments, such as rovers navigating on Mars. MLNav makes judi

Cited by 23SourceScholar