← Search

Katayoon Goshvadi

3 accepted papers

2025

Value-Incentivized Preference Optimization: A Unified Approach to Online and Offline RLHF

ICLR 2025poster

Reinforcement learning from human feedback (RLHF) has demonstrated great promise in aligning large language models (LLMs) with human preference. Depending on the availability of preference data, both online and offline RLHF are active areas of investigation. A key bottleneck is understanding how to…

Cited by 31SourcePDFScholar
2023

DISCS: A Benchmark for Discrete Sampling

NeurIPS 2023poster

Sampling in discrete spaces, with critical applications in simulation and optimization, has recently been boosted by significant advances in gradient-based approaches that exploit modern accelerators like GPUs. However, two key challenges are hindering further advancement in research on discrete sam…

2023

Revisiting Sampling for Combinatorial Optimization

ICML 2023poster

Sampling approaches like Markov chain Monte Carlo were once popular for combinatorial optimization, but the inefficiency of classical methods and the need for problem-specific designs curtailed ongoing development. Recent work has favored data-driven approaches that mitigate the need for hand-craft…

Cited by 18SourcePDFScholar