Bhavya Kumar Agrawalla

floq: Training Critics via Flow-Matching for Scaling Compute in Value-Based RL

A hallmark of modern large-scale machine learning techniques is the use of training objectives that provide dense supervision to intermediate computations, such as teacher forcing the next token in language models or denoising step-by-step in diffusion models. This enables models to learn complex fu…