← Search

Zhiyuan Yao

5 accepted papers

2026

$V_0$: A Generalist Value Model for Any Policy at State Zero

ICML 2026poster

Traditional value models $V^{\pi}$ in LLM reinforcement learning face a coupling dilemma: they require synchronous training alongside the updating policy $\pi$, causing inefficiency and overfitting. In this paper, we propose $V_0$, a generalist value model that decouples value estimation from specif…

Cited by 0SourceScholar
2026

Cat-PO: Cross-modal Adaptive Token-rewards for Preference Optimization in Truthful Multimodal LLMs

ICLR 2026poster

Multi-modal Large Language Models (MLLMs) have shown remarkable generative capabilities across multi-modal tasks, yet remain plagued by hallucinations where generated textual contents are semantically inconsistent with the input images. This work reveals that existing multi-modal preference optimiza…

Cited by 0SourceScholar
2024

FinBen: A Holistic Financial Benchmark for Large Language Models

NeurIPS 2024poster

LLMs have transformed NLP and shown promise in various fields, yet their potential in finance is underexplored due to a lack of comprehensive benchmarks, the rapid development of LLMs, and the complexity of financial tasks. In this paper, we introduce FinBen, the first extensive open-source evaluati…

2024

FinCon: A Synthesized LLM Multi-Agent System with Conceptual Verbal Reinforcement for Enhanced Financial Decision Making

NeurIPS 2024poster

Large language models (LLMs) have demonstrated notable potential in conducting complex tasks and are increasingly utilized in various financial applications. However, high-quality sequential financial investment decision-making remains challenging. These tasks require multiple interactions with a vo…

2022

Learning Distributed and Fair Policies for Network Load Balancing as Markov Potential Game

NeurIPS 2022accept

This paper investigates the network load balancing problem in data centers (DCs) where multiple load balancers (LBs) are deployed, using the multi-agent reinforcement learning (MARL) framework. The challenges of this problem consist of the heterogeneous processing architecture and dynamic environmen…