← Search

Rongqi Fan

4 accepted papers

2025

Towards Cost-Effective Reward Guided Text Generation

ICML 2025poster

Reward-guided text generation (RGTG) has emerged as a viable alternative to offline reinforcement learning from human feedback (RLHF). RGTG methods can align baseline language models to human preferences without further training as in standard RLHF methods. However, they rely on a reward model to…

Cited by 1SourcePDFScholar
2024

GenAI Arena: An Open Evaluation Platform for Generative Models

NeurIPS 2024poster

Generative AI has made remarkable strides to revolutionize fields such as image and video generation. These advancements are driven by innovative algorithms, architecture, and data. However, the rapid proliferation of generative models has highlighted a critical gap: the absence of trustworthy evalu…

Cited by 18SourcePDFScholar
2024

MMLU-Pro: A More Robust and Challenging Multi-Task Language Understanding Benchmark

NeurIPS 2024spotlight

In the age of large-scale language models, benchmarks like the Massive Multitask Language Understanding (MMLU) have been pivotal in pushing the boundaries of what AI can achieve in language comprehension and reasoning across diverse domains. However, as models continue to improve, their performance…

Cited by 269SourcePDFScholar
2024

VideoScore: Building Automatic Metrics to Simulate Fine-grained Human Feedback for Video Generation

EMNLP 2024main

The recent years have witnessed great advances in video generation. However, the development of automatic video metrics is lagging significantly behind. None of the existing metric is able to provide reliable scores over generated videos. The main barrier is the lack of large-scale human-annotated d…