← Search

Yuanhao Yue

5 accepted papers

2025

Building a Family of Data Augmentation Models for Low-cost LLM Fine-tuning on the Cloud

COLING 2025industry

Specializing LLMs in various domain-specific tasks has emerged as a critical step towards achieving high performance. However, the construction and annotation of datasets in specific domains are always very costly. Apart from using superior and expensive closed-source LLM APIs to construct datasets,…

2025

SuperGPQA: Scaling LLM Evaluation across 285 Graduate Disciplines

NeurIPS 2025poster

Large language models (LLMs) have demonstrated remarkable proficiency in mainstream academic disciplines such as mathematics, physics, and computer science. However, human knowledge encompasses over 200 specialized disciplines, far exceeding the scope of existing benchmarks. The capabilities of LLMs…

Cited by 215SourceScholar
2024

Distilling Instruction-following Abilities of Large Language Models with Task-aware Curriculum Planning

EMNLP 2024finding

Instruction tuning aims to align large language models (LLMs) with open-domain instructions and human-preferred responses. While several studies have explored autonomous approaches to distilling and annotating instructions from powerful proprietary LLMs, such as ChatGPT, they often neglect the impac…

2023

Evaluating Open-QA Evaluation

NeurIPS 2023poster

This study focuses on the evaluation of the Open Question Answering (Open-QA) task, which can directly estimate the factuality of large language models (LLMs). Current automatic evaluation methods have shown limitations, indicating that human evaluation still remains the most reliable approach. We i…