← Search

Guohua Tang

4 accepted papers

2025

Aligning Language Models Using Follow-up Likelihood as Reward Signal

AAAI 2025technical

In natural human-to-human conversations, participants often receive feedback signals from one another based on their follow-up reactions. These reactions can include verbal responses, facial expressions, changes in emotional state, and other non-verbal cues. Similarly, in human-machine interactions,…

2024

SoftDedup: an Efficient Data Reweighting Method for Speeding Up Language Model Pre-training

ACL 2024long

The effectiveness of large language models (LLMs) is often hindered by duplicated data in their extensive pre-training datasets. Current approaches primarily focus on detecting and removing duplicates, which risks the loss of valuable information and neglects the varying degrees of duplication. To a…

Cited by 2SourcePDFScholar
2024

TS-Align: A Teacher-Student Collaborative Framework for Scalable Iterative Finetuning of Large Language Models

EMNLP 2024finding

Mainstream approaches to aligning large language models (LLMs) heavily rely on human preference data, particularly when models require periodic updates. The standard process for iterative alignment of LLMs involves collecting new human feedback for each update. However, the data collection process i…

2023

xDial-Eval: A Multilingual Open-Domain Dialogue Evaluation Benchmark

EMNLP 2023long findings

Recent advancements in reference-free learned metrics for open-domain dialogue evaluation have been driven by the progress in pre-trained language models and the availability of dialogue data with high-quality human annotations. However, current studies predominantly concentrate on English dialogues…

Cited by 0SourcecodeScholar