← Search

Dading Chong

6 accepted papers

2025

Aligning Language Models Using Follow-up Likelihood as Reward Signal

AAAI 2025technical

In natural human-to-human conversations, participants often receive feedback signals from one another based on their follow-up reactions. These reactions can include verbal responses, facial expressions, changes in emotional state, and other non-verbal cues. Similarly, in human-machine interactions,…

2024

TS-Align: A Teacher-Student Collaborative Framework for Scalable Iterative Finetuning of Large Language Models

EMNLP 2024finding

Mainstream approaches to aligning large language models (LLMs) heavily rely on human preference data, particularly when models require periodic updates. The standard process for iterative alignment of LLMs involves collecting new human feedback for each update. However, the data collection process i…

2023

Benchmarking Large Language Models on CMExam - A comprehensive Chinese Medical Exam Dataset

NeurIPS 2023poster

Recent advancements in large language models (LLMs) have transformed the field of question answering (QA). However, evaluating LLMs in the medical field is challenging due to the lack of standardized and comprehensive datasets. To address this gap, we introduce CMExam, sourced from the Chinese Natio…

2023

GreenPLM: Cross-Lingual Transfer of Monolingual Pre-Trained Language Models at Almost No Cost

IJCAI 2023poster

Large pre-trained models have revolutionized natural language processing (NLP) research and applications, but high training costs and limited data resources have prevented their benefits from being shared equally amongst speakers of all the world's languages. To address issues of cross-linguistic ac…

2023

Masked Spectrogram Prediction for Self-Supervised Audio Pre-Training

ICASSP 2023accepted

Transformer-based models attain excellent results and generalize well when trained on sufficient amounts of data. However, constrained by the limited data available in the audio domain, most transformer-based models for audio tasks are finetuned from pre-trained models in other domains (e.g. image),…

Cited by 0SourceScholar
2022

METS-CoV: A Dataset of Medical Entity and Targeted Sentiment on COVID-19 Related Tweets

NeurIPS 2022accept

The COVID-19 pandemic continues to bring up various topics discussed or debated on social media. In order to explore the impact of pandemics on people's lives, it is crucial to understand the public's concerns and attitudes towards pandemic-related entities (e.g., drugs, vaccines) on social media. H…