Wanshun Chen — accepted AI-conference papers

2024

Anchor-based Large Language Models

Jianhui Pang, Fanghua Ye, Derek Wong, Xin He, Wanshun Chen, Longyue Wang

ACL 2024findings

Large language models (LLMs) predominantly employ decoder-only transformer architectures, necessitating the retention of keys/values information for historical tokens to provide contextual information and avoid redundant computation. However, the substantial size and parameter volume of these LLMs r…

Cited by 14 Source ↗PDF ↗code ↗Scholar ↗

2024

On Diversified Preferences of Large Language Model Alignment

Dun Zeng, Yong Dai, Pengyu Cheng, Longyue Wang, Tianhao Hu, Wanshun Chen +2

EMNLP 2024finding

Aligning large language models (LLMs) with human preferences has been recognized as the key to improving LLMs’ interaction quality. However, in this pluralistic world, human preferences can be diversified due to annotators’ different tastes, which hinders the effectiveness of LLM alignment methods.…

Cited by 11 Source ↗PDF ↗code ↗Scholar ↗