Yan Lei — accepted AI-conference papers

2024

Qsnail: A Questionnaire Dataset for Sequential Question Generation

Yan Lei, Liang Pang, Yuanzhuo Wang, Huawei Shen, Xueqi Cheng

COLING 2024main

The questionnaire is a professional research methodology used for both qualitative and quantitative analysis of human opinions, preferences, attitudes, and behaviors. However, designing and evaluating questionnaires demands significant effort due to their intricate and complex structure. Questionnai…

Cited by 2 Source ↗PDF ↗code ↗Scholar ↗

2024

Taking a Deep Breath: Enhancing Language Modeling of Large Language Models with Sentinel Tokens

Weiyao Luo, Suncong Zheng, Heming Xia, Weikang Wang, Yan Lei, Tianyu Liu +2

EMNLP 2024finding

Large language models (LLMs) have shown promising efficacy across various tasks, becoming powerful tools in numerous aspects of human life. However, Transformer-based LLMs suffer a performance degradation when modeling long-term contexts due to they discard some information to reduce computational o…

Cited by 2 Source ↗PDF ↗code ↗Scholar ↗