Collaborative Enhancement of Large and Small Models for Question Answering via Dual Knowledge Transfer

Shaofei Wang; Yunan Liu; Xiaolan Tang; Wenlong Chen

AAAI 2026technical0 citations

Collaborative Enhancement of Large and Small Models for Question Answering via Dual Knowledge Transfer

Shaofei Wang, Yunan Liu, Xiaolan Tang, Wenlong Chen

Abstract

Our statistical analysis reveals a complementary phenomenon between large language model-based question answering (QA) and small model-based QA. To facilitate dual knowledge transfer between these two paradigms, this paper introduces a collaborative enhancement method of large and small models for question answering. The proposed method consists of two iterative steps: i) small4large step, in which the small model first predicts an answer for a given question along with its confidence, and these results are then leveraged as prompts to strengthen the large model

BibTeX

@inproceedings{aaai2026_collaborativeenh,
  title = {Collaborative Enhancement of Large and Small Models for Question Answering via Dual Knowledge Transfer},
  author = {Shaofei Wang and Yunan Liu and Xiaolan Tang and Wenlong Chen},
  booktitle = {AAAI 2026},
  year = {2026}
}