AAAI 2026technical0 citations
ProFuser: Progressive Fusion of Large Language Models
Tianyuan Shi, Fanqi Wan, Canbin Huang, Xiaojun Quan, Chenliang Li, Ming Yan, Ji Zhang, Minhua Huang
Abstract
While fusing the capacities and advantages of various large language models offers a pathway to construct more powerful and versatile models, a fundamental challenge is to properly select advantageous model during training. Existing fusion methods primarily focus on the training mode that uses cross entropy on ground truth in a teacher-forcing setup to measure a model
BibTeX
@inproceedings{aaai2026_profuserprogress,
title = {ProFuser: Progressive Fusion of Large Language Models},
author = {Tianyuan Shi and Fanqi Wan and Canbin Huang and Xiaojun Quan and Chenliang Li and Ming Yan and Ji Zhang and Minhua Huang and Wu Kai},
booktitle = {AAAI 2026},
year = {2026}
}