Dinh Q. Phung

On Cross-Layer Alignment for Model Fusion of Heterogeneous Neural Networks

OTFusion, or layer-wise model fusion via optimal transport, applies soft neuron association to unify different pre-trained networks. Despite its effectiveness in saving computational resources, OTFusion requires the input networks to have the same number of layers. To address this issue, we propose…