Hanna Mazzawi

Deep Fusion: Efficient Network Training via Pre-trained Initializations

Training deep neural networks for large language models (LLMs) remains computationally very expensive. To mitigate this, network growing algorithms offer potential cost savings, but their underlying mechanisms are poorly understood. In this paper, we propose a theoretical framework using backward er…