2022
A Closer Look at Parameter Contributions When Training Neural Language and Translation Models
COLING 2022main
We analyze the learning dynamics of neural language and translation models using Loss Change Allocation (LCA), an indicator that enables a fine-grained analysis of parameter updates when optimizing for the loss function. In other words, we can observe the contributions of different network component…