Hande Celikkanat

A Closer Look at Parameter Contributions When Training Neural Language and Translation Models

We analyze the learning dynamics of neural language and translation models using Loss Change Allocation (LCA), an indicator that enables a fine-grained analysis of parameter updates when optimizing for the loss function. In other words, we can observe the contributions of different network component…