Eun-Yeol Ma

Inverse-Reference Priors for Fisher Regularization of Bayesian Neural Networks

Recent studies have shown that the generalization ability of deep neural networks (DNNs) is closely related to the Fisher information matrix (FIM) calculated during the early training phase. Several methods have been proposed to regularize the FIM for increased generalization of DNNs. However, they…