AISTATS 2023poster5 citations
Gradient-Informed Neural Network Statistical Robustness Estimation
Karim TIT, Teddy Furon, Mathias Rousset
Abstract
Deep neural networks are robust against random corruptions of the inputs to some extent. This global sense of safety is not sufficient in critical applications where probabilities of failure must be assessed with accuracy. Some previous works applied known statistical methods from the field of rare event analysis to classification. Yet, they use classifiers as black-box models without taking into account gradient information, readily available for deep learning models via auto-differentiation. We propose a new and highly efficient estimator of probabilities of failure dedicated to neural networks as it leverages the fast computation of gradients of the model through back-propagation.
BibTeX
@InProceedings{pmlr-v206-tit23a,
title = {Gradient-Informed Neural Network Statistical Robustness Estimation},
author = {TIT, Karim and Furon, Teddy and Rousset, Mathias},
booktitle = {Proceedings of The 26th International Conference on Artificial Intelligence and Statistics},
pages = {323--334},
year = {2023},
editor = {Ruiz, Francisco and Dy, Jennifer and van de Meent, Jan-Willem},
volume = {206},
series = {Proceedings of Machine Learning Research},
month = {25--27 Apr},
publisher = {PMLR},
pdf = {https://proceedings.mlr.press/v206/tit23a/tit23a.pdf},
url = {https://proceedings.mlr.press/v206/tit23a.html},
abstract = {Deep neural networks are robust against random corruptions of the inputs to some extent. This global sense of safety is not sufficient in critical applications where probabilities of failure must be assessed with accuracy. Some previous works applied known statistical methods from the field of rare event analysis to classification. Yet, they use classifiers as black-box models without taking into account gradient information, readily available for deep learning models via auto-differentiation. We propose a new and highly efficient estimator of probabilities of failure dedicated to neural networks as it leverages the fast computation of gradients of the model through back-propagation.}
}