2023
Information Plane Analysis for Dropout Neural Networks
ICLR 2023poster
The information-theoretic framework promises to explain the predictive power of neural networks. In particular, the information plane analysis, which measures mutual information (MI) between input and representation as well as representation and output, should give rich insights into the training pr…