← Search

Grégoire Montavon

7 accepted papers

2024

MambaLRP: Explaining Selective State Space Sequence Models

NeurIPS 2024poster

Recent sequence modeling approaches using selective state space sequence models, referred to as Mamba models, have seen a surge of interest. These models allow efficient processing of long sequences in linear time and are rapidly being adopted in a wide range of applications such as language modelin…

2023

Relevant Walk Search for Explaining Graph Neural Networks

ICML 2023poster

Graph Neural Networks (GNNs) have become important machine learning tools for graph analysis, and its explainability is crucial for safety, fairness, and robustness. Layer-wise relevance propagation for GNNs (GNN-LRP) evaluates the relevance of walks to reveal important information flows in the netw…

2023

Shortcomings of Top-Down Randomization-Based Sanity Checks for Evaluations of Deep Neural Network Explanations

CVPR 2023poster

While the evaluation of explanations is an important step towards trustworthy models, it needs to be done carefully, and the employed metrics need to be well-understood. Specifically model randomization testing can be overinterpreted if regarded as a primary criterion for selecting or discarding exp…

Cited by 27SourcePDFScholar
2022

Efficient Computation of Higher-Order Subgraph Attribution via Message Passing

ICML 2022spotlight

Explaining graph neural networks (GNNs) has become more and more important recently. Higher-order interpretation schemes, such as GNN-LRP (layer-wise relevance propagation for GNN), emerged as powerful tools for unraveling how different features interact thereby contributing to explaining GNNs. GNN-…

2022

XAI for Transformers: Better Explanations through Conservative Propagation

ICML 2022spotlight

Transformers have become an important workhorse of machine learning, with numerous applications. This necessitates the development of reliable methods for increasing their transparency. Multiple interpretability methods, often based on gradient information, have been proposed. We show that the gradi…

2016

Wasserstein Training of Restricted Boltzmann Machines

NeurIPS 2016poster

Boltzmann machines are able to learn highly complex, multimodal, structured and multiscale real-world data distributions. Parameters of the model are usually learned by minimizing the Kullback-Leibler (KL) divergence from training samples to the learned model. We propose in this work a novel approac…

Cited by 150SourcePDFScholar