← Search

Benjamin Paul Chamberlain

6 accepted papers

2023

Gradient Gating for Deep Multi-Rate Learning on Graphs

ICLR 2023poster

We present Gradient Gating (G$^2$), a novel framework for improving the performance of Graph Neural Networks (GNNs). Our framework is based on gating the output of GNN layers with a mechanism for multi-rate flow of message passing information across nodes of the underlying graph. Local gradients are…

2023

Graph Neural Networks for Link Prediction with Subgraph Sketching

ICLR 2023top-5%

Many Graph Neural Networks (GNNs) perform poorly compared to simple heuristics on Link Prediction (LP) tasks. This is due to limitations in expressive power such as the inability to count triangles (the backbone of most LP heuristics) and because they can not distinguish automorphic nodes (those hav…

2023

Hyperbolic Deep Reinforcement Learning

ICLR 2023top-25%

In deep reinforcement learning (RL), useful information about the state is inherently tied to its possible future successors. Consequently, encoding features that capture the hierarchical relationships between states into the model's latent representations is often conducive to recovering effective…

Cited by 28SourcePDFScholar
2022

Neural Sheaf Diffusion: A Topological Perspective on Heterophily and Oversmoothing in GNNs

NeurIPS 2022accept

Cellular sheaves equip graphs with a ``geometrical'' structure by assigning vector spaces and linear maps to nodes and edges. Graph Neural Networks (GNNs) implicitly assume a graph with a trivial underlying sheaf. This choice is reflected in the structure of the graph Laplacian operator, the propert…

2022

Understanding over-squashing and bottlenecks on graphs via curvature

ICLR 2022oral

Most graph neural networks (GNNs) use the message passing paradigm, in which node features are propagated on the input graph. Recent works pointed to the distortion of information flowing from distant nodes as a factor limiting the efficiency of message passing for tasks relying on long-distance int…

2021

Beltrami Flow and Neural Diffusion on Graphs

NeurIPS 2021poster

We propose a novel class of graph neural networks based on the discretized Beltrami flow, a non-Euclidean diffusion PDE. In our model, node features are supplemented with positional encodings derived from the graph topology and jointly evolved by the Beltrami flow, producing simultaneously contin…