← Search

Morteza Ramezani

3 accepted papers

2022

Learn Locally, Correct Globally: A Distributed Algorithm for Training Graph Neural Networks

ICLR 2022poster

Despite the recent success of Graph Neural Networks (GNNs), training GNNs on large graphs remains challenging. The limited resource capacities of the existing servers, the dependency between nodes in a graph, and the privacy concern due to the centralized storage and model learning have spurred the…

Cited by 44SourcePDFScholar
2021

On Provable Benefits of Depth in Training Graph Convolutional Networks

NeurIPS 2021poster

Graph Convolutional Networks (GCNs) are known to suffer from performance degradation as the number of layers increases, which is usually attributed to over-smoothing. Despite the apparent consensus, we observe that there exists a discrepancy between the theoretical understanding of over-smoothing an…

2020

GCN meets GPU: Decoupling “When to Sample” from “How to Sample”

NeurIPS 2020poster

Sampling-based methods promise scalability improvements when paired with stochastic gradient descent in training Graph Convolutional Networks (GCNs). While effective in alleviating the neighborhood explosion, due to bandwidth and memory bottlenecks, these methods lead to computational overheads in p…

Cited by 41SourcePDFScholar