← Search

Rashish Tandon

2 accepted papers

2018

Gradient Coding from Cyclic MDS Codes and Expander Graphs

ICML 2018oral

Gradient coding is a technique for straggler mitigation in distributed learning. In this paper we design novel gradient codes using tools from classical coding theory, namely, cyclic MDS codes, which compare favourably with existing solutions, both in the applicable range of parameters and in the co…

Cited by 223SourcePDFScholar
2017

Gradient Coding: Avoiding Stragglers in Distributed Learning

ICML 2017poster

We propose a novel coding theoretic framework for mitigating stragglers in distributed learning. We show how carefully replicating data blocks and coding across gradients can provide tolerance to failures and stragglers for synchronous Gradient Descent. We implement our schemes in python (using MPI)…

Cited by 590SourcePDFScholar