← Search

Raghav Somani

6 accepted papers

2021

LLC: Accurate, Multi-purpose Learnt Low-dimensional Binary Codes

NeurIPS 2021poster

Learning binary representations of instances and classes is a classical problem with several high potential applications. In modern settings, the compression of high-dimensional neural representations to low-dimensional binary codes is a challenging task and often require large bit-codes to be accur…

2021

SPECTRE: defending against backdoor attacks using robust statistics

ICML 2021accepted

Modern machine learning increasingly requires training on a large collection of data from multiple sources, not all of which can be trusted. A particularly frightening scenario is when a small fraction of corrupted data changes the behavior of the trained model when triggered by an attacker-specifie…

2020

Robust Meta-learning for Mixed Linear Regression with Small Batches

NeurIPS 2020poster

A common challenge faced in practical supervised learning, such as medical image processing and robotic interactions, is that there are plenty of tasks but each task cannot afford to collect enough labeled examples to be learned in isolation. However, by exploiting the similarities across those task…

Cited by 43SourcePDFScholar
2020

Soft Threshold Weight Reparameterization for Learnable Sparsity

ICML 2020poster

Sparsity in Deep Neural Networks (DNNs) is studied extensively with the focus of maximizing prediction accuracy given an overall parameter budget. Existing methods rely on uniform or heuristic non-uniform sparsity budgets which have sub-optimal layer-wise parameter allocation resulting in a) lower p…

2018

Support Recovery for Orthogonal Matching Pursuit: Upper and Lower bounds

NeurIPS 2018spotlight

This paper studies the problem of sparse regression where the goal is to learn a sparse vector that best optimizes a given objective function. Under the assumption that the objective function satisfies restricted strong convexity (RSC), we analyze orthogonal matching pursuit (OMP), a greedy algorith…

Cited by 8SourcePDFScholar