← Search

Luka Rimanic

5 accepted papers

2022

Fine-tuning Language Models over Slow Networks using Activation Quantization with Guarantees

NeurIPS 2022accept

Communication compression is a crucial technique for modern distributed learning systems to alleviate their communication bottlenecks over slower networks. Despite recent intensive studies of gradient compression for data parallel-style training, compressing the activations for models trained with p…

Cited by 9SourcePDFScholar
2022

Which Model To Transfer? Finding the Needle in the Growing Haystack

CVPR 2022poster

Transfer learning has been recently popularized as a data-efficient alternative to training models from scratch, in particular for computer vision tasks where it provides a remarkably solid baseline. The emergence of rich model repositories, such as TensorFlow Hub, enables the practitioners and rese…

Cited by 23PDFScholar
2021

Evaluating Bayes Error Estimators on Real-World Datasets with FeeBee

NeurIPS 2021poster

The Bayes error rate (BER) is a fundamental concept in machine learning that quantifies the best possible accuracy any classifier can achieve on a fixed probability distribution. Despite years of research on building estimators of lower and upper bounds for the BER, these were usually compared only…

Cited by 9SourcecodeScholar
2021

Knowledge Enhanced Machine Learning Pipeline against Diverse Adversarial Attacks

ICML 2021spotlight

Despite the great successes achieved by deep neural networks (DNNs), recent studies show that they are vulnerable against adversarial examples, which aim to mislead DNNs by adding small adversarial perturbations. Several defenses have been proposed against such attacks, while many of them have been…

2020

On Convergence of Nearest Neighbor Classifiers over Feature Transformations

NeurIPS 2020poster

The k-Nearest Neighbors (kNN) classifier is a fundamental non-parametric machine learning algorithm. However, it is well known that it suffers from the curse of dimensionality, which is why in practice one often applies a kNN classifier on top of a (pre-trained) feature transformation. From a theore…

Cited by 13SourcePDFScholar