← Search

Matthew Mattina

6 accepted papers

2022

UDC: Unified DNAS for Compressible TinyML Models for Neural Processing Units

NeurIPS 2022accept

Deploying TinyML models on low-cost IoT hardware is very challenging, due to limited device memory capacity. Neural processing unit (NPU) hardware address the memory challenge by using model compression to exploit weight quantization and sparsity to fit more parameters in the same footprint. However…

Cited by 17SourcePDFScholar
2021

Debiasing Model Updates for Improving Personalized Federated Training

ICML 2021spotlight

We propose a novel method for federated learning that is customized specifically to the objective of a given edge device. In our proposed method, a server trains a global meta-model by collaborating with devices without actually sharing data. The trained global meta-model is then personalized locall…

Cited by 86SourcePDFScholar
2021

Federated Learning Based on Dynamic Regularization

ICLR 2021oral

We propose a novel federated learning method for distributively training neural network models, where the server orchestrates cooperation between a subset of randomly chosen devices in each round. We view Federated Learning problem primarily from a communication perspective and allow more device lev…

2021

On the effects of quantisation on model uncertainty in Bayesian neural networks

UAI 2021poster

Bayesian neural networks (BNNs) are making significant progress in many research areas where decision-making needs to be accompanied by uncertainty estimation. Being able to quantify uncertainty while making decisions is essential for understanding when the model is over-/under-confident, and hence…

2019

SpArSe: Sparse Architecture Search for CNNs on Resource-Constrained Microcontrollers

NeurIPS 2019poster

The vast majority of processors in the world are actually microcontroller units (MCUs), which find widespread use performing simple control tasks in applications ranging from automobiles to medical devices and office equipment. The Internet of Things (IoT) promises to inject machine learning into ma…