Differentiable Clustering with Perturbed Spanning Forests

Lawrence Stewart; Francis Bach; Felipe Llinares-López; Quentin Berthet

NeurIPS 2023poster10 citations

Differentiable Clustering with Perturbed Spanning Forests

Lawrence Stewart, Francis Bach, Felipe Llinares-López, Quentin Berthet

Abstract

We introduce a differentiable clustering method based on stochastic perturbations of minimum-weight spanning forests. This allows us to include clustering in end-to-end trainable pipelines, with efficient gradients. We show that our method performs well even in difficult settings, such as data sets with high noise and challenging geometries. We also formulate an ad hoc loss to efficiently learn from partial clustering data using this operation. We demonstrate its performance on several data sets for supervised and semi-supervised tasks.

Structured learningClusteringDifferentiableweakly supervisedsemi-supervisedrepresentation learning

BibTeX

@inproceedings{
stewart2023differentiable,
title={Differentiable Clustering with Perturbed Spanning Forests},
author={Lawrence Stewart and Francis Bach and Felipe Llinares-L{\'o}pez and Quentin Berthet},
booktitle={Thirty-seventh Conference on Neural Information Processing Systems},
year={2023},
url={https://openreview.net/forum?id=nRfcVBsF9n}
}