AISTATS 2021poster15 citations
Hierarchical Clustering in General Metric Spaces using Approximate Nearest Neighbors
Benjamin Moseley, Sergei Vassilvtiskii, Yuyan Wang
Abstract
Hierarchical clustering is a widely used data analysis method, but suffers from scalability issues, requiring quadratic time in general metric spaces. In this work, we demonstrate how approximate nearest neighbor (ANN) queries can be used to improve the running time of the popular single-linkage and average-linkage methods. Our proposed algorithms are the first subquadratic time algorithms for non-Euclidean metrics. We complement our theoretical analysis with an empirical evaluation showcasing our methods’ efficiency and accuracy.
BibTeX
@InProceedings{pmlr-v130-moseley21a,
title = { Hierarchical Clustering in General Metric Spaces using Approximate Nearest Neighbors },
author = {Moseley, Benjamin and Vassilvtiskii, Sergei and Wang, Yuyan},
booktitle = {Proceedings of The 24th International Conference on Artificial Intelligence and Statistics},
pages = {2440--2448},
year = {2021},
editor = {Banerjee, Arindam and Fukumizu, Kenji},
volume = {130},
series = {Proceedings of Machine Learning Research},
month = {13--15 Apr},
publisher = {PMLR},
pdf = {http://proceedings.mlr.press/v130/moseley21a/moseley21a.pdf},
url = {https://proceedings.mlr.press/v130/moseley21a.html},
abstract = { Hierarchical clustering is a widely used data analysis method, but suffers from scalability issues, requiring quadratic time in general metric spaces. In this work, we demonstrate how approximate nearest neighbor (ANN) queries can be used to improve the running time of the popular single-linkage and average-linkage methods. Our proposed algorithms are the first subquadratic time algorithms for non-Euclidean metrics. We complement our theoretical analysis with an empirical evaluation showcasing our methods’ efficiency and accuracy. }
}