NeurIPS 2017poster5 citations

Hierarchical Methods of Moments

Matteo Ruffini, Guillaume Rabusseau, Borja Balle

Abstract

Spectral methods of moments provide a powerful tool for learning the parameters of latent variable models. Despite their theoretical appeal, the applicability of these methods to real data is still limited due to a lack of robustness to model misspecification. In this paper we present a hierarchical approach to methods of moments to circumvent such limitations. Our method is based on replacing the tensor decomposition step used in previous algorithms with approximate joint diagonalization. Experiments on topic modeling show that our method outperforms previous tensor decomposition methods in terms of speed and model quality.

BibTeX
@inproceedings{NIPS2017_c44e5038,
 author = {Ruffini, Matteo and Rabusseau, Guillaume and Balle, Borja},
 booktitle = {Advances in Neural Information Processing Systems},
 editor = {I. Guyon and U. Von Luxburg and S. Bengio and H. Wallach and R. Fergus and S. Vishwanathan and R. Garnett},
 pages = {},
 publisher = {Curran Associates, Inc.},
 title = {Hierarchical Methods of Moments},
 url = {https://proceedings.neurips.cc/paper_files/paper/2017/file/c44e503833b64e9f27197a484f4257c0-Paper.pdf},
 volume = {30},
 year = {2017}
}