An iterative hard thresholding approach to ℓ0 sparse Hellinger NMF
Abstract
Performance of Non-negative Matrix Factorisation (NMF) can be diminished when the underlying factors consist of elements that overlap in the matrix to be factorised. The use of ℓ <sub xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">0</sub> sparsity may improve NMF, however such approaches are generally limited to Euclidean distance. We have previously proposed a stepwise ℓ <sub xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">0</sub> method for Hellinger distance, leading to improved sparse NMF. We extend sparse Hellinger NMF by proposing an alternative Iterative Hard Thresholding sparse approximation method. Experimental validation of the proposed approach is given, with a large improvement over NMF methods when learning is performed on a large dataset.
BibTeX
@inproceedings{icassp2016_aniterativehardt,
title = {An iterative hard thresholding approach to ℓ0 sparse Hellinger NMF},
author = {Ken O'Hanlon and Mark B. Sandler},
booktitle = {ICASSP 2016},
year = {2016}
}