Concave Losses for Robust Dictionary Learning

Abstract

Traditional dictionary learning methods are based on quadratic convex loss function and thus are sensitive to outliers. In this paper, we propose a generic framework for robust dictionary learning based on concave losses. We provide results on composition of concave functions, notably regarding super-gradient computations, that are key for developing generic dictionary learning algorithms applicable to smooth and nonsmooth losses. In order to improve identification of outliers, we introduce an initialization heuristic based on undercom-plete dictionary learning. Experimental results using synthetic and real data demonstrate that our method is able to better detect outliers, and thus capable of generating better dictionaries, outperforming state-of-the-art methods such as K-SVD and LC-KSVD.