Optimal Compression for Minimizing Classification Error Probability: An Information-Theoretic Approach
We formulate the problem of performing optimal data compression under the constraints that compressed data can be used for accurate classification in machine learning. We show that this translates to a problem of minimizing the mutual information between data and its compressed version under the con…