Periklis A. Papakonstantinou

The Effect of Weight Precision on the Neuron Count in Deep ReLU Networks

Deep neural networks (DNNs) have become pivotal in machine learning, but the impact of weight precision, such as in networks with rectified linear units (ReLU), remains underexplored. We analytically investigate the interplay of three key factors: the precision of ReLU network weights, the number of…