Jason d'Eon

Logical Activation Functions: Logit-space equivalents of Probabilistic Boolean Operators

The choice of activation functions and their motivation is a long-standing issue within the neural network community. Neuronal representations within artificial neural networks are commonly understood as logits, representing the log-odds score of presence of features within the stimulus. We derive l…