2025
Sampled Estimators For Softmax Must Be Biased
NeurIPS 2025poster
Models requiring probabilistic outputs are ubiquitous and used in fields such as natural language processing, contrastive learning, and recommendation systems. The standard method of designing such a model is to output unconstrained logits, which are normalized into probabilities with the softmax fu…