← Search

Nicolas Mayoraz

3 accepted papers

2020

Rankmax: An Adaptive Projection Alternative to the Softmax Function

NeurIPS 2020poster

Several machine learning models involve mapping a score vector to a probability vector. Usually, this is done by projecting the score vector onto a probability simplex, and such projections are often characterized as Lipschitz continuous approximations of the argmax function, whose Lipschitz constan…

Cited by 20SourcePDFScholar
2019

Efficient Training on Very Large Corpora via Gramian Estimation

ICLR 2019poster

We study the problem of learning similarity functions over very large corpora using neural network embedding models. These models are typically trained using SGD with random sampling of unobserved pairs, with a sample size that grows quadratically with the corpus size, making it expensive to scale.…

Cited by 51SourcePDFScholar