← Search

Nils Y. Hammerla

3 accepted papers

2019

Don't Settle for Average, Go for the Max: Fuzzy Sets and Max-Pooled Word Vectors

ICLR 2019poster

Recent literature suggests that averaged word vectors followed by simple post-processing outperform many deep learning methods on semantic textual similarity tasks. Furthermore, when averaged word vectors are trained supervised on large corpora of paraphrases, they achieve state-of-the-art results o…

2018

Decoding Decoders: Finding Optimal Representation Spaces for Unsupervised Similarity Tasks

ICLR 2018workshop

Experimental evidence indicates that simple models outperform complex deep networks on many unsupervised similarity tasks. Introducing the concept of an optimal representation space, we provide a simple theoretical resolution to this apparent paradox. In addition, we present a straightforward proced…

Cited by 8SourcecodeScholar
2017

Offline bilingual word vectors, orthogonal transformations and the inverted softmax

ICLR 2017poster

Usually bilingual word vectors are trained "online''. Mikolov et al. showed they can also be found "offline"; whereby two pre-trained embeddings are aligned with a linear transformation, using dictionaries compiled from expert knowledge. In this work, we prove that the linear transformation between…

Cited by 642SourceScholar