Ondřej Draganov

The Shape of Word Embeddings: Quantifying Non-Isometry with Topological Data Analysis

Word embeddings represent language vocabularies as clouds of d-dimensional points. We investigate how information is conveyed by the general shape of these clouds, instead of representing the semantic meaning of each token. Specifically, we use the notion of persistent homology from topological data…