Diego De La Fuente Rodr{\'i}guez

On the Correspondence between the Squared Norm and Information Content in Text Embeddings

Previous work has reported both empirical and theoretical evidence, for specific training models, of the correspondence between the squared norm of an embedding and the information content of the text it represents.In this paper, we investigate the relationship at the theoretical and empirical level