Telmo de Menezes E Silva Filho

Language Models Do Not Embed Numbers Continuously (Student Abstract)

We evaluate how well large language model embeddings represent continuous numerical values across different precisions and ranges. Using linear models and principal component analysis on models from major providers, we show that while embeddings can reconstruct numbers with high fidelity (R2 ≥ 0.95)