2026
Efficient numeracy in language models through single-token number embeddings
ICML 2026spotlight
To drive progress in science and engineering, large language models (LLMs) must be able to process large amounts of numerical data and solve long calculations efficiently. This is currently only possible through the use of external tools or extensive reasoning chains, either weakening the numerical …