2026
Geometric Constraints for Small Language Models to Understand and Expand Scientific Taxonomies
ICLR 2026poster
Recent findings reveal that token embeddings of Large Language Models (LLMs) exhibit strong hyperbolicity. This insight motivates leveraging LLMs for scientific taxonomy tasks, where maintaining and expanding hierarchical knowledge structures is critical. Although potential, generally-trained LLMs f…