2026
Weaving Graph over Tokens: Contextualizing Structured Sequences for LLMs
ICML 2026poster
Generative Graph Language Models (GLMs) must reconcile topology with causal language modeling. Linearization obscures multi-hop connectivity, while encoder-based methods bottleneck token-level reasoning during generation. Viewing context modeling as a form of message passing, we introduce **Weaver**…