← Search

Shijian Xiao

3 accepted papers

2026

Demystifying GNN-to-MLP Knowledge Transfer: Theoretical Grounding and Dual-Stream Distillation Method

AAAI 2026technical

Graph Neural Networks (GNNs) have shown remarkable effectiveness across various applications, but their computational complexity poses significant scalability challenges. To this end, GNN-to-MLP Knowledge Distillation (KD) methods transfer relational inductive biases from GNNs to MLPs, equipping MLP

Cited by 1Source ↗PDF ↗Scholar ↗
2026

ProtoKV: Long-context Knowledges Are Already Well-Organized Before Your Query

ICLR 2026poster

Modern Large Language Models (LLMs) face fundamental challenges in processing long text sequences due to the quadratic complexity of attention mechanisms. Key-Value (KV) cache retention strategies mitigate this issue by selectively preserving salient KV pairs for autoregressive generation. However,…

Cited by 0Source ↗code ↗Scholar ↗
2025

Contextual Structure Knowledge Transfer for Graph Neural Networks

AAAI 2025technical

Graph transfer learning endeavors to develop a Graph Neural Network (GNN) model in a fully-labeled source domain, with the intention of deploying it on a target domain that has limited labeled data for inference. We reveal that prevalent graph transfer learning methods are susceptible to the homophi…