← Search

Shijian Xiao

3 accepted papers

2026

Demystifying GNN-to-MLP Knowledge Transfer: Theoretical Grounding and Dual-Stream Distillation Method

AAAI 2026technical

Graph Neural Networks (GNNs) have shown remarkable effectiveness across various applications, but their computational complexity poses significant scalability challenges. To this end, GNN-to-MLP Knowledge Distillation (KD) methods transfer relational inductive biases from GNNs to MLPs, equipping MLP

Cited by 0SourcePDFScholar
2026

ProtoKV: Long-context Knowledges Are Already Well-Organized Before Your Query

ICLR 2026poster

Modern Large Language Models (LLMs) face fundamental challenges in processing long text sequences due to the quadratic complexity of attention mechanisms. Key-Value (KV) cache retention strategies mitigate this issue by selectively preserving salient KV pairs for autoregressive generation. However,…

Cited by 0SourcecodeScholar
2025

Contextual Structure Knowledge Transfer for Graph Neural Networks

AAAI 2025technical

Graph transfer learning endeavors to develop a Graph Neural Network (GNN) model in a fully-labeled source domain, with the intention of deploying it on a target domain that has limited labeled data for inference. We reveal that prevalent graph transfer learning methods are susceptible to the homophi…