← Search

Wenzhong Li

14 accepted papers

2026

Demystifying GNN-to-MLP Knowledge Transfer: Theoretical Grounding and Dual-Stream Distillation Method

AAAI 2026technical

Graph Neural Networks (GNNs) have shown remarkable effectiveness across various applications, but their computational complexity poses significant scalability challenges. To this end, GNN-to-MLP Knowledge Distillation (KD) methods transfer relational inductive biases from GNNs to MLPs, equipping MLP

Cited by 0SourcePDFScholar
2026

Learnable Matrix Profile for Motif Discovery on Multivariate Time Series

AAAI 2026technical

Multivariate motif discovery aims to identify frequently occurring subsequences within multi-dimensional time series, which is a critical machine learning task with wide applications. However, previous motif discovery algorithms often miss complex multivariate motifs and struggle with high computati

Cited by 0SourcePDFScholar
2026

Multimodal Graph Representation Learning with Dynamic Information Pathways

AAAI 2026technical

Multimodal graphs, where nodes contain heterogeneous features such as images and text, are increasingly common in real-world applications. Effectively learning on such graphs requires both adaptive intra-modal message passing and efficient inter-modal aggregation. However, most existing approaches t

Cited by 0SourcePDFScholar
2026

ProtoKV: Long-context Knowledges Are Already Well-Organized Before Your Query

ICLR 2026poster

Modern Large Language Models (LLMs) face fundamental challenges in processing long text sequences due to the quadratic complexity of attention mechanisms. Key-Value (KV) cache retention strategies mitigate this issue by selectively preserving salient KV pairs for autoregressive generation. However,…

Cited by 0SourcecodeScholar
2026

Unifying Perception and Action: A Hybrid-Modality Pipeline with Implicit Visual Chain-of-Thought for Robotic Action Generation

CVPR 2026

Vision-Language-Action (VLA) models built upon Chain-of-Thought (CoT) have achieved remarkable success in advancing general-purpose robotic agents, owing to its significant perceptual comprehension. Recently, since text-only CoT struggles to adequately capture scene details in complex spatial enviro

Cited by 0SourceScholar
2025

Aggregation Mechanism Based Graph Heterogeneous Networks Distillation

IJCAI 2025

Graph Neural Networks (GNNs) have demonstrated remarkable effectiveness across various tasks but are often hindered by their high computational overhead. GNN-to-MLP distillation provides a promising remedy by transferring knowledge from complex GNNs to lightweight MLPs. However, existing methods lar

Cited by 0SourcePDFScholar
2025

Contextual Structure Knowledge Transfer for Graph Neural Networks

AAAI 2025technical

Graph transfer learning endeavors to develop a Graph Neural Network (GNN) model in a fully-labeled source domain, with the intention of deploying it on a target domain that has limited labeled data for inference. We reveal that prevalent graph transfer learning methods are susceptible to the homophi…

2025

QuantileFormer: Probabilistic Time Series Forecasting with a Pattern-Mixture Decomposed VAE Transformer

IJCAI 2025

Probabilistic time series forecasting has attracted an increasing attention in machine learning community for its potential applications in the fields of renewable energy, traffic management, healthcare, etc. Previous research mainly focused on extracting long-range dependencies for point-wise predi

Cited by 0SourcePDFScholar
2025

Semantic-Supervised Spatial-Temporal Fusion for LiDAR-Based 3D Object Detection

ICRA 2025

LiDAR-based 3D object detection presents significant challenges due to the inherent sparsity of LiDAR points. A common solution involves long-term temporal LiDAR data to densify the inputs. However, efficiently leveraging spatial-temporal information remains an open problem. In this paper, we propos

Cited by 1SourceScholar
2025

Unified Graph Neural Networks Pre-training for Multi-domain Graphs

AAAI 2025technical

Graph Neural Networks (GNNs) have proven effective and typically benefit from pre-training on accessible graphs to enhance performance on tasks with limited labeled data. However, existing GNNs are constrained by the ``one-domain-one-model'' limitation, which restricts their effectiveness across div…

Cited by 0SourcePDFScholar
2024

Label Attentive Distillation for GNN-Based Graph Classification

AAAI 2024technical

Graph Neural Networks (GNNs) have emerged as a powerful tool for modeling graph-structured data, exhibiting remarkable potential in applications such as social networks, recommendation systems, and molecular structures. However, the conventional GNNs perform node-level feature aggregation from neigh…

2023

Federated Learning With Data-Agnostic Distribution Fusion

CVPR 2023poster

Federated learning has emerged as a promising distributed machine learning paradigm to preserve data privacy. One of the fundamental challenges of federated learning is that data samples across clients are usually not independent and identically distributed (non-IID), leading to slow convergence and…

2023

Multi-Domain Generalized Graph Meta Learning

AAAI 2023technical

Graph meta learning aims to learn historical knowledge from training graph neural networks (GNNs) models and adapt it to downstream learning tasks in a target graph, which has drawn increasing attention due to its ability of knowledge transfer and fast adaptation. While existing graph meta learning…

Cited by 14SourcePDFScholar
2023

PatchNAS: Repairing DNNs in Deployment with Patched Network Architecture Search

AAAI 2023technical

Despite being widely deployed in safety-critical applications such as autonomous driving and health care, deep neural networks (DNNs) still suffer from non-negligible reliability issues. Numerous works had reported that DNNs were vulnerable to either natural environmental noises or man-made adversar…

Cited by 1SourcePDFScholar