← Search

Shirui Pan

111 accepted papers

2026

Assemble Your Crew: Automatic Multi-agent Communication Topology Design via Autoregressive Graph Generation

AAAI 2026technical

Multi-agent systems (MAS) based on large language models (LLMs) have emerged as a powerful solution for dealing with complex problems across diverse domains. The effectiveness of MAS is critically dependent on its collaboration topology, which has become a focal point for automated design research.

Cited by 0SourcePDFScholar
2026

CAMERA: Adapting to Semantic Camouflage in Unsupervised Text-Attributed Graph Fraud Detection

IJCAI 2026

Text-attributed graph fraud detection (TAGFD) plays a critical role in preventing fraudulent activities on online social and e-commerce platforms. However, to evade detection, fraudsters continuously evolve their camouflaging strategies by deliberately mimicking textual responses of benign users, th

Cited by 0Scholar
2026

CARD: Towards Conditional Design of Multi-agent Topological Structures

ICLR 2026poster

Large language model (LLM)-based multi-agent systems have shown strong capabilities in tasks such as code generation and collaborative reasoning. However, the effectiveness and robustness of these systems critically depend on their communication topology, which is often fixed or statically learned,…

Cited by 0SourcecodeScholar
2026

Correcting False Alarms from Unseen: Adapting Graph Anomaly Detectors at Test Time

AAAI 2026technical

Graph anomaly detection (GAD), which aims to detect outliers in graph-structured data, has received increasing research attention recently. However, existing GAD methods assume identical training and testing distributions, which is rarely valid in practice. In real-world scenarios, unseen but normal

Cited by 0SourcePDFScholar
2026

FedCIGAR: A Personalized Reconstruction Approach for Federated Graph-Level Anomaly Detection

IJCAI 2026

Graph-level anomaly detection (GLAD) is crucial for ensuring the reliability of graph-driven applications by identifying abnormal graphs that deviate from the majority. Considering the privacy concerns in distributed scenarios, federated graph-level anomaly detection (FedGLAD) has emerged as a promi

Cited by 0Scholar
2026

G-reasoner: Foundation Models for Unified Reasoning over Graph-structured Knowledge

ICLR 2026poster

Large language models (LLMs) excel at complex reasoning but remain limited by static and incomplete parametric knowledge. Retrieval-augmented generation (RAG) mitigates this by incorporating external knowledge, yet existing RAGs struggle with knowledge-intensive tasks due to fragmented information a…

Cited by 0SourcecodeScholar
2026

GraphRAG-Induced Dual Knowledge Structure Graphs for Personalized Learning Path Recommendation

AAAI 2026technical

Learning path recommendation seeks to provide students with a structured sequence of learning items (e.g., knowledge concepts or exercises) to optimize their learning efficiency. Despite significant efforts in this area, most existing methods primarily rely on prerequisite relations, which present t

Cited by 0SourcePDFScholar
2026

Knowledge Reasoning Language Model: Unifying Knowledge and Language for Inductive Knowledge Graph Reasoning

ICLR 2026poster

Inductive Knowledge Graph Reasoning (KGR) aims to discover facts in open-domain KGs containing unknown entities and relations, which poses a challenge for KGR models in comprehending uncertain KG components. Existing studies have proposed Knowledge Graph Foundation Models (KGFMs) that learn structur…

Cited by 0SourceScholar
2026

Learning Cardiac Latent Representations in Vectorcardiogram Space

ICML 2026poster

Electrocardiography (ECG) is a cornerstone of cardiac assessment, making the learning of informative ECG representations fundamental to tasks ranging from disease diagnosis to clinical report generation. However, existing methods operate almost exclusively in the observable ECG signal space. In prac…

Cited by 0SourceScholar
2026

LineageFlow: Flow Matching for High-Fidelity Family-Aware Protein Sequence Generation

ICML 2026poster

Protein sequence generation for engineering requires samples that are biophysically plausible and, when targeting a family/domain, remain recognizable members while exploring within-family diversity. Current discrete generative models typically start from uniform or masked-token noise, which discard…

Cited by 0SourceScholar
2026

Multi-Objective Protein Design via Memory-Aware Test-Time Scaling in Diffusion Models

ICML 2026poster

Multi-objective protein design is essential for meeting the complex demands of synthetic biology. To adapt to shifting multi-functional targets without the prohibitive cost of retraining, test-time scaling has emerged as a flexible, training-free alternative. However, current test-time diffusion met…

Cited by 0SourceScholar
2026

Paradigm Shift of GNN Explainer from Label Space to Prototypical Representation Space

ICLR 2026poster

Post-hoc instance-level graph neural network (GNN) explainers are developed to identify a compact subgraph (i.e., explanation) that encompasses the most influential components for each input graph. A fundamental limitation of existing methods lies in the insufficient utilization of structural inform…

Cited by 0SourcecodeScholar
2026

ReCoG: Relational and Compact Context Graph Learning for Few-shot Molecular Property Prediction

ICML 2026poster

Few-shot molecular property prediction (FSMPP) is essential in drug discovery and materials design, where high-quality labeled data are often scarce and expensive to obtain. Despite the promising performance of existing methods, especially in the context-aware methods, they still face two-fold sever…

Cited by 0SourceScholar
2026

Rel-MOSS: Towards Imbalanced Relational Deep Learning on Relational Databases

ICML 2026poster

In recent advances, to enable a fully data-driven learning paradigm on relational databases (RDB), relational deep learning (RDL) is proposed to structure the RDB as a heterogeneous entity graph and adopt the graph neural network (GNN) as the predictive model. However, existing RDL methods neglect t…

Cited by 0SourceScholar
2026

Rethinking Feature Alignment in Generalist Graph Anomaly Detection: A Relational Fingerprint-based Approach

ICML 2026poster

Extending traditional graph anomaly detection (GAD) from one-for-one to one-for-all paradigms, generalist GAD aims to learn a universal detector for identifying anomalies on unseen graphs without graph-specific retraining. Nevertheless, existing approaches primarily focus on aligning heterogeneous f…

Cited by 0SourceScholar
2026

ST-TGExplainer: Disentangling Stability and Transition Patterns for Temporal GNN Interpretability

ICML 2026poster

Temporal graph neural networks (TGNNs) have gained significant traction in solving real-world temporal graph tasks. However, their interpretability remains limited, as most TGNNs fail to identify which historical interactions most influence a given prediction. Despite promising progress on interpret…

Cited by 0SourceScholar
2026

Sonar-TS: Search-Then-Verify Natural Language Querying for Time Series Databases

ICML 2026poster

Natural Language Querying for Time Series Databases (NLQ4TSDB) aims to assist non-expert users retrieve meaningful events, intervals, and summaries from massive temporal records. However, existing Text-to-SQL methods are not designed for continuous morphological intents such as shapes or anomalies, …

Cited by 0SourceScholar
2026

TTS-Design: Test-Time Compute Scaling for Structure-Guided Protein Design

IJCAI 2026

Generating protein sequences that reliably fold into target structures is a central challenge in computational biology and protein design. Progress in protein inverse folding (PIF), however, is fundamentally constrained by the scarcity of high-quality structural data, which limits the effectiveness

Cited by 0Scholar
2026

The Choice of Divergence: A Neglected Key to Mitigating Diversity Collapse in Reinforcement Learning with Verifiable Reward

ICLR 2026poster

A central paradox in fine-tuning Large Language Models (LLMs) with Reinforcement Learning with Verifiable Reward (RLVR) is the frequent degradation of multi-attempt performance (Pass@k) despite improvements in single-attempt accuracy (Pass@1). This is often accompanied by catastrophic forgetting, wh…

Cited by 0SourceScholar
2026

TimeOmni-1: Incentivizing Complex Reasoning with Time Series in Large Language Models

ICLR 2026poster

Recent advances in multimodal time series learning underscore a paradigm shift from analytics centered on basic patterns toward advanced time series understanding and reasoning. However, existing multimodal time series datasets mostly remain at the level of surface alignment and question answering,…

Cited by 0SourcecodeScholar
2026

TimeOmni-VL: Unified Models for Time Series Understanding and Generation

ICML 2026poster

Recent time series modeling faces a sharp divide between numerical generation and semantic understanding, with research showing that generation models often rely on superficial pattern matching, while understanding-oriented models struggle with high-fidelity numerical output. Although unified multim…

Cited by 0SourceScholar
2026

Towards One-for-All Anomaly Detection for Tabular Data

ICML 2026poster

Tabular anomaly detection (TAD) aims to identify samples that deviate from the majority in tabular data and is critical in many real-world applications. However, existing methods follow a ``one model for one dataset (OFO)'' paradigm, which relies on dataset-specific training and thus incurs high com…

Cited by 0SourceScholar
2026

Variational Bayesian Flow Network for Graph Generation

ICML 2026poster

Graph generation aims to sample discrete node and edge attributes while satisfying coupled structural constraints. Diffusion models for graphs often adopt largely factorized forward-noising, and many flow-matching methods start from factorized reference noise and coordinate-wise interpolation, so no…

Cited by 0SourceScholar
2025

A Label-free Heterophily-guided Approach for Unsupervised Graph Fraud Detection

AAAI 2025technical

Graph fraud detection (GFD) has rapidly advanced in protecting online services by identifying malicious fraudsters. Recent supervised GFD research highlights that heterophilic connections between fraudster and user greatly impacts detection performance, where the fraudsters tend to camouflage themse…

2025

Adversarial Contrastive Graph Masked AutoEncoder Against Graph Structure and Feature Dual Attacks

AAAI 2025technical

Graph Neural Networks (GNNs) have been shown vulnerable to graph adversarial attacks. Current robust graph representation learning methods mainly defend against graph structure attack, and improves performance of GNNs. However node feature in graph can been easily attacked in reality. The joint defe…

Cited by 0SourcePDFScholar
2025

BiMark: Unbiased Multilayer Watermarking for Large Language Models

ICML 2025poster

Recent advances in Large Language Models (LLMs) have raised urgent concerns about LLM-generated text authenticity, prompting regulatory demands for reliable identification mechanisms. Although watermarking offers a promising solution, existing approaches struggle to simultaneously achieve three cri…

Cited by 0SourcePDFScholar
2025

Conformal Anomaly Detection in Event Sequences

ICML 2025poster

Anomaly detection in continuous-time event sequences is a crucial task in safety-critical applications. While existing methods primarily focus on developing a superior test statistic, they fail to provide guarantees regarding the false positive rate (FPR), which undermines their reliability in pract…

Cited by 0SourcePDFScholar
2025

Diagnosing and Addressing Pitfalls in KG-RAG Datasets: Toward More Reliable Benchmarking

NeurIPS 2025poster

Knowledge Graph Question Answering (KGQA) systems rely on high-quality benchmarks to evaluate complex multi-hop reasoning. However, despite their widespread use, popular datasets such as WebQSP and CWQ suffer from critical quality issues, including inaccurate or incomplete ground-truth annotations,…

Cited by 0SourceScholar
2025

Domain-Level Disentanglement Framework Based on Information Enhancement for Cross-Domain Cold-Start Recommendation

AAAI 2025technical

Recommender systems in various applications often encounter the challenge of cold-start, which refers to how to provide recommendations for completely new users. Cross-domain recommendation offers a solution to address this cold-start issue by leveraging user interaction information from other domai…

Cited by 0SourcePDFScholar
2025

DyG-Mamba: Continuous State Space Modeling on Dynamic Graphs

NeurIPS 2025poster

Dynamic graph modeling aims to uncover evolutionary patterns in real-world systems, enabling accurate social recommendation and early detection of cancer cells. Inspired by the success of recent state space models in efficiently capturing long-term dependencies, we propose DyG-Mamba by translating d…

Cited by 0SourcecodeScholar
2025

Enhancing Large Language Model for Knowledge Graph Completion via Structure-Aware Alignment-Tuning

EMNLP 2025

Knowledge graph completion (KGC) aims to infer new knowledge and make predictions from knowledge graphs. Recently, large language models (LLMs) have exhibited remarkable reasoning capabilities. LLM-enhanced KGC methods primarily focus on designing task-specific instructions, achieving promising adva

Cited by 0SourcePDFScholar
2025

Equivalence is All: A Unified View for Self-supervised Graph Learning

ICML 2025oral

Node equivalence is common in graphs, such as computing networks, encompassing automorphic equivalence (preserving adjacency under node permutations) and attribute equivalence (nodes with identical attributes). Despite their importance for learning node representations, these equivalences are largel…

Cited by 0SourcePDFScholar
2025

GFM-RAG: Graph Foundation Model for Retrieval Augmented Generation

NeurIPS 2025poster

Retrieval-augmented generation (RAG) has proven effective in integrating knowledge into large language models (LLMs). However, conventional RAGs struggle to capture complex relationships between pieces of knowledge, limiting their performance in intricate reasoning that requires integrating knowledg…

Cited by 0SourcecodeScholar
2025

Graph Sparsification via Mixture of Graphs

ICLR 2025spotlight

Graph Neural Networks (GNNs) have demonstrated superior performance across various graph learning tasks but face significant computational challenges when applied to large-scale graphs. One effective approach to mitigate these challenges is graph sparsification, which involves removing non-essential…

2025

Graph-constrained Reasoning: Faithful Reasoning on Knowledge Graphs with Large Language Models

ICML 2025poster

Large language models (LLMs) have demonstrated impressive reasoning abilities, but they still struggle with faithful reasoning due to knowledge gaps and hallucinations. To address these issues, knowledge graphs (KGs) have been utilized to enhance LLM reasoning through their structured knowledge. How…

2025

Less is More: Federated Graph Learning with Alleviating Topology Heterogeneity from A Causal Perspective

ICML 2025poster

Federated graph learning (FGL) aims to collaboratively train a global graph neural network (GNN) on multiple private graphs with preserving the local data privacy. Besides the common cases of data heterogeneity in conventional federated learning, FGL faces the unique challenge of topology heterogene…

Cited by 0SourcePDFScholar
2025

M^2LLM: Multi-view Molecular Representation Learning with Large Language Models

IJCAI 2025

Accurate molecular property prediction is a critical challenge with wide-ranging applications in chemistry, materials science, and drug discovery. Molecular representation methods, including fingerprints and graph neural networks (GNNs), achieve state-of-the-art results by effectively deriving featu

Cited by 0SourcePDFScholar
2025

Mitigating Over-Squashing in Graph Neural Networks by Spectrum-Preserving Sparsification

ICML 2025poster

The message-passing paradigm of Graph Neural Networks often struggles with exchanging information across distant nodes typically due to structural bottlenecks in certain graph regions, a limitation known as over-squashing. To reduce such bottlenecks, graph rewiring, which modifies graph topology, ha…

Cited by 0SourcePDFScholar
2025

N2GON: Neural Networks for Graph-of-Net with Position Awareness

ICML 2025poster

Graphs, fundamental in modeling various research subjects such as computing networks, consist of nodes linked by edges. However, they typically function as components within larger structures in real-world scenarios, such as in protein-protein interactions where each protein is a graph in a larger n…

Cited by 0SourcePDFScholar
2025

Open-Set Cross-Network Node Classification via Unknown-Excluded Adversarial Graph Domain Alignment

AAAI 2025technical

Existing cross-network node classification methods are mainly proposed for closed-set setting, where the source network and the target network share exactly the same label space. Such a setting is restricted in real-world applications, since the target network might contain additional classes that a…

2025

Progressive Prefix-Memory Tuning for Complex Logical Query Answering on Knowledge Graphs

IJCAI 2025

Conducting complex logical queries over knowledge graphs remains a significant challenge. Recent research has successfully leveraged Pre-trained Language Models (PLMs) to tackle Knowledge Graph Complex Query Answering (KGCQA) tasks, which is attributed to PLMs' ability to comprehend logical semantic

2025

Robust Graph Based Social Recommendation Through Contrastive Multi-View Learning

AAAI 2025technical

Social recommendation leverages the social connections between users to mitigate the issue of data sparsity and enhance recommendation quality. Although existing related works show their effectiveness, there remain two critical questions: i) The patterns of preference interactions among users are va…

Cited by 0SourcePDFScholar
2025

ShapeX: Shapelet-Driven Post Hoc Explanations for Time Series Classification Models

NeurIPS 2025poster

Explaining time series classification models is crucial, particularly in high-stakes applications such as healthcare and finance, where transparency and trust play a critical role. Although numerous time series classification methods have identified key subsequences, known as shapelets, as core feat…

Cited by 0SourceScholar
2025

Sharpness-aware Zeroth-order Optimization for Graph Transformers

IJCAI 2025

Graph Transformers (GTs) have emerged as powerful tools for handling graph-structured data through global attention mechanisms. While GTs can effectively capture long-range dependencies, they introduce difficulties in optimization due to their complex, non-differentiable operators, which cannot be d

2025

T2S: High-resolution Time Series Generation with Text-to-Series Diffusion Models

IJCAI 2025

Text-to-Time Series generation holds significant potential to address challenges such as data sparsity, imbalance, and limited availability of multimodal time series data across domains. While diffusion models have achieved remarkable success in Text-to-X (e.g., vision and audio data) generation, th

2025

TGLsta: Low-resource Textual Graph Learning with Semantic and Topological Awareness via LLMs

AAAI 2025technical

Textual Graphs (TGs) present a graph-based representation of textual data and find wide applications in real-world scenarios, such as citation networks, knowledge graphs, and social networks. While the traditional "pre-train, fine-tune" framework effectively addresses tasks requiring abundant labele…

Cited by 0SourcePDFScholar
2025

Test-Time Graph Neural Dataset Search With Generative Projection

ICML 2025poster

In this work, we address the test-time adaptation challenge in graph neural networks (GNNs), focusing on overcoming the limitations in flexibility and generalization inherent in existing data-centric approaches. To this end, we propose a novel research problem, test-time graph neural dataset search,…

Cited by 0SourcePDFScholar
2025

TimeFilter: Patch-Specific Spatial-Temporal Graph Filtration for Time Series Forecasting

ICML 2025poster

Time series forecasting methods generally fall into two main categories: Channel Independent (CI) and Channel Dependent (CD) strategies. While CI overlooks important covariate relationships, CD captures all dependencies without distinction, introducing noise and reducing generalization. Recent advan…

2025

Towards Neural Scaling Laws for Time Series Foundation Models

ICLR 2025poster

Scaling laws offer valuable insights into the design of time series foundation models (TSFMs). However, previous research has largely focused on the scaling laws of TSFMs for in-distribution (ID) data, leaving their out-of-distribution (OOD) scaling behavior and the influence of model architectures…

2025

Understanding the Information Propagation Effects of Communication Topologies in LLM-based Multi-Agent Systems

EMNLP 2025

The communication topology in large language model-based multi-agent systems fundamentally governs inter-agent collaboration patterns, critically shaping both the efficiency and effectiveness of collective decision-making. While recent studies for communication topology automated design tend to cons

2025

Unifying Unsupervised Graph-Level Anomaly Detection and Out-of-Distribution Detection: A Benchmark

ICLR 2025poster

To build safe and reliable graph machine learning systems, unsupervised graph-level anomaly detection (GLAD) and unsupervised graph-level out-of-distribution (OOD) detection (GLOD) have received significant attention in recent years. Though these two lines of research share the same objective, they…

2024

ARC: A Generalist Graph Anomaly Detector with In-Context Learning

NeurIPS 2024poster

Graph anomaly detection (GAD), which aims to identify abnormal nodes that differ from the majority within a graph, has garnered significant attention. However, current GAD methods necessitate training specific to each dataset, resulting in high training costs, substantial data requirements, and limi…

2024

Attractor Memory for Long-Term Time Series Forecasting: A Chaos Perspective

NeurIPS 2024poster

In long-term time series forecasting (LTSF) tasks, an increasing number of works have acknowledged that discrete time series originate from continuous dynamic systems and have attempted to model their underlying dynamics. Recognizing the chaotic nature of real-world data, our model, Attraos, incorpo…

2024

Augmented Commonsense Knowledge for Remote Object Grounding

AAAI 2024technical

The vision-and-language navigation (VLN) task necessitates an agent to perceive the surroundings, follow natural language instructions, and act in photo-realistic unseen environments. Most of the existing methods employ the entire image or object features to represent navigable viewpoints. However,…

2024

CONC: Complex-noise-resistant Open-set Node Classification with Adaptive Noise Detection

IJCAI 2024poster

As a popular task in graph learning, node classification seeks to assign labels to nodes, taking into account both their features and connections. However, an important challenge for its application in real-world scenarios is the presence of newly-emerged out-of-distribution samples and noisy sample…

Cited by 1SourcePDFScholar
2024

EGonc : Energy-based Open-Set Node Classification with substitute Unknowns

NeurIPS 2024poster

Open-set Classification (OSC) is a critical requirement for safely deploying machine learning models in the open world, which aims to classify samples from known classes and reject samples from out-of-distribution (OOD). Existing methods exploit the feature space of trained network and attempt at e…

Cited by 0SourcePDFScholar
2024

FedPFT: Federated Proxy Fine-Tuning of Foundation Models

IJCAI 2024poster

Adapting Foundation Models (FMs) for down- stream tasks through Federated Learning (FL) emerges a promising strategy for protecting data privacy and valuable FMs. Existing methods fine- tune FM by allocating sub-FM to clients in FL, however, leading to suboptimal performance due to insufficient tuni…

2024

GOODAT: Towards Test-Time Graph Out-of-Distribution Detection

AAAI 2024technical

Graph neural networks (GNNs) have found widespread application in modeling graph data across diverse domains. While GNNs excel in scenarios where the testing data shares the distribution of their training counterparts (in distribution, ID), they often exhibit incorrect predictions when confronted wi…

2024

Gradformer: Graph Transformer with Exponential Decay

IJCAI 2024poster

Graph Transformers (GTs) have demonstrated their advantages across a wide range of tasks. However, the self-attention mechanism in GTs overlooks the graph's inductive biases, particularly biases related to structure, which are crucial for the graph tasks. Although some methods utilize positional enc…

2024

Graph Attention Network with High-Order Neighbor Information Propagation for Social Recommendation

IJCAI 2024poster

In recommender systems, graph neural networks (GNN) can integrate interactions between users and items with their attributes, which makes GNN-based methods more powerful. However, directly stacking multiple layers in a graph neural network can easily lead to over-smoothing, hence recommendation syst…

Cited by 2SourcePDFScholar
2024

Graph Neural Stochastic Diffusion for Estimating Uncertainty in Node Classification

ICML 2024poster

Graph neural networks (GNNs) have advanced the state of the art in various domains. Despite their remarkable success, the uncertainty estimation of GNN predictions remains under-explored, which limits their practical applications especially in risk-sensitive areas. Current works suffer from either i…

Cited by 13SourcePDFScholar
2024

Large Language Models-guided Dynamic Adaptation for Temporal Knowledge Graph Reasoning

NeurIPS 2024poster

Temporal Knowledge Graph Reasoning (TKGR) is the process of utilizing temporal information to capture complex relations within a Temporal Knowledge Graph (TKG) to infer new knowledge. Conventional methods in TKGR typically depend on deep learning algorithms or temporal logical rules. However, deep l…

2024

NestE: Modeling Nested Relational Structures for Knowledge Graph Reasoning

AAAI 2024technical

Reasoning with knowledge graphs (KGs) has primarily focused on triple-shaped facts. Recent advancements have been explored to enhance the semantics of these facts by incorporating more potent representations, such as hyper-relational facts. However, these approaches are limited to atomic facts, whic…

2024

Online GNN Evaluation Under Test-time Graph Distribution Shifts

ICLR 2024spotlight

Evaluating the performance of a well-trained GNN model on real-world graphs is a pivotal step for reliable GNN online deployment and serving. Due to a lack of test node labels and unknown potential training-test graph data distribution shifts, conventional model evaluation encounters limitations in…

2024

Position: What Can Large Language Models Tell Us about Time Series Analysis

ICML 2024poster

Time series analysis is essential for comprehending the complexities inherent in various real-world systems and applications. Although large language models (LLMs) have recently made significant strides, the development of artificial general intelligence (AGI) equipped with time series analysis capa…

Cited by 36SourcePDFScholar
2024

ROG_PL: Robust Open-Set Graph Learning via Region-Based Prototype Learning

AAAI 2024technical

Open-set graph learning is a practical task that aims to classify the known class nodes and to identify unknown class samples as unknowns. Conventional node classification methods usually perform unsatisfactorily in open-set scenarios due to the complex data they encounter, such as out-of-distributi…

Cited by 2SourcePDFScholar
2024

Reasoning on Graphs: Faithful and Interpretable Large Language Model Reasoning

ICLR 2024poster

Large language models (LLMs) have demonstrated impressive reasoning abilities in complex tasks. However, they lack up-to-date knowledge and experience hallucinations during reasoning, which can lead to incorrect reasoning processes and diminish their performance and trustworthiness. Knowledge graphs…

Cited by 231SourcePDFScholar
2024

Sign is Not a Remedy: Multiset-to-Multiset Message Passing for Learning on Heterophilic Graphs

ICML 2024poster

Graph Neural Networks (GNNs) have gained significant attention as a powerful modeling and inference method, especially for homophilic graph-structured data. To empower GNNs in heterophilic graphs, where adjacent nodes exhibit dissimilar labels or features, Signed Message Passing (SMP) has been widel…

2024

Time-LLM: Time Series Forecasting by Reprogramming Large Language Models

ICLR 2024poster

Time series forecasting holds significant importance in many real-world dynamic systems and has been extensively studied. Unlike natural language process (NLP) and computer vision (CV), where a single large model can tackle multiple tasks, models for time series forecasting are often specialized, ne…

2024

Towards Model Extraction Attacks in GAN-Based Image Translation via Domain Shift Mitigation

AAAI 2024technical

Model extraction attacks (MEAs) enable an attacker to replicate the functionality of a victim deep neural network (DNN) model by only querying its API service remotely, posing a severe threat to the security and integrity of pay-per-query DNN-based services. Although the majority of current research…

Cited by 3SourcePDFScholar
2024

Two Heads Are Better Than One: Boosting Graph Sparse Training via Semantic and Topological Awareness

ICML 2024poster

Graph Neural Networks (GNNs) excel in various graph learning tasks but face computational challenges when applied to large-scale graphs. A promising solution is to remove non-essential edges to reduce the computational overheads in GNN. Previous literature generally falls into two categories: topolo…

Cited by 16SourcePDFScholar
2024

Uncovering the Redundancy in Graph Self-supervised Learning Models

NeurIPS 2024poster

Graph self-supervised learning, as a powerful pre-training paradigm for Graph Neural Networks (GNNs) without labels, has received considerable attention. We have witnessed the success of graph self-supervised learning on pre-training the parameters of GNNs, leading many not to doubt that whether the…

Cited by 0SourcePDFScholar
2023

Beyond Smoothing: Unsupervised Graph Representation Learning with Edge Heterophily Discriminating

AAAI 2023technical

Unsupervised graph representation learning (UGRL) has drawn increasing research attention and achieved promising results in several graph analytic tasks. Relying on the homophily assumption, existing UGRL methods tend to smooth the learned node representations along all edges, ignoring the existence…

2023

Demystifying Uneven Vulnerability of Link Stealing Attacks against Graph Neural Networks

ICML 2023poster

While graph neural networks (GNNs) dominate the state-of-the-art for exploring graphs in real-world applications, they have been shown to be vulnerable to a growing number of privacy attacks. For instance, link stealing is a well-known membership inference attack (MIA) on edges that infers the prese…

Cited by 26SourcePDFScholar
2023

Fast Heterogeneous Federated Learning with Hybrid Client Selection

UAI 2023poster

Client selection schemes are widely adopted to handle the communication-efficient problems in recent studies of Federated Learning (FL). However, the large variance of the model updates aggregated from the randomly-selected unrepresentative subsets directly slows the FL convergence. We present a nov…

Cited by 10SourcePDFScholar
2023

Finding the Missing-half: Graph Complementary Learning for Homophily-prone and Heterophily-prone Graphs

ICML 2023poster

Real-world graphs generally have only one kind of tendency in their connections. These connections are either homophilic-prone or heterophily-prone. While graphs with homophily-prone edges tend to connect nodes with the same class (i.e., intra-class nodes), heterophily-prone edges tend to build rela…

2023

G2Pxy: Generative Open-Set Node Classification on Graphs with Proxy Unknowns

IJCAI 2023poster

Node classification is the task of predicting the labels of unlabeled nodes in a graph. State-of-the-art methods based on graph neural networks achieve excellent performance when all labels are available during training. But in real-life, models are of ten applied on data with new classes, which…

2023

GNNEvaluator: Evaluating GNN Performance On Unseen Graphs Without Labels

NeurIPS 2023poster

Evaluating the performance of graph neural networks (GNNs) is an essential task for practical GNN model deployment and serving, as deployed GNNs face significant performance uncertainty when inferring on unseen and unlabeled test graphs, due to mismatched training-test graph distributions. In this p…

Cited by 15SourcePDFScholar
2023

Neighbor Contrastive Learning on Learnable Graph Augmentation

AAAI 2023technical

Recent years, graph contrastive learning (GCL), which aims to learn representations from unlabeled graphs, has made great progress. However, the existing GCL methods mostly adopt human-designed graph augmentations, which are sensitive to various graph datasets. In addition, the contrastive losses or…

2023

Shrinking Embeddings for Hyper-Relational Knowledge Graphs

ACL 2023long

Link prediction on knowledge graphs (KGs) has been extensively studied on binary relational KGs, wherein each fact is represented by a triple. A significant amount of important knowledge, however, is represented by hyper-relational facts where each fact is composed of a primal triple and a set of qu…

2023

Simple and Efficient Heterogeneous Graph Neural Network

AAAI 2023technical

Heterogeneous graph neural networks (HGNNs) have the powerful capability to embed rich structural and semantic information of a heterogeneous graph into node representations. Existing HGNNs inherit many mechanisms from graph neural networks (GNNs) designed for homogeneous graphs, especially the atte…

2023

Structure-free Graph Condensation: From Large-scale Graphs to Condensed Graph-free Data

NeurIPS 2023spotlight

Graph condensation, which reduces the size of a large-scale graph by synthesizing a small-scale condensed graph as its substitution, has immediate benefits for various graph learning tasks. However, existing graph condensation methods rely on the joint optimization of nodes and structures in the con…

2023

Towards Self-Interpretable Graph-Level Anomaly Detection

NeurIPS 2023poster

Graph-level anomaly detection (GLAD) aims to identify graphs that exhibit notable dissimilarity compared to the majority in a collection. However, current works primarily focus on evaluating graph-level abnormality while failing to provide meaningful explanations for the predictions, which largely l…

2022

A Probabilistic Graphical Model Based on Neural-Symbolic Reasoning for Visual Relationship Detection

CVPR 2022poster

This paper aims to leverage symbolic knowledge to improve the performance and interpretability of the Visual Relationship Detection (VRD) models. Existing VRD methods based on deep learning suffer from the problems of poor performance on insufficient labeled examples and lack of interpretability. To…

Cited by 28PDFScholar
2022

BaLeNAS: Differentiable Architecture Search via the Bayesian Learning Rule

CVPR 2022poster

Differentiable Architecture Search (DARTS) has received massive attention in recent years, mainly because it significantly reduces the computational cost through weight sharing and continuous relaxation. However, more recent works find that existing differentiable NAS techniques struggle to outperfo…

Cited by 24PDFScholar
2022

CGMN: A Contrastive Graph Matching Network for Self-Supervised Graph Similarity Learning

IJCAI 2022poster

Graph similarity learning refers to calculating the similarity score between two graphs, which is required in many realistic applications, such as visual tracking, graph classification, and collaborative filtering. As most of the existing graph neural networks yield effective graph representations o…

2022

Cross-Modal Clinical Graph Transformer for Ophthalmic Report Generation

CVPR 2022poster

Automatic generation of ophthalmic reports using data-driven neural networks has great potential in clinical practice. When writing a report, ophthalmologists make inferences with prior clinical knowledge. This knowledge has been neglected in prior medical report generation methods. To endow models…

Cited by 55PDFcodeScholar
2022

Exploring Relational Semantics for Inductive Knowledge Graph Completion

AAAI 2022technical

Knowledge graph completion (KGC) aims to infer missing information in incomplete knowledge graphs (KGs). Most previous works only consider the transductive scenario where entities are existing in KGs, which cannot work effectively for the inductive scenario containing emerging entities. Recently som…

2022

Fire Burns, Sword Cuts: Commonsense Inductive Bias for Exploration in Text-based Games

ACL 2022short

Text-based games (TGs) are exciting testbeds for developing deep reinforcement learning techniques due to their partially observed environments and large action spaces. In these games, the agent learns to explore the environment via natural language interactions with the game simulator. A fundamenta…

2022

How Far are We from Robust Long Abstractive Summarization?

EMNLP 2022main

Abstractive summarization has made tremendous progress in recent years. In this work, we perform fine-grained human annotations to evaluate long document abstractive summarization systems (i.e., models and metrics) with the aim of implementing them to generate reliable summaries. For long document a…

2022

Multi-Graph Fusion Networks for Urban Region Embedding

IJCAI 2022poster

Learning the embeddings for urban regions from human mobility data can reveal the functionality of regions, and then enables the correlated but distinct tasks such as crime prediction. Human mobility data contains rich but abundant information, which yields to the comprehensive region embeddings for…

2022

Neural Temporal Walks: Motif-Aware Representation Learning on Continuous-Time Dynamic Graphs

NeurIPS 2022accept

Continuous-time dynamic graphs naturally abstract many real-world systems, such as social and transactional networks. While the research on continuous-time dynamic graph representation learning has made significant advances recently, neither graph topological properties nor temporal dependencies hav…

Cited by 98SourcePDFScholar
2022

Pseudo-Riemannian Graph Convolutional Networks

NeurIPS 2022accept

Graph Convolutional Networks (GCNs) are powerful frameworks for learning embeddings of graph-structured data. GCNs are traditionally studied through the lens of Euclidean geometry. Recent works find that non-Euclidean Riemannian manifolds provide specific inductive biases for embedding hierarchical…

2022

Rethinking and Scaling Up Graph Contrastive Learning: An Extremely Efficient Approach with Group Discrimination

NeurIPS 2022accept

Graph contrastive learning (GCL) alleviates the heavy reliance on label information for graph representation learning (GRL) via self-supervised learning schemes. The core idea is to learn by maximising mutual information for similar instances, which requires similarity computation between two node i…

2022

Survey on Graph Neural Network Acceleration: An Algorithmic Perspective

IJCAI 2022poster

Graph neural networks (GNNs) have been a hot spot of recent research and are widely utilized in diverse applications. However, with the use of huger data and deeper models, an urgent demand is unsurprisingly made to accelerate GNNs for more efficient execution. In this paper, we provide a comprehens…

Cited by 55SourcePDFScholar
2022

Triformer: Triangular, Variable-Specific Attentions for Long Sequence Multivariate Time Series Forecasting

IJCAI 2022poster

A variety of real-world applications rely on far future information to make decisions, thus calling for efficient and accurate long sequence multivariate time series forecasting. While recent attention-based forecasting models show strong abilities in capturing long-term dependencies, they still su…

2021

Contrastive Graph Poisson Networks: Semi-Supervised Learning with Extremely Limited Labels

NeurIPS 2021poster

Graph Neural Networks (GNNs) have achieved remarkable performance in the task of semi-supervised node classification. However, most existing GNN models require sufficient labeled data for effective network training. Their performance can be seriously degraded when labels are extremely limited. To ad…

Cited by 65SourcePDFScholar
2021

Contrastive and Generative Graph Convolutional Networks for Graph-based Semi-Supervised Learning

AAAI 2021technical

Graph-based Semi-Supervised Learning (SSL) aims to transfer the labels of a handful of labeled data to the remaining massive unlabeled data via a graph. As one of the most popular graph-based SSL approaches, the recently proposed Graph Convolutional Networks (GCNs) have gained remarkable progress by…

Cited by 163SourcePDFScholar
2021

Leveraging Information Bottleneck for Scientific Document Summarization

EMNLP 2021finding

This paper presents an unsupervised extractive approach to summarize scientific long documents based on the Information Bottleneck principle. Inspired by previous work which uses the Information Bottleneck principle for sentence compression, we extend it to document level summarization with two sepa…

Cited by 20SourcePDFScholar
2021

Multi-Scale Contrastive Siamese Networks for Self-Supervised Graph Representation Learning

IJCAI 2021poster

Graph representation learning plays a vital role in processing graph-structured data. However, prior arts on graph representation learning heavily rely on labeling information. To overcome this problem, inspired by the recent success of graph contrastive learning and Siamese networks in visual repre…

2021

iDARTS: Differentiable Architecture Search with Stochastic Implicit Gradients

ICML 2021spotlight

Differentiable ARchiTecture Search(DARTS) has recently become the mainstream in the neural architecture search (NAS) due to its efficiency and simplicity. With a gradient-based bi-level optimization, DARTS alternately optimizes the inner model weights and the outer architecture parameter in a weight…

2020

A Relation-Specific Attention Network for Joint Entity and Relation Extraction

IJCAI 2020poster

Joint extraction of entities and relations is an important task in natural language processing (NLP), which aims to capture all relational triplets from plain texts. This is a big challenge due to some of the triplets extracted from one sentence may have overlapping entities. Most existing methods p…

2020

Differentiable Neural Architecture Search in Equivalent Space with Exploration Enhancement

NeurIPS 2020poster

Recent works on One-Shot Neural Architecture Search (NAS) mostly adopt a bilevel optimization scheme to alternatively optimize the supernet weights and architecture parameters after relaxing the discrete search space into a differentiable space. However, the non-negligible incongruence in their rela…

Cited by 42SourcePDFScholar
2020

Graph Geometry Interaction Learning

NeurIPS 2020poster

While numerous approaches have been developed to embed graphs into either Euclidean or hyperbolic spaces, they do not fully utilize the information available in graphs, or lack the flexibility to model intrinsic complex graph geometry. To utilize the strength of both Euclidean and hyperbolic geometr…

2020

Graph Stochastic Neural Networks for Semi-supervised Learning

NeurIPS 2020poster

Graph Neural Networks (GNNs) have achieved remarkable performance in the task of the semi-supervised node classification. However, most existing models learn a deterministic classification function, which lack sufficient flexibility to explore better choices in the presence of kinds of imperfect ob…

2020

One-Shot Neural Architecture Search via Novelty Driven Sampling

IJCAI 2020poster

One-Shot Neural architecture search (NAS) has received wide attentions due to its computational efficiency. Most state-of-the-art One-Shot NAS methods use the validation accuracy based on inheriting weights from the supernet as the stepping stone to search for the best performing architecture, adopt…

2020

Overcoming Multi-Model Forgetting in One-Shot NAS With Diversity Maximization

CVPR 2020poster

One-Shot Neural Architecture Search (NAS) significantly improves the computational efficiency through weight sharing. However, this approach also introduces multi-model forgetting during the supernet training (architecture search phase), where the performance of previous architectures degrade when s…

Cited by 103PDFcodeScholar
2020

Reasoning Like Human: Hierarchical Reinforcement Learning for Knowledge Graph Reasoning

IJCAI 2020poster

Knowledge Graphs typically suffer from incompleteness. A popular approach to knowledge graph completion is to infer missing knowledge by multihop reasoning over the information found along other paths connecting a pair of entities. However, multi-hop reasoning is still challenging because the reason…