← Search

Jiayu Zhang

20 accepted papers

2026

A$^2$FM: An Adaptive Agent Foundation Model for Tool-Aware Hybrid Reasoning

ICLR 2026poster

Large language models split into two families: reasoning-centric LLMs, which strengthen internal chain-of-thought reasoning but cannot invoke external tools, and agentic LLMs, which learn to interact with environments and leverage tools but often lag in deep reasoning. This divide arises from fundam…

Cited by 0SourcecodeScholar
2026

Faithfulness Under the Distribution: A New Look at Attribution Evaluation

ICLR 2026poster

Evaluating the faithfulness of attribution methods remains an open challenge. Standard metrics such as Insertion and Deletion Scores rely on heuristic input perturbations (e.g., zeroing pixels), which often push samples out of the data distribution (OOD). This can distort model behavior and lead to…

Cited by 0SourceScholar
2026

Multi-Semantic Aware Self-Supervised Learning for Multi-Label Node Classification

IJCAI 2026

Graph self-supervised learning aims to mine intrinsic signals from graph data itself to train models. It enables the acquisition of high-quality representations without manual annotations, making it suitable for various label-scarce scenarios and thus garnering substantial interest. Existing graph s

Cited by 0Scholar
2026

NL2Repo-Bench: Towards Long-Horizon Repository Generation Evaluation of Coding Agents

ICML 2026poster

Recent advances in coding agents suggest rapid progress toward autonomous software development, yet existing benchmarks primarily evaluate short-horizon behaviors such as localized code generation, scaffolded completion, or repository repair, leaving it unclear whether agents can sustain coherent re…

Cited by 0SourceScholar
2026

Pi-CCA: Prompt-Invariant CCA Certificates for Replay-Free Continual Multimodal Learning

ICLR 2026poster

When deployed on non-stationary data streams, foundation vision-language models require continual updates without access to past data. However, naive fine-tuning undermines their zero-shot recognition capabilities and prompt robustness. We seek a replay-free principle that preserves pre-trained cros…

Cited by 0SourceScholar
2026

SUGAR: Learning Skeleton Representation with Visual-Motion Knowledge for Action Recognition

AAAI 2026technical

Large Language Models (LLMs) hold rich implicit knowledge and powerful transferability. In this paper, we explore the combination of LLMs with the human skeleton to perform action classification and description. However, when treating LLM as a recognizer, two questions arise: 1) How can LLMs underst

Cited by 0SourcePDFScholar
2025

A Generative-Augmented Deep Matrix Factorization Model for POI Recommendations

ICASSP 2025accepted

Deep matrix factorization has become a pivotal technique for Point of Interest (POI) recommendations, effectively capturing complex user-POI interactions to improve user experiences. However, these systems often face challenges such as data sparsity and the geographical constraints of POIs. To addre…

Cited by 0SourceScholar
2025

Hierarchical Trajectory Planning Method for Piano-Playing Robot

IROS 2025

Piano-playing tasks, which effectively demonstrate bimanual coordination capabilities in humanoid robots, are increasingly becoming a research focus. However, prior research has predominantly focused on Cartesian space trajectory planning without adequately addressing real-world obstacle avoidance c

Cited by 0SourceScholar
2025

Improving Adversarial Transferability via Decision Boundary Adaptation

UAI 2025

Black-box attacks play a pivotal role in adversarial attacks. However, existing approaches often focus predominantly on attacking from a data-centric perspective, neglecting crucial aspects of the models. To address this issue, we propose a novel approach in this paper, coined Decision Boundary Adap

2025

Narrowing Information Bottleneck Theory for Multimodal Image-Text Representations Interpretability

ICLR 2025poster

The task of identifying multimodal image-text representations has garnered increasing attention, particularly with models such as CLIP (Contrastive Language-Image Pretraining), which demonstrate exceptional performance in learning complex associations between images and text. Despite these advanceme…

2025

Splitting & Integrating: Out-of-Distribution Detection via Adversarial Gradient Attribution

ICML 2025poster

Out-of-distribution (OOD) detection is essential for enhancing the robustness and security of deep learning models in unknown and dynamic data environments. Gradient-based OOD detection methods, such as GAIA, analyse the explanation pattern representations of in-distribution (ID) and OOD samples by…

2025

Whose Instructions Count? Resolving Preference Bias in Instruction Fine-Tuning

NeurIPS 2025poster

Instruction fine-tuning (IFT) has emerged as a ubiquitous strategy for specializing large language models (LLMs), yet it implicitly assumes a single, coherent "ground-truth" preference behind all human-written instructions. In practice, annotators differ in the styles, emphases, and granularities th…

Cited by 0SourceScholar
2024

A Novel Multi-Atlas Fusion Model Based On Contrastive Learning For Functional Connectivity Graph Diagnosis

ICASSP 2024accepted

Functional connectivity (FC) graph analysis is an important method for diagnosing brain disorders using functional magnetic resonance imaging (fMRI). Existing FC graph diagnosis approaches preprocess the brain by dividing it into specific regions using atlases. However, relying on a single atlas exc…

Cited by 0SourceScholar
2024

AttEXplore: Attribution for Explanation with model parameters eXploration

ICLR 2024poster

Due to the real-world noise and human-added perturbations, attaining the trustworthiness of deep neural networks (DNNs) is a challenging task. Therefore, it becomes essential to offer explanations for the decisions made by these non-linear and complex parameterized models. Attribution methods are pr…

2024

Enhancing Transferable Adversarial Attacks on Vision Transformers through Gradient Normalization Scaling and High-Frequency Adaptation

ICLR 2024poster

Vision Transformers (ViTs) have been widely used in various domains. Similar to Convolutional Neural Networks (CNNs), ViTs are prone to the impacts of adversarial samples, raising security concerns in real-world applications. As one of the most effective black-box attack methods, transferable attack…

2024

Iterative Search Attribution for Deep Neural Networks

ICML 2024poster

Deep neural networks (DNNs) have achieved state-of-the-art performance across various applications. However, ensuring the reliability and trustworthiness of DNNs requires enhanced interpretability of model inputs and outputs. As an effective means of Explainable Artificial Intelligence (XAI) researc…

2024

MFABA: A More Faithful and Accelerated Boundary-Based Attribution Method for Deep Neural Networks

AAAI 2024technical

To better understand the output of deep neural networks (DNN), attribution based methods have been an important approach for model interpretability, which assign a score for each input dimension to indicate its importance towards the model outcome. Notably, the attribution methods use the ax- ioms o…