← Search

Shinichi Nakajima

14 accepted papers

2026

Attentive Multi-Layer Fusion for Vision Transformers

ICML 2026poster

With the rise of large-scale foundation models, efficiently adapting them to downstream tasks remains a central challenge. Linear probing, which freezes the backbone and trains a lightweight head, is computationally efficient but often restricted to last-layer representations. We show that task-rele…

Cited by 0SourceScholar
2026

Bayesian Parameter Shift Rules in Variational Quantum Eigensolvers

ICLR 2026poster

Parameter shift rules (PSRs) are key techniques for efficient gradient estimation in variational quantum eigensolvers (VQEs). In this paper, we propose their Bayesian variant, where Gaussian processes with appropriate kernels are used to estimate the gradient of the VQE objective. Our Bayesian PSR o…

Cited by 0SourcecodeScholar
2025

Multilevel Generative Samplers for Investigating Critical Phenomena

ICLR 2025poster

Investigating critical phenomena or phase transitions is of high interest in physics and chemistry, for which Monte Carlo (MC) simulations, a crucial tool for numerically analyzing macroscopic properties of given systems, are often hindered by an emerging divergence of correlation length---known as…

2024

Adaptive Observation Cost Control for Variational Quantum Eigensolvers

ICML 2024poster

The objective to be minimized in the variational quantum eigensolver (VQE) has a restricted form, which allows a specialized sequential minimal optimization (SMO) that requires only a few observations in each iteration. However, the SMO iteration is still costly due to the observation noise---one *o…

2024

Generative Fractional Diffusion Models

NeurIPS 2024poster

We introduce the first continuous-time score-based generative model that leverages fractional diffusion processes for its underlying dynamics. Although diffusion models have excelled at capturing data distributions, they still suffer from various limitations such as slow convergence, mode-collapse o…

2023

Labeling Neural Representations with Inverse Recognition

NeurIPS 2023poster

Deep Neural Networks (DNNs) demonstrate remarkable capabilities in learning complex hierarchical data representations, but the nature of these representations remains largely unknown. Existing global explainability methods, such as Network Dissection, face limitations such as reliance on segmentatio…

2023

Physics-Informed Bayesian Optimization of Variational Quantum Circuits

NeurIPS 2023poster

In this paper, we propose a novel and powerful method to harness Bayesian optimization for variational quantum eigensolvers (VQEs) - a hybrid quantum-classical protocol used to approximate the ground state of a quantum Hamiltonian. Specifically, we derive a *VQE-kernel* which incorporates important…

2023

Relevant Walk Search for Explaining Graph Neural Networks

ICML 2023poster

Graph Neural Networks (GNNs) have become important machine learning tools for graph analysis, and its explainability is crucial for safety, fairness, and robustness. Layer-wise relevance propagation for GNNs (GNN-LRP) evaluates the relevance of walks to reveal important information flows in the netw…

2022

Efficient Computation of Higher-Order Subgraph Attribution via Message Passing

ICML 2022spotlight

Explaining graph neural networks (GNNs) has become more and more important recently. Higher-order interpretation schemes, such as GNN-LRP (layer-wise relevance propagation for GNN), emerged as powerful tools for unraveling how different features interact thereby contributing to explaining GNNs. GNN-…

2022

NoiseGrad — Enhancing Explanations by Introducing Stochasticity to Model Weights

AAAI 2022technical

Many efforts have been made for revealing the decision-making process of black-box learning machines such as deep neural networks, resulting in useful local and global explanation methods. For local explanation, stochasticity is known to help: a simple method, called SmoothGrad, has improved the vis…

2022

Path-Gradient Estimators for Continuous Normalizing Flows

ICML 2022oral

Recent work has established a path-gradient estimator for simple variational Gaussian distributions and has argued that the path-gradient is particularly beneficial in the regime in which the variational distribution approaches the exact target distribution. In many applications, this regime can how…

2019

Partial Optimality of Dual Decomposition for MAP Inference in Pairwise MRFs

AISTATS 2019poster

Markov random fields (MRFs) are a powerful tool for modelling statistical dependencies for a set of random variables using a graphical representation. An important computational problem related to MRFs, called maximum a posteriori (MAP) inference, is finding a joint variable assignment with the maxi…

Cited by 7SourcePDFScholar
2017

Minimizing Trust Leaks for Robust Sybil Detection

ICML 2017poster

Sybil detection is a crucial task to protect online social networks (OSNs) against intruders who try to manipulate automatic services provided by OSNs to their customers. In this paper, we first discuss the robustness of graph-based Sybil detectors SybilRank and Integro and refine theoretically thei…

Cited by 18SourcePDFScholar