← Search

Mingzhen He

4 accepted papers

2025

Primphormer: Efficient Graph Transformers with Primal Representations

ICML 2025poster

Graph Transformers (GTs) have emerged as a promising approach for graph representation learning. Despite their successes, the quadratic complexity of GTs limits scalability on large graphs due to their pair-wise computations. To fundamentally reduce the computational burden of GTs, we propose a prim…

Cited by 0SourcePDFScholar
2025

Simulating Training Dynamics to Reconstruct Training Data from Deep Neural Networks

ICLR 2025poster

Whether deep neural networks (DNNs) memorize the training data is a fundamental open question in understanding deep learning. A direct way to verify the memorization of DNNs is to reconstruct training data from DNNs’ parameters. Since parameters are gradually determined by data throughout training,…

Cited by 0SourcePDFScholar
2024

Kernel PCA for Out-of-Distribution Detection

NeurIPS 2024poster

Out-of-Distribution (OoD) detection is vital for the reliability of Deep Neural Networks (DNNs). Existing works have shown the insufficiency of Principal Component Analysis (PCA) straightforwardly applied on the features of DNNs in detecting OoD data from In-Distribution (InD) data. The failure of P…

2023

Diffusion Representation for Asymmetric Kernels via Magnetic Transform

NeurIPS 2023poster

As a nonlinear dimension reduction technique, the diffusion map (DM) has been widely used. In DM, kernels play an important role for capturing the nonlinear relationship of data. However, only symmetric kernels can be used now, which prevents the use of DM in directed graphs, trophic networks, and…