← Search

Shikuang Deng

8 accepted papers

2025

Rethinking Hebbian Principle: Low-Dimensional Structural Projection for Unsupervised Learning

NeurIPS 2025poster

Hebbian learning is a biological principle that intuitively describes how neurons adapt their connections through repeated stimuli. However, when applied to machine learning, it suffers serious issues due to the unconstrained updates of the connections and the lack of accounting for feedback mediati…

Cited by 0SourcecodeScholar
2025

Temporal Flexibility in Spiking Neural Networks: Towards Generalization Across Time Steps and Deployment Friendliness

ICLR 2025poster

Spiking Neural Networks (SNNs), models inspired by neural mechanisms in the brain, allow for energy-efficient implementation on neuromorphic hardware. However, SNNs trained with current direct training approaches are constrained to a specific time step. This "temporal inflexibility" 1) hinders SNNs'…

2024

Spiking Token Mixer: An event-driven friendly Former structure for spiking neural networks

NeurIPS 2024poster

Spiking neural networks (SNNs), inspired by biological processes, use spike signals for inter-layer communication, presenting an energy-efficient alternative to traditional neural networks. To realize the theoretical advantages of SNNs in energy efficiency, it is essential to deploy them onto neurom…

2023

Surrogate Module Learning: Reduce the Gradient Error Accumulation in Training Spiking Neural Networks

ICML 2023poster

Spiking neural networks provide an alternative solution to conventional artificial neural networks with energy-saving and high-efficiency characteristics after hardware implantation. However, due to its non-differentiable activation function and the temporally delayed accumulation in outputs, the di…

Cited by 24SourcePDFScholar
2022

Temporal Efficient Training of Spiking Neural Network via Gradient Re-weighting

ICLR 2022poster

Recently, brain-inspired spiking neuron networks (SNNs) have attracted widespread research interest because of their event-driven and energy-efficient characteristics. It is difficult to efficiently train deep SNNs due to the non-differentiability of its activation function, which disables the typic…

2021

A Free Lunch From ANN: Towards Efficient, Accurate Spiking Neural Networks Calibration

ICML 2021spotlight

Spiking Neural Network (SNN) has been recognized as one of the next generation of neural networks. Conventionally, SNN can be converted from a pre-trained ANN by only replacing the ReLU activation to spike activation while keeping the parameters intact. Perhaps surprisingly, in this work we show tha…

2021

Differentiable Spike: Rethinking Gradient-Descent for Training Spiking Neural Networks

NeurIPS 2021poster

Spiking Neural Networks (SNNs) have emerged as a biology-inspired method mimicking the spiking nature of brain neurons. This bio-mimicry derives SNNs' energy efficiency of inference on neuromorphic hardware. However, it also causes an intrinsic disadvantage in training high-performing SNNs from scra…

Cited by 288SourcePDFScholar
2021

Optimal Conversion of Conventional Artificial Neural Networks to Spiking Neural Networks

ICLR 2021poster

Spiking neural networks (SNNs) are biology-inspired artificial neural networks (ANNs) that comprise of spiking neurons to process asynchronous discrete signals. While more efficient in power consumption and inference speed on the neuromorphic hardware, SNNs are usually difficult to train directly fr…