← Search

Ammar Belatreche

15 accepted papers

2026

AdaS: Adaptive Gradient Descent for Spiking Transformers

ICML 2026poster

Transformer-based Spiking Neural Networks (SNNs) combine Transformer performance with SNN energy efficiency through an event-driven self-attention mechanism. However, Spiking Transformers still lag behind their Artificial Neural Network (ANN) counterparts. Most existing studies address this issue th…

Cited by 0SourceScholar
2026

Positional Encoding for Spiking Transformers

ICML 2026poster

Spiking Neural Networks (SNNs) demonstrate superior energy efficiency over conventional Artificial Neural Networks (ANNs). Recent advances in Transformer-based SNNs have shown encouraging performance by seamlessly integrating spike-driven computation with Transformer architectures. Positional inform…

Cited by 0SourceScholar
2026

Robust Spiking Neural Networks Against Adversarial Attacks

ICLR 2026poster

Spiking Neural Networks (SNNs) represent a promising paradigm for energy-efficient neuromorphic computing due to their bio-plausible and spike-driven characteristics. However, the robustness of SNNs in complex adversarial environments remains significantly constrained. In this study, we theoretical…

Cited by 0SourceScholar
2026

SmoothSpike: Spiking Transformer with Learnable Hadamard Transformation

ICML 2026spotlight

Spiking Neural Networks (SNNs) that leverage sparse binary spikes and temporal dynamics have emerged as energy-efficient alternatives to Artificial Neural Networks (ANNs). However, SNNs suffer from limited representational capacity due to the discrete nature of spikes. Existing solutions extending s…

Cited by 0SourceScholar
2026

SpikingLM: Towards Fully Spiking Language Model

ICML 2026poster

Spiking Neural Networks (SNNs) offer a promising avenue toward energy-efficient language modeling by replacing multiply-accumulate operations with sparse, event-driven computation. However, constructing fully spiking language models reveals two fundamental challenges: (1) gradient degradation from d…

Cited by 0SourceScholar
2026

TP-Spikformer: Token Pruned Spiking Transformer

ICLR 2026poster

Spiking neural networks (SNNs) offer an energy-efficient alternative to traditional neural networks due to their event-driven computing paradigm. However, recent advancements in spiking transformers have focused on improving accuracy with large-scale architectures, which require significant computat…

Cited by 0SourceScholar
2026

Towards Training-Free and Accurate ANN-to-SNN Conversion via Activation-Aware Redistribution

AAAI 2026technical

Conversion represents an effective approach for obtaining low-power models by transforming Artificial Neural Networks (ANNs) into event-driven Spiking Neural Networks (SNNs) without additional training. However, existing training-free conversion methods often incur substantial conversion errors. Her

Cited by 0SourcePDFScholar
2025

BSO: Binary Spiking Online Optimization Algorithm

ICML 2025poster

Binary Spiking Neural Networks (BSNNs) offer promising efficiency advantages for resource-constrained computing. However, their training algorithms often require substantial memory overhead due to latent weights storage and temporal processing requirements. To address this issue, we propose Binary S…

2025

Binary Event-Driven Spiking Transformer

IJCAI 2025

Transformer-based Spiking Neural Networks (SNNs) introduce a novel event-driven self-attention paradigm that combines the high performance of Transformers with the energy efficiency of SNNs. However, the larger model size and increased computational demands of the Transformer structure limit their p

2025

QP-SNN: Quantized and Pruned Spiking Neural Networks

ICLR 2025poster

Brain-inspired Spiking Neural Networks (SNNs) leverage sparse spikes to encode information and operate in an asynchronous event-driven manner, offering a highly energy-efficient paradigm for machine intelligence. However, the current SNN community focuses primarily on performance improvement by deve…

Cited by 0SourcePDFScholar
2025

S$^2$NN: Sub-bit Spiking Neural Networks

NeurIPS 2025poster

Spiking Neural Networks (SNNs) offer an energy-efficient paradigm for machine intelligence, but their continued scaling poses challenges for resource-limited deployment. Despite recent advances in binary SNNs, the storage and computational demands remain substantial for large-scale networks. To furt…

Cited by 0SourceScholar
2025

Spiking Vision Transformer with Saccadic Attention

ICLR 2025poster

The combination of Spiking Neural Networks (SNNs) and Vision Transformers (ViTs) holds potential for achieving both energy efficiency and high performance, particularly suitable for edge vision applications. However, a significant performance gap still exists between SNN-based ViTs and their ANN cou…

Cited by 1SourcePDFScholar
2025

Towards Accurate Binary Spiking Neural Networks: Learning with Adaptive Gradient Modulation Mechanism

AAAI 2025technical

Binary Spiking Neural Networks (BSNNs) inherit the event-driven paradigm of SNNs, while also adopting the reduced storage burden of binarization techniques. These distinct advantages grant BSNNs lightweight and energy-efficient characteristics, rendering them ideal for deployment on resource-constra…

2024

Spike-based Neuromorphic Model for Sound Source Localization

NeurIPS 2024poster

Biological systems possess remarkable sound source localization (SSL) capabilities that are critical for survival in complex environments. This ability arises from the collaboration between the auditory periphery, which encodes sound as precisely timed spikes, and the auditory cortex, which performs…

Cited by 6SourcePDFScholar
2023

Temporal-Coded Spiking Neural Networks with Dynamic Firing Threshold: Learning with Event-Driven Backpropagation

ICCV 2023poster

Spiking Neural Networks (SNNs) offer a highly promising computing paradigm due to their biological plausibility, exceptional spatiotemporal information processing capability and low power consumption. As a temporal encoding scheme for SNNs, Time-To-First-Spike (TTFS) encodes information using the ti…

Cited by 34PDFScholar