Joint Ann-SNN Co-training for Object Localization and Image Segmentation

Marc Baltes; Nidal Abuhajar; Ye Yue; Charles D. Smith; Jundong Liu

ICASSP 2023accepted0 citations

Joint Ann-SNN Co-training for Object Localization and Image Segmentation

Marc Baltes, Nidal Abuhajar, Ye Yue, Charles D. Smith, Jundong Liu

Abstract

The field of machine learning has been greatly transformed with the advancement of deep artificial neural networks (ANNs) and the increased availability of annotated data. Spiking neural networks (SNNs) have recently emerged as a low-power alternative to ANNs due to their sparsity nature.In this work, we propose a novel hybrid ANN-SNN cotraining framework to improve the performance of converted SNNs. Our approach is a fine-tuning scheme, conducted through an alternating, forward-backward training procedure. We apply our framework to object detection and image segmentation tasks. Experiments demonstrate the effectiveness of our approach in achieving the design goals.

BibTeX

@inproceedings{icassp2023_jointannsnncotra,
  title = {Joint Ann-SNN Co-training for Object Localization and Image Segmentation},
  author = {Marc Baltes and Nidal Abuhajar and Ye Yue and Charles D. Smith and Jundong Liu},
  booktitle = {ICASSP 2023},
  year = {2023}
}