A high-precision, low-latency conversion method with globally representing spiking neural network

MA Zhong, XU Kexin, LI Shen, WANG Zhongxi

Integrated Circuits and Embedded Systems ›› 2025, Vol. 25 ›› Issue (3) : 15-23.

PDF(4674 KB)
PDF(4674 KB)
Integrated Circuits and Embedded Systems ›› 2025, Vol. 25 ›› Issue (3) : 15-23. DOI: 10.20193/j.ices2097-4191.2024.0066
Research Paper

A high-precision, low-latency conversion method with globally representing spiking neural network

Author information +
History +

Abstract

Unlike Artificial Neural Networks (ANN), Spiking Neural Networks (SNN), as a representative of the third generation of neural network technologies, perform computations based on biological neuron mechanisms, using sequences of spike signals to transmit information. This exhibits significant energy efficiency advantages and high-speed processing capabilities for massive data. However, due to the complex dynamics of spiking neurons and the non-differentiability of spike computations, the current direct training methods for SNNs are not very effective, hindering their widespread application. At present, converting high-precision ANN to SNN is considered one of the most promising methods for generating SNN. However, mainstream ANN-to-SNN conversion methods have their limitations: first, they do not support negative spikes, making it difficult to represent negative spikes from dynamic vision sensor cameras; second, low latency and high precision cannot be achieved simultaneously during the conversion process. To address these issues, this paper proposes a novel spiking neuron that can represent the entire range of values, supporting both positive and negative values in traditional ANN as well as the positive and negative polarities of DVS (Dynamic Vision Sensor) spikes. Additionally, this paper proposes a step-wise Leaky ReLU activation function and a regional convergence testing algorithm to achieve zero-error conversion from ANN to SNN. With these methods, we realize a high-precision, low-latency, and robust ANN-to-SNN conversion. Our method demonstrates outstanding performance on the CIFAR10 and CIFAR100 datasets.

Key words

ANN-to-SNN conversion / stepwise Leaky ReLU activation function / regional convergence testing algorithm / globally representing / robust test

Cite this article

Download Citations
MA Zhong , XU Kexin , LI Shen , et al. A high-precision, low-latency conversion method with globally representing spiking neural network[J]. Integrated Circuits and Embedded Systems. 2025, 25(3): 15-23 https://doi.org/10.20193/j.ices2097-4191.2024.0066

References

[1]
PETER U DIEHL, MATTHEW COOK. Unsupervised learning of digit recognition using spike-timing-dependent plasticity[J]. Frontiers in Computational Neuroscience, 2015(9):99.
[2]
AMIRHOSSEIN TAVANAEI, MASOUD GHODRATI, SAEED REZA KHERADPISHEH, et al. Deep learning in spiking neural networks[J]. Neural Networks, 2019(111):47-63.
[3]
G Q BI, M M POO. Synaptic modifications in cultured hippocampal neurons:Dependence on spike timing,synaptic strength, and post-synaptic cell type[J]. The J. Neurosci., 1998, 18(24):10464-10472.
[4]
M MOZAFARI, S R KHERADPISHEH, T MASQUELIER, et al. First-spike-based visual categorization using reward-modulated STDP[J]. IEEE Trans. Neural Netw. Learn. Syst., 2018, 29(12):6178-6190.
[5]
S R KHERADPISHEH, M GANJTABESH, S J THORPE, et al. STDP-based spiking deep convolutional neural networks for object recognition[J]. Neural Netw., 2018, 99(3):56-67.
[6]
C LEE, G SRINIVASAN, P PANDA, et al. Deep spiking convolutional neural network trained with unsupervised spike-timing-dependent plasticity[J]. IEEE Trans. Cognit. Develop. Syst., 2019, 11(3):384-394.
[7]
D E RUMELHART, G E HINTON, R J WILLIAMS. Learning representations by back-propagating errors[J]. Nature, 1988, 323(6088):696-699.
[8]
S M BOHTE, J N KOK, H LA POUTRÉ. Error-backpropagation in temporally encoded networks of spiking neurons[J]. Neurocomputing, 2002, 48(10):17-37.
[9]
H MOSTAFA. Supervised learning based on temporal coding in spiking neural networks[J]. IEEE Trans. Neural Netw. Learn. Syst., 2018, 29(7):3227-3235.
[10]
WU Y, DENG L, LI G, et al. Spatio-temporal backpropagation for training high-performance spiking neural networks[J]. Frontiers Neurosci., 2018, 12(3).
[11]
JIN Y, ZHANG W, LI P. Hybrid macro/micro level backpropagation for training deep spiking neural networks[C]// Proc. Adv. Neural Inf. Process. Syst., 2018:7005-7015.
[12]
S B SHRESTHA, G ORCHARD. Slayer:Spike layer error reassignment in time[C]// Proc. Adv. Neural Inf. Process. Syst., 2018:1412-1421.
[13]
E O NEFTCI, H MOSTAFA, F ZENKE. Surrogate gradient learning in spiking neural networks:Bringing the power of gradient-based optimization to spiking neural networks[J]. IEEE Signal Process. Mag., 2019, 36(6):51-63.
[14]
GU P, XIAO R, PAN G, et al. STCA:Spatio-temporal credit assignment with delayed feedback in deep spiking neural networks[C]// Proc. 28th Int. Joint Conf. Artif. Intell., 2019:1366-1372.
[15]
ABHRONIL SENGUPTA, YUTING YE, ROBERT WANG, et al. Going deeper in spiking neural networks:Vgg and residual architectures[J]. Frontiers in neuroscience, 2019(13):95.
[16]
YONGQIANG CAO, YANG CHEN, DEEPAK KHOSLA. Spiking deep convolutional neural networks for energy-effcient object recognition[J]. International Journal of Computer Vision, 2015, 113(1):54-66.
[17]
BU T, FANG W, DING J H, et al. Optimal ann-snn conversion for high-accuracy and ultra-low-latency spiking neural networks[C]// In International Conference on Learning Representations, 2021.
[18]
LI W S, CHEN H T, GUO J Y, et al. Brain-inspired multi-layer perceptron with spiking neurons[C]// Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2022:783-793.
[19]
ALAN JEFFARES, QINGHAI GUO, PONTUS STENETORP, et al. Spike-inspired rank coding for fast and accurate recurrent neural networks.arXiv preprint arXiv:2110.02865, 2021.
[20]
J A PEREZ-CARRASCO. Mapping from frame-driven to frame-free event-driven vision systems by low-rate rate coding and coincidence processing-application to feedforward ConvNets[J]. IEEE Trans. Pattern Anal. Mach. Intell., 2013, 35(11):2706-2719.
[21]
Y CAO, Y CHEN, D KHOSLA. Spiking deep convolutional neural networks for energy-efficient object recognition[J]. Int. J. Comput. Vis., 2015, 113(1):54-66.
[22]
P U DIEHL, D NEIL, J BINAS, et al. Fast-classifying, high-accuracy spiking deep networks through weight and threshold balancing[C]// Proc. Int. Joint Conf. Neural Netw. (IJCNN), 2015:1-8.
[23]
B RUECKAUER, I A LUNGU, Y HU, et al. Conversion of continuous-valued deep networks to efficient event-driven networks for image classification[J]. Frontiers Neurosci., 2017, 11(12):682.
[24]
XU Y, TANG H, XING J, et al. Spike trains encoding and threshold rescaling method for deep spiking neural networks[C]// Proc. IEEE Symp. Ser. Comput. Intell. (SSCI), 2017:1-6.
[25]
A SENGUPTA, Y YE, R WANG, et al. Going deeper in spiking neural networks: VGG and residual architectures[J]. Frontiers Neurosci., 2019, 13(3).
[26]
S KIM, S PARK, B NA, et al. Spiking-YOLO:Spiking neural network for energy-efficient object detection[C]// Proc. 24th AAAI Conf. Artif. Intell., 2020:11270-11277.
[27]
WANG Y, XU Y, YAN R, et al. Deep spiking neural networks with binary weights for object recognition[C]// IEEE Trans. Cognit. Develop. Syst., early access, 2020.doi: 10.1109/TCDS.2020.2971655.
[28]
FANG W, YU Z, CHEN Y, et al. Incorporating learnable membrane time constant to enhance learning of spiking neural networks[C]// Proceedings of the IEEE/CVF international conference on computer vision, 2021:2661-2671.
[29]
YANG LI, YI ZENG. Effcient and accurate conversion of spiking neural network with burst spikes. arXiv preprint arXiv:2204.13271, 2022.
[30]
WANG Y C, ZHANG M L, CHEN Y, et al. Signed neuron with memory:Towards simple, accurate and high-effcient ann-snn conversion[C]// International Joint Conference on Artifcial Intelligence, 2022.
[31]
LI Y H, DENG S K, DONG X, et al. A free lunch from ann:Towards effcient, accurate spiking neural networks calibration[C]// International Conference on Machine Learning, 2021:6316-6325.
[32]
MENG Q Y, XIAO M Q, YAN S, et al. Training high-performance low-latency spiking neural networks by differentiation on spike representation[C]// Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2022:12444-12453.
PDF(4674 KB)

Accesses

Citation

Detail

Sections
Recommended

/