PDF(4674 KB)
A high-precision, low-latency conversion method with globally representing spiking neural network
MA Zhong, XU Kexin, LI Shen, WANG Zhongxi
Integrated Circuits and Embedded Systems ›› 2025, Vol. 25 ›› Issue (3) : 15-23.
PDF(4674 KB)
PDF(4674 KB)
A high-precision, low-latency conversion method with globally representing spiking neural network
Unlike Artificial Neural Networks (ANN), Spiking Neural Networks (SNN), as a representative of the third generation of neural network technologies, perform computations based on biological neuron mechanisms, using sequences of spike signals to transmit information. This exhibits significant energy efficiency advantages and high-speed processing capabilities for massive data. However, due to the complex dynamics of spiking neurons and the non-differentiability of spike computations, the current direct training methods for SNNs are not very effective, hindering their widespread application. At present, converting high-precision ANN to SNN is considered one of the most promising methods for generating SNN. However, mainstream ANN-to-SNN conversion methods have their limitations: first, they do not support negative spikes, making it difficult to represent negative spikes from dynamic vision sensor cameras; second, low latency and high precision cannot be achieved simultaneously during the conversion process. To address these issues, this paper proposes a novel spiking neuron that can represent the entire range of values, supporting both positive and negative values in traditional ANN as well as the positive and negative polarities of DVS (Dynamic Vision Sensor) spikes. Additionally, this paper proposes a step-wise Leaky ReLU activation function and a regional convergence testing algorithm to achieve zero-error conversion from ANN to SNN. With these methods, we realize a high-precision, low-latency, and robust ANN-to-SNN conversion. Our method demonstrates outstanding performance on the CIFAR10 and CIFAR100 datasets.
ANN-to-SNN conversion / stepwise Leaky ReLU activation function / regional convergence testing algorithm / globally representing / robust test
| [1] |
|
| [2] |
|
| [3] |
|
| [4] |
|
| [5] |
S R KHERADPISHEH,
|
| [6] |
|
| [7] |
|
| [8] |
|
| [9] |
|
| [10] |
|
| [11] |
|
| [12] |
|
| [13] |
|
| [14] |
|
| [15] |
|
| [16] |
|
| [17] |
|
| [18] |
|
| [19] |
|
| [20] |
J A PEREZ-CARRASCO. Mapping from frame-driven to frame-free event-driven vision systems by low-rate rate coding and coincidence processing-application to feedforward ConvNets[J]. IEEE Trans. Pattern Anal. Mach. Intell., 2013, 35(11):2706-2719.
|
| [21] |
|
| [22] |
|
| [23] |
|
| [24] |
|
| [25] |
|
| [26] |
|
| [27] |
|
| [28] |
|
| [29] |
|
| [30] |
|
| [31] |
|
| [32] |
|
/
| 〈 |
|
〉 |