Abstract
Biological evidence shows that precise timing spikes can more accurately describe the activity of the neuron and effectively transmit spatio-temporal patterns. However, it is still a core challenge to trigger multiple precise timing spikes in each layer of multilayer spiking neural network (SNN), since the complexity of the learning targets increases significantly for multispike learning. To address this issue, we propose a novel supervised, multispike learning method for multilayer SNNs, which can accomplish the complex spatio-temporal pattern learning of spike trains. The proposed method derives the synaptic weight update rule from the Widrow-Hoff (WH) rule, and then credits the network error simultaneously to preceding layers using backpropagation. The algorithm has been successfully applied to the benchmark datasets from the UCI dataset. Experimental results show that the proposed method can achieve comparable classification accuracy with classical learning methods and a state-of-the-art supervised algorithm. In addition, the training framework effectively reduces the number of connections, thus improving the computational efficiency of the network.
This work is supported by National Natural Science Foundation of China under Grant No. 61906126.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Butts, D.A., et al.: Temporal precision in the neural code and the timescales of natural vision. Nature 449(7158), 92 (2007)
Knudsen, E.I.: Instructed learning in the auditory localization pathway of the barn owl. Nature 417(6886), 322 (2002)
Pfister, J.P., Toyoizumi, T., Barber, D., Gerstner, W.: Optimal spike-timing-dependent plasticity for precise action potential firing in supervised learning. Neural Comput. 18(6), 1318–1348 (2006)
Gardner, B., Grüning, A.: Supervised learning in spiking neural networks for precise temporal encoding. PloS one 11(8), e0161335 (2016)
Ponulak, F., Kasiński, A.: Supervised learning in spiking neural networks with resume: sequence learning, classification, and spike shifting. Neural Comput. 22(2), 467–510 (2010)
McKennoch, S., Liu, D., Bushnell, L.G.: Fast modifications of the spikeprop algorithm. In: The 2006 IEEE International Joint Conference on Neural Network Proceedings, pp. 3970–3977. IEEE (2006)
Shrestha, S.B., Song, Q.: Adaptive learning rate of spikeprop based on weight convergence analysis. Neural Netw. 63, 185–198 (2015)
Sporea, I., Grüning, A.: Supervised learning in multilayer spiking neural networks. Neural Comput. 25(2), 473–509 (2013)
Taherkhani, A., Belatreche, A., Li, Y., Maguire, L.P.: Dl-resume: a delay learning-based remote supervised method for spiking neurons. IEEE Trans. Neural Netw. Learn. Syst. 26(12), 3137–3149 (2015)
Taherkhani, A., Belatreche, A., Li, Y., Maguire, L.P.: A supervised learning algorithm for learning precise timing of multiple spikes in multilayer spiking neural networks. IEEE Trans. Neural Netw. Learn. Syst. 99, 1–14 (2018)
Wade, J.J., McDaid, L.J., Santos, J.A., Sayers, H.M.: Swat: a spiking neural network training algorithm for classification problems. IEEE Trans. Neural Netw. 21(11), 1817–1830 (2010)
Gerstner, W., Kistler, W.M.: Spiking Neuron Models: Single Neurons, Populations. Cambridge University Press, Plasticity (2002)
Yu, Q., Tang, H., Tan, K.C., Li, H.: Precise-spike-driven synaptic plasticity: learning hetero-association of spatiotemporal spike patterns. Plos one 8(11), e78318 (2013)
Snippe, H.P.: Parameter extraction from population codes: a critical assessment. Neural Comput. 8(3), 511–529 (1996)
Wang, J., Belatreche, A., Maguire, L., Mcginnity, T.M.: An online supervised learning method for spiking neural networks with adaptive structure. Neurocomputing 144, 526–536 (2014)
Bohte, S.M., Kok, J.N., La Poutre, H.: Error-backpropagation in temporally encoded networks of spiking neurons. Neurocomputing 48(1), 17–37 (2002)
Xu, Y., Zeng, X., Han, L., Yang, J.: A supervised multi-spike learning algorithm based on gradient descent for spiking neural networks. Neural Netw. 43, 99–113 (2013)
Xie, X., Qu, H., Liu, G., Zhang, M., Kurths, J.: An efficient supervised training algorithm for multilayer spiking neural networks. PloS one 11(4), e0150329 (2016)
Xie, X., Qu, H., Yi, Z., Kurths, J.: Efficient training of supervised spiking neural network via accurate synaptic-efficiency adjustment method. IEEE Trans. Neural Netw. Learn. Syst. 28(6), 1411–1424 (2017)
Tavanaei, A., Maida, A.: BP-STDP: approximating backpropagation using spike timing dependent plasticity. Neurocomputing 330, 39–47 (2019)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Switzerland AG
About this paper
Cite this paper
Xiao, R., Geng, T. (2020). A Supervised Learning Algorithm for Learning Precise Timing of Multispike in Multilayer Spiking Neural Networks. In: Yang, H., Pasupa, K., Leung, A.CS., Kwok, J.T., Chan, J.H., King, I. (eds) Neural Information Processing. ICONIP 2020. Communications in Computer and Information Science, vol 1333. Springer, Cham. https://doi.org/10.1007/978-3-030-63823-8_55
Download citation
DOI: https://doi.org/10.1007/978-3-030-63823-8_55
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-63822-1
Online ISBN: 978-3-030-63823-8
eBook Packages: Computer ScienceComputer Science (R0)