Spiking Neural P Systems With Learning Functions

Spiking neural P systems (SN P systems) are a class of distributed and parallel neural-like computing models, inspired from the way neurons communicate by means of spikes. In this paper, a new variant of the systems, called SN P systems with learning functions, is introduced. Such systems can dynamically strengthen and weaken connections among neurons during the computation. A class of specific SN P systems with simple Hebbian learning function is constructed to recognize English letters. The experimental results show that the SN P systems achieve average accuracy rate 98.76% in the test case without noise. In the test cases with low, medium, and high noises, the SN P systems outperform back propagation neural networks and probabilistic neural networks. Moreover, comparing with spiking neural networks, SN P systems perform a little better in recognizing letters with noise. The result of this paper is promising in terms of the fact that it is the first attempt to use SN P systems in pattern recognition after many theoretical advancements of SN P systems, and SN P systems exhibit the feasibility for tackling pattern recognition problems.

[1]  Haibo He,et al.  Learning from Imbalanced Data , 2009, IEEE Transactions on Knowledge and Data Engineering.

[2]  Oscar H. Ibarra,et al.  Sequential SNP systems based on min/max spike number , 2009, Theor. Comput. Sci..

[3]  Xiangxiang Zeng,et al.  Performing Four Basic Arithmetic Operations With Spiking Neural P Systems , 2012, IEEE Transactions on NanoBioscience.

[4]  G Deco,et al.  The coding of information by spiking neurons: an analytical study. , 1998, Network.

[5]  Arnaud Delorme,et al.  Face identification using one spike per neuron: resistance to image degradations , 2001, Neural Networks.

[6]  Xiangxiang Zeng,et al.  A Note on Small Universal Spiking Neural P Systems , 2009, Workshop on Membrane Computing.

[7]  Dean V. Buonomano,et al.  A Neural Network Model of Temporal Code Generation and Position-Invariant Pattern Recognition , 1999, Neural Computation.

[8]  Lyle N. Long,et al.  Character Recognition using Spiking Neural Networks , 2007, 2007 International Joint Conference on Neural Networks.

[9]  Gerald Sommer,et al.  Pattern Recognition by Self-Organizing Neural Networks , 1994 .

[10]  Christo Panchev,et al.  Temporal Processing in a Spiking Model of the Visual System , 2006, ICANN.

[11]  Jeffrey D. Ullman,et al.  Introduction to Automata Theory, Languages and Computation , 1979 .

[12]  Marian Gheorghe,et al.  Research Frontiers of membrane Computing: Open Problems and Research Topics , 2013, Int. J. Found. Comput. Sci..

[13]  Hava T. Siegelmann,et al.  On the Computational Power of Neural Nets , 1995, J. Comput. Syst. Sci..

[14]  Tao Song,et al.  Spiking Neural P Systems With Rules on Synapses Working in Maximum Spiking Strategy. , 2015, IEEE transactions on nanobioscience.

[15]  Linqiang Pan,et al.  Asynchronous spiking neural P systems with local synchronization , 2013, Inf. Sci..

[16]  Tingfang Wu,et al.  Spiking neural P systems with rules on synapses and anti-spikes , 2018, Theor. Comput. Sci..

[17]  Shaista Hussain,et al.  Learning Spike Time Codes Through Morphological Learning With Binary Synapses , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[18]  Amr Badr,et al.  Towards a Spiking Neural P Systems OS , 2010, ArXiv.

[19]  Gheorghe Păun,et al.  Spiking Neural P Systems with Weights , 2010, Neural Computation.

[20]  Haibo He,et al.  A neural network based online learning and control approach for Markov jump systems , 2015, Neurocomputing.

[21]  Nikola K. Kasabov,et al.  NeuCube: A spiking neural network architecture for mapping, learning and understanding of spatio-temporal brain data , 2014, Neural Networks.

[22]  Maoguo Gong,et al.  A Multiobjective Sparse Feature Learning Model for Deep Neural Networks , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[23]  Philip D. Wasserman,et al.  Advanced methods in neural computing , 1993, VNR computer library.

[24]  Gheorghe Paun,et al.  Spiking neural P systems with neuron division and budding , 2011, Science China Information Sciences.

[25]  Dominic Palmer-Brown,et al.  A modal learning adaptive function neural network applied to handwritten digit recognition , 2008, Inf. Sci..

[26]  A. Michel,et al.  Analysis and synthesis of a class of neural networks: linear systems operating on a closed hypercube , 1989 .

[27]  Xiangxiang Zeng,et al.  Deterministic solutions to QSAT and Q3SAT by spiking neural P systems with pre-computed resources , 2010, Theor. Comput. Sci..

[28]  Hojjat Adeli,et al.  Improved spiking neural networks for EEG classification and epilepsy and seizure detection , 2007, Integr. Comput. Aided Eng..

[29]  Linqiang Pan,et al.  Spiking Neural P Systems With Rules on Synapses Working in Maximum Spikes Consumption Strategy , 2015, IEEE Transactions on NanoBioscience.

[30]  Linqiang Pan,et al.  Normal Forms for Some Classes of Sequential Spiking Neural P Systems , 2013, IEEE Transactions on NanoBioscience.

[31]  Gheorghe Paun.  Spiking Neural P Systems: A Tutorial , 2007, Bull. EATCS.

[32]  Fuliang Li,et al.  Character Recognition System Based on Back-Propagation Neural Network , 2010, 2010 International Conference on Machine Vision and Human-machine Interface.

[33]  Jinyu Wen,et al.  Adaptive Learning in Tracking Control Based on the Dual Critic Network Design , 2013, IEEE Transactions on Neural Networks and Learning Systems.

[34]  Michael Sipser,et al.  Introduction to the Theory of Computation , 1996, SIGA.

[35]  Xun Wang,et al.  Design of logic gates using spiking neural P systems with homogeneous neurons and astrocytes-like control , 2016, Inf. Sci..

[36]  Andrzej J. Kasinski,et al.  Supervised Learning in Spiking Neural Networks with ReSuMe: Sequence Learning, Classification, and Spike Shifting , 2010, Neural Computation.

[37]  Christian W. Eurich,et al.  Multidimensional Encoding Strategy of Spiking Neurons , 2000, Neural Computation.

[38]  S. Ramakrishnan.  On the Application of Various Probabilistic Neural Networks in Solving Different Pattern Classification Problems , 2008 .

[39]  Zhang Wei.  Machine Printed Character Recognition System Using Backpropagation Neural Network , 2009 .

[40]  Bolei Zhou,et al.  Learning Deep Features for Scene Recognition using Places Database , 2014, NIPS.

[41]  Huaguang Zhang,et al.  A Comprehensive Review of Stability Analysis of Continuous-Time Recurrent Neural Networks , 2014, IEEE Transactions on Neural Networks and Learning Systems.

[42]  Giancarlo Mauri,et al.  Uniform solutions to SAT and Subset Sum by spiking neural P systems , 2008, Natural Computing.

[43]  Xingyi Zhang,et al.  Spiking Neural P Systems With White Hole Neurons , 2016, IEEE Transactions on NanoBioscience.

[44]  Zhengyou He,et al.  Fault Diagnosis of Electric Power Systems Based on Fuzzy Reasoning Spiking Neural P Systems , 2015, IEEE Transactions on Power Systems.

[45]  Oscar H. Ibarra,et al.  Asynchronous spiking neural P systems , 2009, Theor. Comput. Sci..

[46]  Chin-Teng Lin,et al.  Brain Dynamics in Predicting Driving Fatigue Using a Recurrent Self-Evolving Fuzzy Neural Network , 2016, IEEE Transactions on Neural Networks and Learning Systems.

[47]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[48]  Xiangxiang Zeng,et al.  Homogeneous Spiking Neural P Systems , 2009, Fundam. Informaticae.

[49]  Martin Fodslette Meiller.  A Scaled Conjugate Gradient Algorithm for Fast Supervised Learning , 1993 .

[50]  Gheorghe Paun,et al.  The Oxford Handbook of Membrane Computing , 2010 .

[51]  Ferrante Neri,et al.  An Optimization Spiking Neural P System for Approximately Solving Combinatorial Optimization Problems , 2014, Int. J. Neural Syst..

[52]  Sander M. Bohte,et al.  Error-backpropagation in temporally encoded networks of spiking neurons , 2000, Neurocomputing.

[53]  Gheorghe Paun,et al.  Computing with Membranes , 2000, J. Comput. Syst. Sci..

[54]  Pan Linqiang,et al.  Spiking neural P systems with neuron division and budding , 2011 .

[55]  Alfonso Rodríguez-Patón,et al.  A Parallel Image Skeletonizing Method Using Spiking Neural P Systems with Weights , 2018, Neural Processing Letters.

[56]  Romain Brette,et al.  Equation-oriented specification of neural models for simulations , 2013, Front. Neuroinform..

[57]  Gheorghe Paun,et al.  Spiking Neural P Systems with Anti-Spikes , 2009, Int. J. Comput. Commun. Control.

[58]  Cheng-Lin Liu,et al.  Handwritten digit recognition: benchmarking of state-of-the-art techniques , 2003, Pattern Recognit..

[59]  Romain Brette,et al.  The Brian Simulator , 2009, Front. Neurosci..

[60]  Wofgang Maas,et al.  Networks of spiking neurons: the third generation of neural network models , 1997 .

[61]  Berin Martini,et al.  Embedded Streaming Deep Neural Networks Accelerator With Applications , 2017, IEEE Transactions on Neural Networks and Learning Systems.

[62]  Gheorghe Paun.  Spiking Neural P Systems with Astrocyte-Like Control , 2007, J. Univers. Comput. Sci..

[63]  Mihai Ionescu,et al.  Several Applications of Spiking Neural P Systems , 2007 .

[64]  J.A. Anderson,et al.  Neural Network Models for Pattern Recognition and Associative Memory , 2002 .

[65]  Andrei Paun,et al.  Small universal spiking neural P systems , 2007, Biosyst..

[66]  Ruslan Mitkov,et al.  The Oxford handbook of computational linguistics , 2003 .