A Neural Network Using Single Multiplicative Spiking Neuron for Function Approximation and Classification

In this paper, learning algorithm for a single multiplicative spiking neuron (MSN) is proposed and tested for various applications where a multilayer perceptron (MLP) neural network is conventionally used. It is found that a single MSN is sufficient for the applications that require a number of neurons in different hidden layers of a conventional neural network. Several benchmark and real-life problems of classification and function-approximation are illustrated. It has been observed that the inclusion of few more biological phenomenon in artificial neural networks can make them more prevailing.

[1]  Jianfeng Feng,et al.  Training the integrate-and-fire model with the informax principle: I , 2002 .

[2]  A. Hodgkin,et al.  A quantitative description of membrane current and its application to conduction and excitation in nerve , 1990 .

[3]  Bernard Widrow,et al.  Adaptive switching circuits , 1988 .

[4]  Shih-Chii Liu,et al.  Temporal coding in a silicon network of integrate-and-fire neurons , 2004, IEEE Transactions on Neural Networks.

[5]  Jianfeng Feng,et al.  Training integrate-and-fire neurons with the Informax principle II , 2003, IEEE Trans. Neural Networks.

[6]  Jianfeng Feng.  Neuronal Models with Current Inputs , 2001, IWANN.

[7]  Andrew D. Back,et al.  A spiking neural network architecture for nonlinear function approximation , 2001, Neural Networks.

[8]  S. Kaplan.  The Physiology of Thought , 1950 .

[9]  W. Gerstner,et al.  Time structure of the activity in neural network models. , 1995, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[10]  Wulfram Gerstner,et al.  SPIKING NEURON MODELS Single Neurons , Populations , Plasticity , 2002 .

[11]  W. Pitts,et al.  A Logical Calculus of the Ideas Immanent in Nervous Activity (1943) , 2021, Ideas That Created the Future.

[12]  Sander M. Bohte,et al.  SpikeProp: backpropagation for networks of spiking neurons , 2000, ESANN.

[13]  Yogesh Singh,et al.  Feedforward sigmoidal networks - equicontinuity and fault-tolerance properties , 2004, IEEE Transactions on Neural Networks.

[14]  Jianfeng Feng,et al.  Integrate-and-fire and Hodgkin-Huxley models with current inputs , 2001 .

[15]  Wofgang Maas,et al.  Networks of spiking neurons: the third generation of neural network models , 1997 .

[16]  J. J. Hopfield,et al.  Pattern recognition computation using action potential timing for stimulus representation , 1995, Nature.

[17]  Prem Kalra,et al.  Classification using single neuron , 2003, IEEE International Conference on Industrial Informatics, 2003. INDIN 2003. Proceedings..

[18]  A. Kendon,et al.  Organization of behavior in face-to-face interaction , 1975 .

[19]  S. Thomas Alexander,et al.  Adaptive Signal Processing , 1986, Texts and Monographs in Computer Science.

[20]  S. Ray,et al.  Learning with single integrate-and-fire neuron , 2005, Proceedings. 2005 IEEE International Joint Conference on Neural Networks, 2005..

[21]  W. J. Freeman.  Why neural networks don't yet fly: inquiry into the neurodynamics of biological intelligence , 1988, IEEE 1988 International Conference on Neural Networks.

[22]  Prem Kumar Kalra,et al.  Chaotic Behavior in Neural Networks and FitzHugh-Nagumo Neuronal Model , 2004, ICONIP.

[23]  Bedrich J. Hosticka,et al.  Biologically-inspired artificial neurons: modeling and applications , 1993, Proceedings of 1993 International Conference on Neural Networks (IJCNN-93-Nagoya, Japan).

[24]  T. Poggio,et al.  Multiplying with synapses and neurons , 1992 .

[25]  Henry C. Tuckwell,et al.  Introduction to theoretical neurobiology , 1988 .

[26]  Vivien A. Casagrande,et al.  Biophysics of Computation: Information Processing in Single Neurons , 1999 .