Analog-Digital Self-Learning Fuzzy Spiking Neural Network in Image Processing Problems

Computational intelligence provides a variety of means that can perform complex image processing in a rather effective way. Among them, self-learning systems, especially selflearning artificial neural networks (self-organizing maps, ART neural networks, ‘BrainState-in-a-Box’ neuromodels, etc.) (Haykin, 1999) and fuzzy clustering systems (fuzzy cmeans, algorithms of Gustafson-Kessel, Yager-Filev, Klawonn-Hoeppner, etc) (Bezdek et al., 2005; Sato-Ilic & Jain, 2006), occupy a significant place as they make it possible to solve a data processing problem in the absence of a priori knowledge of it. While there are many artificial neural networks that can be successfully used in image processing tasks, the most prominent of them are networks of a new, the third generation, commonly known as spiking neural networks (Maass & Bishop, 1998; Gerstner & Kistler, 2002). On the one hand, spiking neural networks are biologically more plausible than neural networks of the previous generations that is of fundamental importance for computational intelligence from theoretical point of view. On the other hand, networks of spiking neurons appeared to be computationally more powerful than conventional neural networks (Maass, 1997b). In addition, complex data processing via artificial neural networks of the second generation is time consuming due to multi-epoch learning; instead, spiking neural networks can perform the same processing tasks much faster as they require a few learning epochs only (Bohte et al., 2002; Berredo, 2005; Meftah et al., 2008; Lindblad & Kinser, 2005). All these facts are causing considerable interest in networks of spiking neurons as a powerful computational intelligence tool for image processing Although spiking neural networks are becoming a popular computational intelligence tool for various technical problems solving, their architecture and functioning are treated in terms of neurophysiology rather than in terms of any technical sciences apparatus in the most research works on engineering subjects. Yet none technically plausible description of spiking neurons functioning has been provided. In contrast to artificial neural networks, fuzzy logic systems are capable of performing accurate and efficient data processing under a priori and current uncertainty, particularly if classes to be separated overlap one another. Integrating artificial neural networks and fuzzy systems together allows of combining capabilities of both in a synergetic way (Jang et al., 1997), thus producing hybrid intelligent systems that achieve high performance and reliability in real life problems solving, particularly in image processing. Obviously,

[1]  Ye. Bodyanskiy,et al.  Image processing using self-learning fuzzy spiking neural network in the presence of overlapping classes , 2008, 2008 11th International Biennial Baltic Electronics Conference.

[2]  Simon Haykin,et al.  Neural Networks: A Comprehensive Foundation , 1998 .

[3]  Naresh K. Sinha,et al.  Modern Control Systems , 1981, IEEE Transactions on Systems, Man, and Cybernetics.

[4]  Marvin Minsky,et al.  Perceptrons: An Introduction to Computational Geometry , 1969 .

[5]  Peter Dayan,et al.  Theoretical Neuroscience: Computational and Mathematical Modeling of Neural Systems , 2001 .

[6]  Teuvo Kohonen,et al.  Self-Organizing Maps , 2010 .

[7]  Wofgang Maas,et al.  Networks of spiking neurons: the third generation of neural network models , 1997 .

[8]  J. J. Hopfield,et al.  Pattern recognition computation using action potential timing for stimulus representation , 1995, Nature.

[9]  Sander M. Bohte,et al.  Unsupervised clustering with spiking neurons by sparse temporal coding and multilayer RBF networks , 2002, IEEE Trans. Neural Networks.

[10]  James C. Bezdek,et al.  Pattern Recognition with Fuzzy Objective Function Algorithms , 1981, Advanced Applications in Pattern Recognition.

[11]  Lakhmi C. Jain,et al.  Innovations in Fuzzy Clustering - Theory and Applications , 2006, Studies in Fuzziness and Soft Computing.

[12]  Jürgen Kurths,et al.  Synchronization - A Universal Concept in Nonlinear Sciences , 2001, Cambridge Nonlinear Science Series.

[13]  Eytan Domany,et al.  Temporal aspects of coding and information processing in biological systems , 1994 .

[14]  A. Roli Artificial Neural Networks , 2012, Lecture Notes in Computer Science.

[15]  Wolfgang Maass,et al.  Fast Sigmoidal Networks via Spiking Neurons , 1997, Neural Computation.

[16]  Charles L. Phillips,et al.  Feedback Control Systems , 1988 .

[17]  J. Fort,et al.  A stochastic model of retinotopy: A self organizing process , 1986, Biological Cybernetics.

[18]  James M. Keller,et al.  Fuzzy Models and Algorithms for Pattern Recognition and Image Processing , 1999 .

[19]  W. Pitts,et al.  A Logical Calculus of the Ideas Immanent in Nervous Activity (1943) , 2021, Ideas That Created the Future.

[20]  Abdelkader Benyettou,et al.  Image clustering with spiking neuron network , 2008, 2008 IEEE International Joint Conference on Neural Networks (IEEE World Congress on Computational Intelligence).

[21]  Wulfram Gerstner,et al.  SPIKING NEURON MODELS Single Neurons , Populations , Plasticity , 2002 .

[22]  Kurt Hornik,et al.  Multilayer feedforward networks are universal approximators , 1989, Neural Networks.

[23]  Christoph von der Malsburg,et al.  The Correlation Theory of Brain Function , 1994 .

[24]  Marek Kraft,et al.  DESIGN OF THE SPIKING NEURON HAVING LEARNING CAPABILITIES BASED ON FPGA CIRCUITS , 2006 .

[25]  K. Schulten,et al.  On the stationary state of Kohonen's self-organizing sensory mapping , 2004, Biological Cybernetics.

[26]  E. Mizutani,et al.  Neuro-Fuzzy and Soft Computing-A Computational Approach to Learning and Machine Intelligence [Book Review] , 1997, IEEE Transactions on Automatic Control.

[27]  I︠a︡. Z. T︠S︡ypkin Relay Control Systems , 1985 .

[28]  Graham C. Goodwin,et al.  Control System Design , 2000 .

[29]  T Natschläger,et al.  Spatial and temporal pattern analysis via spiking neurons. , 1998, Network.

[30]  Christopher J. Bishop,et al.  Pulsed Neural Networks , 1998 .

[31]  J. Nazuno Haykin, Simon. Neural networks: A comprehensive foundation, Prentice Hall, Inc. Segunda Edición, 1999 , 2000 .

[32]  Wulfram Gerstner,et al.  A neuronal learning rule for sub-millisecond temporal coding , 1996, Nature.

[33]  Tim Schönauer,et al.  Simulation of a digital neuro-chip for spiking neural networks , 2000, Proceedings of the IEEE-INNS-ENNS International Joint Conference on Neural Networks. IJCNN 2000. Neural Computing: New Challenges and Perspectives for the New Millennium.

[34]  Jason M. Kinser,et al.  Image Processing using Pulse-Coupled Neural Networks , 1998, Perspectives in Neural Computing.

[35]  Alwyn C. Scott,et al.  Neuroscience: A Mathematical Primer , 2002 .

[36]  Yevgeniy Bodyanskiy,et al.  SELF-LEARNING FUZZY SPIKING NEURAL NETWORK AS A NONLINEAR PULSE-POSITION THRESHOLD DETECTION DYNAMIC SYSTEM BASED ON SECOND-ORDER CRITICALLY DAMPED RESPONSE UNITS , 2009 .

[37]  George Cybenko,et al.  Approximation by superpositions of a sigmoidal function , 1992, Math. Control. Signals Syst..