Morphological perceptrons with competitive learning: Lattice-theoretical framework and constructive learning algorithm

A morphological neural network is generally defined as a type of artificial neural network that performs an elementary operation of mathematical morphology at every node, possibly followed by the application of an activation function. The underlying framework of mathematical morphology can be found in lattice theory. With the advent of granular computing, lattice-based neurocomputing models such as morphological neural networks and fuzzy lattice neurocomputing models are becoming increasingly important since many information granules such as fuzzy sets and their extensions, intervals, and rough sets are lattice ordered. In this paper, we present the lattice-theoretical background and the learning algorithms for morphological perceptrons with competitive learning which arise by incorporating a winner-take-all output layer into the original morphological perceptron model. Several well-known classification problems that are available on the internet are used to compare our new model with a range of classifiers such as conventional multi-layer perceptrons, fuzzy lattice neurocomputing models, k-nearest neighbors, and decision trees.

[1]  Maya Gokhale,et al.  Optimizing Digital Hardware Perceptrons for Multi-Spectral Image Classification , 2003, Journal of Mathematical Imaging and Vision.

[2]  Krassimir T. Atanassov,et al.  Intuitionistic fuzzy sets , 1986 .

[3]  G. Grätzer,et al.  Lattice Theory: First Concepts and Distributive Lattices , 1971 .

[4]  Edward R. Dougherty,et al.  Design and analysis of fuzzy morphological algorithms for image processing , 1997, IEEE Trans. Fuzzy Syst..

[5]  László Györfi,et al.  A Probabilistic Theory of Pattern Recognition , 1996, Stochastic Modelling and Applied Probability.

[6]  Wei-Yin Loh,et al.  Classification and regression trees , 2011, WIREs Data Mining Knowl. Discov..

[7]  Gerhard X. Ritter,et al.  Lattice algebra approach to single-neuron computation , 2003, IEEE Trans. Neural Networks.

[8]  Vassilios Petridis,et al.  Fuzzy lattice neural network (FLNN): a hybrid model for learning , 1998, IEEE Trans. Neural Networks.

[9]  Henk J. A. M. Heijmans,et al.  Grey-Scale Morphology Based on Fuzzy Logic , 2002, Journal of Mathematical Imaging and Vision.

[10]  Paul D. Gader,et al.  Image algebra networks for pattern classification , 1994, Optics & Photonics.

[11]  R. Fisher THE USE OF MULTIPLE MEASUREMENTS IN TAXONOMIC PROBLEMS , 1936 .

[12]  R. Cuninghame-Green Minimax Algebra and Applications , 1994 .

[13]  G. Matheron Random Sets and Integral Geometry , 1976 .

[14]  Vassilis G. Kaburlasos FINs: lattice theoretic tools for improving prediction of sugar production from populations of measurements , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[15]  Lotfi A. Zadeh,et al.  Fuzzy Sets , 1996, Inf. Control..

[16]  Peter Sussner,et al.  Matrix decomposition in minimax algebra and applications in image processing , 1996 .

[17]  H. Heijmans Morphological image operators , 1994 .

[18]  Isabelle Bloch,et al.  Lattices of fuzzy sets and bipolar fuzzy sets, and mathematical morphology , 2011, Inf. Sci..

[19]  Ricardo de A. Araújo,et al.  Modular Morphological Neural Network Training via Adaptive Genetic Algorithm for Designing Translation Invariant Operators , 2006, 2006 IEEE International Conference on Acoustics Speech and Signal Processing Proceedings.

[20]  Etienne E. Kerre,et al.  On the relationship between some extensions of fuzzy set theory , 2003, Fuzzy Sets Syst..

[21]  D. J. Newman,et al.  UCI Repository of Machine Learning Database , 1998 .

[22]  Edward R. Dougherty,et al.  Hands-on Morphological Image Processing , 2003 .

[23]  Donato Malerba,et al.  A Comparative Analysis of Methods for Pruning Decision Trees , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[24]  Shi Yan,et al.  A learning rule for fuzzy associative memories , 1994, Proceedings of 1994 IEEE International Conference on Neural Networks (ICNN'94).

[25]  Peter Sussner,et al.  Morphological and Certain Fuzzy Morphological Associative Memories for Classification and Prediction , 2007, Computational Intelligence Based on Lattice Theory.

[26]  B. Carré An Algebra for Network Routing Problems , 1971 .

[27]  Peter Sussner,et al.  Constructive Morphological Neural Networks: Some Theoretical Aspects and Experimental Results in Classification , 2009, Constructive Neural Networks.

[28]  Etienne E. Kerre,et al.  On the role of complete lattices in mathematical morphology: From tool to uncertainty model , 2011, Inf. Sci..

[29]  Peter Sussner,et al.  Implicative Fuzzy Associative Memories , 2006, IEEE Transactions on Fuzzy Systems.

[30]  Ronei Marcos de Moraes,et al.  Fuzzy expert systems architecture for image classification using mathematical morphology operators , 2002, Inf. Sci..

[31]  Pierre Soille,et al.  Morphological Image Analysis , 1999 .

[32]  Petros Maragos,et al.  Neural networks with hybrid morphological/rank/linear nodes and their application to handwritten character recognition , 1998, 9th European Signal Processing Conference (EUSIPCO 1998).

[33]  Vassilios Petridis,et al.  Fuzzy Lattice Neurocomputing (FLN) models , 2000, Neural Networks.

[34]  Paul D. Gader,et al.  Automatic target detection using entropy optimized shared-weight neural networks , 2000, IEEE Trans. Neural Networks Learn. Syst..

[35]  Paul D. Gader,et al.  Morphological regularization neural networks , 2000, Pattern Recognit..

[36]  Bart Kosko,et al.  Neural networks and fuzzy systems: a dynamical systems approach to machine intelligence , 1991 .

[37]  Jean Serra,et al.  Image Analysis and Mathematical Morphology , 1983 .

[38]  Etienne E. Kerre,et al.  On the position of intuitionistic fuzzy set theory in the framework of theories modelling imprecision , 2007, Inf. Sci..

[39]  Vladik Kreinovich,et al.  Handbook of Granular Computing , 2008 .

[40]  Manuel Graña,et al.  On the Application of Associative Morphological Memories to Hyperspectral Image Analysis , 2003, IWANN.

[41]  O. Mangasarian,et al.  Multisurface method of pattern separation for medical diagnosis applied to breast cytology. , 1990, Proceedings of the National Academy of Sciences of the United States of America.

[42]  Peter Sussner,et al.  Gray-scale morphological associative memories , 2006, IEEE Transactions on Neural Networks.

[43]  Junior Barrera,et al.  Decomposition of mappings between complete lattices by mathematical morphology, Part I. General lattices , 1993, Signal Process..

[44]  Peter Sussner,et al.  Classification of Fuzzy Mathematical Morphologies Based on Concepts of Inclusion Measure and Duality , 2008, Journal of Mathematical Imaging and Vision.

[45]  Gerhard X. Ritter,et al.  Autonomous single-pass endmember approximation using lattice auto-associative memories , 2009, Neurocomputing.

[46]  Frank Y. Shih,et al.  Adaptive mathematical morphology for edge linking , 2004, Inf. Sci..

[47]  Peter Sussner,et al.  A general framework for fuzzy morphological associative memories , 2008, Fuzzy Sets Syst..

[48]  Bogdan Raducanu,et al.  Morphological Scale Spaces and Associative Morphological Memories: Results on Robustness and Practical Applications , 2003, Journal of Mathematical Imaging and Vision.

[49]  Vassilis G. Kaburlasos,et al.  A granular extension of the fuzzy-ARTMAP (FAM) neural classifier based on fuzzy lattice reasoning (FLR) , 2009, Neurocomputing.

[50]  Jennifer L. Davidson,et al.  Morphology neural networks: An introduction with applications , 1993 .

[51]  Peter Sussner,et al.  An introduction to morphological perceptrons with competitive learning , 2009, 2009 International Joint Conference on Neural Networks.

[52]  Peter Sussner,et al.  An introduction to morphological neural networks , 1996, Proceedings of 13th International Conference on Pattern Recognition.

[53]  Peter Sussner,et al.  Fuzzy Associative Memories and Their Relationship to Mathematical Morphology , 2008 .

[54]  Paul D. Gader,et al.  LADAR target detection using morphological shared-weight neural networks , 2000, Machine Vision and Applications.

[55]  Korris Fu-Lai Chung,et al.  On fuzzy associative memory with multiple-rule storage capacity , 1996, IEEE Trans. Fuzzy Syst..

[56]  Paul D. Gader,et al.  Domain learning using Choquet integral-based morphological shared weight neural networks , 2003, Image Vis. Comput..

[57]  J. Goguen L-fuzzy sets , 1967 .

[58]  R. Backhouse,et al.  Regular Algebra Applied to Path-finding Problems , 1975 .

[59]  Brian D. Ripley,et al.  Pattern Recognition and Neural Networks , 1996 .

[60]  Vartkes Goetcherian,et al.  From binary to grey tone image processing using fuzzy logic concepts , 1980, Pattern Recognit..

[61]  Frank Y. Shih,et al.  Geometric modeling and representation based on sweep mathematical morphology , 2005, Inf. Sci..

[62]  Peter Sussner,et al.  L-Fuzzy mathematical morphology: An extension of interval-valued and intuitionistic fuzzy mathematical morphology , 2009, NAFIPS 2009 - 2009 Annual Meeting of the North American Fuzzy Information Processing Society.

[63]  Richard P. Lippmann,et al.  An introduction to computing with neural nets , 1987 .

[64]  Etienne E. Kerre,et al.  Connections between binary, gray-scale and fuzzy mathematical morphologies , 2001, Fuzzy Sets Syst..

[65]  Pericles A. Mitkas,et al.  Fuzzy lattice reasoning (FLR) classifier and its application for ambient ozone estimation , 2007, Int. J. Approx. Reason..

[66]  Tiago A. E. Ferreira,et al.  An Evolutionary Morphological Approach for Financial Time Series Forecasting , 2006, 2006 IEEE International Conference on Evolutionary Computation.

[67]  Gerhard X. Ritter,et al.  Computational Intelligence Based on Lattice Theory , 2007, Studies in Computational Intelligence.

[68]  Max A. Woodbury,et al.  Individualizing user interfaces: application of the Grade of Membership (GoM) model for development of fuzzy user classes , 1994 .