Unified granular neural networks for pattern classification

Abstract Motivation in the development of granular neural network (GNN) with the principle of granular computing (GrC) is to obtain possible degree of transparency in the network architecture and its operational steps, which are bottleneck for conventional neural network (NN). In addition, GNN provides improved performance and at the same time poses less computational burden compared to conventional NN and fuzzy NN (FNN). Topologically, the nodes of different layers of FNNs are fully connected whereas it is partial in case of GNNs. Further, the architectures of GNN is determined based on the extracted rules from the domain information. However, selection of relevant rules for GNN is a tedious task. To mitigate this, the present paper aims to develop a pattern classification model in the framework of unification of GNNs and tries to avoid the searching of optimum number of rules and the best combination of rules. The unified model thus works with a set of different rules-based GNNs and derives the final decision from the individual GNN. Each of these GNNs takes the class-supportive fuzzy granulated features of the input in order to preserve the feature-wise belonging information to different classes. These granulated features provide improved class discriminatory information for the classification of data sets with ill-defined and overlapping class boundaries. The proposed model thus explores mutually the advantages of class-supportive fuzzy granulation of features, informative rules-based GNNs and unification of GNNs. Superiority of the model to similar other methods are justified in terms of various performance measurement indexes using different benchmark data sets including remote sensing imagery.

[1]  Demetris Stathakis,et al.  Satellite image classification using granular neural networks , 2006 .

[2]  Ludmila I. Kuncheva,et al.  Fuzzy Classifier Design , 2000, Studies in Fuzziness and Soft Computing.

[3]  Sankar K. Pal,et al.  Fuzzy sets and decisionmaking approaches in vowel and speaker recognition , 1977 .

[4]  Joseph N. Wilson,et al.  Twenty Years of Mixture of Experts , 2012, IEEE Transactions on Neural Networks and Learning Systems.

[5]  Sundaram Suresh,et al.  A complex-valued neuro-fuzzy inference system and its learning mechanism , 2014, Neurocomputing.

[6]  Vladik Kreinovich,et al.  Handbook of Granular Computing , 2008 .

[7]  Nikola K. Kasabov,et al.  Learning fuzzy rules and approximate reasoning in fuzzy neural networks and hybrid systems , 1996, Fuzzy Sets Syst..

[8]  R. Polikar,et al.  Ensemble based systems in decision making , 2006, IEEE Circuits and Systems Magazine.

[9]  Sankar K. Pal,et al.  Knowledge-based fuzzy MLP for classification and rule generation , 1997, IEEE Trans. Neural Networks.

[10]  Sankar K. Pal,et al.  Rough fuzzy MLP: knowledge encoding and classification , 1998, IEEE Trans. Neural Networks.

[11]  Soumitra Dutta,et al.  Fuzzy rough granular neural networks, fuzzy granules, and classification , 2011, Theor. Comput. Sci..

[12]  Soumitra Dutta,et al.  Class-dependent rough-fuzzy granular space, dispersion index and classification , 2012, Pattern Recognit..

[13]  Ioannis Kanellopoulos,et al.  Global Elevation Ancillary Data for Land-use Classification Using Granular Neural Networks , 2008 .

[14]  George Panoutsos,et al.  Granular computing neural-fuzzy modelling: A neutrosophic approach , 2013, Appl. Soft Comput..

[15]  Wei Zhang,et al.  Multiple Classifier System for Remote Sensing Image Classification: A Review , 2012, Sensors.

[16]  Giovanni Bortolan An architecture of fuzzy neural networks for linguistic processing , 1998, Fuzzy Sets Syst..

[17]  Sankar K. Pal,et al.  Multilayer perceptron, fuzzy sets, and classification , 1992, IEEE Trans. Neural Networks.

[18]  Subhash C. Bagui,et al.  Combining Pattern Classifiers: Methods and Algorithms , 2005, Technometrics.

[19]  Jiri Matas,et al.  On Combining Classifiers , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[20]  Witold Pedrycz,et al.  Granular Neural Networks: Concepts and Development Schemes , 2013, IEEE Transactions on Neural Networks and Learning Systems.

[21]  Lotfi A. Zadeh,et al.  Fuzzy Sets , 1996, Inf. Control..

[22]  Guoqiang Peter Zhang,et al.  Neural networks for classification: a survey , 2000, IEEE Trans. Syst. Man Cybern. Part C.

[23]  Jacob Cohen A Coefficient of Agreement for Nominal Scales , 1960 .

[24]  Qingxiang Wu,et al.  Pedestrian identification based on fusion of multiple features and multiple classifiers , 2016, Neurocomputing.

[25]  Witold Pedrycz,et al.  Granular Computing: Analysis and Design of Intelligent Systems , 2013 .

[26]  Saroj K. Meher Knowledge-Encoded Granular Neural Networks for Hyperspectral Remote Sensing Image Classification , 2015, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[27]  Witold Pedrycz,et al.  From local neural networks to granular neural networks: A study in information granulation , 2011, Neurocomputing.

[28]  Andrew Kusiak,et al.  A data-driven approach for steam load prediction in buildings , 2010 .

[29]  John A. Richards,et al.  Remote Sensing Digital Image Analysis: An Introduction , 1999 .

[30]  Samarjit Kar,et al.  Applications of neuro fuzzy systems: A brief review and future outline , 2014, Appl. Soft Comput..

[31]  Lorenzo Bruzzone,et al.  Neuro-fuzzy-combiner: an effective multiple classifier system , 2010, Int. J. Knowl. Eng. Soft Data Paradigms.

[32]  Athanasios V. Vasilakos,et al.  Granular neural networks for land use classification , 2005, Soft Comput..

[33]  Scott Dick,et al.  A granular neural network: Performance analysis and application to re-granulation , 2013, Int. J. Approx. Reason..

[34]  Saroj K. Meher Explicit rough-fuzzy pattern classification model , 2014, Pattern Recognit. Lett..

[35]  Hui Li,et al.  Research of multi-sided multi-granular neural network ensemble optimization method , 2016, Neurocomputing.

[36]  P. ZhangG. Neural networks for classification , 2000 .

[37]  Witold Pedrycz,et al.  Granular neural networks , 2001, Neurocomputing.

[38]  Saroj K. Meher,et al.  A novel approach to neuro-fuzzy classification , 2009, Neural Networks.