A new method for constructing granular neural networks based on rule extraction and extreme learning machine

This paper introduces a framework of granular neural networks named rough rule granular extreme learning machine (RRGELM), and develops its comprehensive design process. The proposed granular neural networks are formed on the basis of rough decision rules extracted from training samples through rough set theory. Firstly, Sample data are reduced by the algorithms of attributes reduction and attributes values reduction in rough set theory, and then they are compressed to an irredundant data set. In this data set, each sample can represent a rough rule, and is expressed as an If-Then rule which indicates the relationship between the input and output pattern. Moreover, the confidence level and the coverage level of each rule are calculated. Secondly, granular-neurons can be constructed through the If-Then rules, and all the granular-neurons constitute rule matching layer which is regarded as the hidden layer of the RRGELM. The linked weights between the input neurons and granular-neurons can be determined by the confidences of rough decision rules, while the linked weights between the output neurons and granular-neurons can be initialized as the contributions of the rough rules to the classification. Finally, the extreme learning machine (ELM) algorithm is introduced to improve the learning speed of the RRGELM, rather than the BP algorithm used by other traditional GNN models. Good performance of the proposed RRGELM is demonstrated on several well-known benchmark data sets.

[1]  Daniel F. Leite,et al.  Evolving granular neural network for semi-supervised data stream classification , 2010, The 2010 International Joint Conference on Neural Networks (IJCNN).

[2]  Sankar K. Pal,et al.  Rough Self Organizing Map , 2004, Applied Intelligence.

[3]  Tsau Young Lin,et al.  Granular neural web agents for stock prediction , 2002, Soft Comput..

[4]  Demetris Stathakis,et al.  Satellite image classification using granular neural networks , 2006 .

[5]  Daniel F. Leite,et al.  Evolving granular neural networks from fuzzy data streams , 2013, Neural Networks.

[6]  Jao-Hong Cheng,et al.  A hybrid forecast marketing timing model based on probabilistic neural network, rough set and C4.5 , 2010, Expert Syst. Appl..

[7]  Yasser F. Hassan,et al.  Rough sets for adapting wavelet neural networks as a new classifier system , 2011, Applied Intelligence.

[8]  Sung-Kwun Oh,et al.  Modeling of the charging characteristic of linear-type superconducting power supply using granular-based radial basis function neural networks , 2012, Expert Syst. Appl..

[9]  Soumitra Dutta,et al.  Fuzzy rough granular neural networks, fuzzy granules, and classification , 2011, Theor. Comput. Sci..

[10]  M Syeda,et al.  Parallel granular neural networks for fast credit card fraud detection , 2002, 2002 IEEE World Congress on Computational Intelligence. 2002 IEEE International Conference on Fuzzy Systems. FUZZ-IEEE'02. Proceedings (Cat. No.02CH37291).

[11]  Scott Dick,et al.  A granular neural network: Performance analysis and application to re-granulation , 2013, Int. J. Approx. Reason..

[12]  Catherine Blake,et al.  UCI Repository of machine learning databases , 1998 .

[13]  Chee Kheong Siew,et al.  Extreme learning machine: Theory and applications , 2006, Neurocomputing.

[14]  Witold Pedrycz,et al.  Granular Neural Networks: Concepts and Development Schemes , 2013, IEEE Transactions on Neural Networks and Learning Systems.

[15]  Yanqing Zhang,et al.  Granular Neural Networks With Evolutionary Interval Learning , 2008, IEEE Transactions on Fuzzy Systems.

[16]  Yaonan Wang,et al.  Rough neural network modeling based on fuzzy rough model and its application to texture classification , 2009, Neurocomputing.

[17]  Shifei Ding,et al.  Extreme learning machine and its applications , 2013, Neural Computing and Applications.

[18]  Abraham Kandel,et al.  Granular neural networks for numerical-linguistic data fusion and knowledge discovery , 2000, IEEE Trans. Neural Networks Learn. Syst..

[19]  Zhi-Li Zhang,et al.  Fuzzy rough neural network and its application to feature selection , 2011, The Fourth International Workshop on Advanced Computational Intelligence.

[20]  Chun-Chin Hsu,et al.  An information granulation based data mining approach for classifying imbalanced data , 2008, Inf. Sci..

[21]  Yu Cao,et al.  Early warning of enterprise decline in a life cycle using neural networks and rough set theory , 2011, Expert Syst. Appl..

[22]  Hongming Zhou,et al.  Extreme Learning Machine for Regression and Multiclass Classification , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[23]  Athanasios V. Vasilakos,et al.  Granular neural networks for land use classification , 2005, Soft Comput..

[24]  Lotfi A. Zadeh,et al.  Toward a theory of fuzzy information granulation and its centrality in human reasoning and fuzzy logic , 1997, Fuzzy Sets Syst..

[25]  Shen-Chuan Tai,et al.  Segmentation of multispectral MR images through an annealed rough neural network , 2011, Neural computing & applications (Print).

[26]  Enrique Romero,et al.  Data and knowledge visualization with virtual reality spaces, neural networks and rough sets: Application to cancer and geophysical prospecting data , 2012 .

[27]  Witold Pedrycz,et al.  Granular neural networks , 2001, Neurocomputing.

[28]  Dusan Marcek,et al.  Approximation and Prediction of Wages Based on Granular Neural Network , 2008, RSKT.

[29]  Daniel F. Leite,et al.  Evolving granular neural network for fuzzy time series forecasting , 2012, The 2012 International Joint Conference on Neural Networks (IJCNN).