Fuzzy rough granular neural networks, fuzzy granules, and classification

We introduce a fuzzy rough granular neural network (FRGNN) model based on the multilayer perceptron using a back-propagation algorithm for the fuzzy classification of patterns. We provide the development strategy of the network mainly based upon the input vector, initial connection weights determined by fuzzy rough set theoretic concepts, and the target vector. While the input vector is described in terms of fuzzy granules, the target vector is defined in terms of fuzzy class membership values and zeros. Crude domain knowledge about the initial data is represented in the form of a decision table, which is divided into subtables corresponding to different classes. The data in each decision table is converted into granular form. The syntax of these decision tables automatically determines the appropriate number of hidden nodes, while the dependency factors from all the decision tables are used as initial weights. The dependency factor of each attribute and the average degree of the dependency factor of all the attributes with respect to decision classes are considered as initial connection weights between the nodes of the input layer and the hidden layer, and the hidden layer and the output layer, respectively. The effectiveness of the proposed FRGNN is demonstrated on several real-life data sets.

[1]  Pawan Lingras,et al.  Survey of Rough and Fuzzy Hybridization , 2007, 2007 IEEE International Fuzzy Systems Conference.

[2]  Andrzej Skowron,et al.  Rough sets and Boolean reasoning , 2007, Inf. Sci..

[3]  Andrzej Skowron,et al.  Rough sets: Some extensions , 2007, Inf. Sci..

[4]  George J. Klir,et al.  Fuzzy sets, uncertainty and information , 1988 .

[5]  Richard P. Lippmann,et al.  An introduction to computing with neural nets , 1987 .

[6]  Simon Haykin,et al.  Neural Networks: A Comprehensive Foundation , 1998 .

[7]  Witold Pedrycz,et al.  Granular Computing - The Emerging Paradigm , 2007 .

[8]  Qiang Shen,et al.  New Approaches to Fuzzy-Rough Feature Selection , 2009, IEEE Transactions on Fuzzy Systems.

[9]  L. Zadeh A new direction in AI: toward a computational theory of perceptions , 2002 .

[10]  Michael R. W. Dawson,et al.  The Multilayer Perceptron , 2008 .

[11]  Andrzej Skowron,et al.  Rough-Neural Computing: Techniques for Computing with Words , 2004, Cognitive Technologies.

[12]  Abraham Kandel,et al.  Granular computing in neural networks , 2001 .

[13]  Sankar K. Pal,et al.  Roughness of a Fuzzy Set , 1996, Inf. Sci..

[14]  Lotfi A. Zadeh,et al.  Toward a theory of fuzzy information granulation and its centrality in human reasoning and fuzzy logic , 1997, Fuzzy Sets Syst..

[15]  Janusz Zalewski,et al.  Rough sets: Theoretical aspects of reasoning about data , 1996 .

[16]  Grzegorz Rozenberg,et al.  The many facets of natural computing , 2008, Commun. ACM.

[17]  Sankar K. Pal,et al.  Generalized Rough Sets, Entropy, and Image Ambiguity Measures , 2009, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[18]  Catherine Blake,et al.  UCI Repository of machine learning databases , 1998 .

[19]  Andrzej Skowron,et al.  Rough-Fuzzy Hybridization: A New Trend in Decision Making , 1999 .

[20]  Athanasios V. Vasilakos,et al.  Granular neural networks for land use classification , 2005, Soft Comput..

[21]  Lotfi A. Zadeh,et al.  Fuzzy Logic , 2009, Encyclopedia of Complexity and Systems Science.

[22]  Y. Yao,et al.  Stratified rough sets and granular computing , 1999, 18th International Conference of the North American Fuzzy Information Processing Society - NAFIPS (Cat. No.99TH8397).

[23]  Marcin Szczuka Refining classifiers with neural networks , 2001 .

[24]  Lotfi A. Zadeh,et al.  From Computing with Numbers to Computing with Words - from Manipulation of Measurements to Manipulation of Perceptions , 2005, Logic, Thought and Action.

[25]  Jyh-Shing Roger Jang,et al.  ANFIS: adaptive-network-based fuzzy inference system , 1993, IEEE Trans. Syst. Man Cybern..

[26]  Andrzej Skowron,et al.  Rough-Neural Computing , 2004, Cognitive Technologies.

[27]  Chris Cornelis,et al.  Attribute selection with fuzzy decision reducts , 2010, Inf. Sci..

[28]  Sankar K. Pal,et al.  Multilayer perceptron, fuzzy sets, and classification , 1992, IEEE Trans. Neural Networks.

[29]  Sankar K. Pal,et al.  Fuzzy Mathematical Approach to Pattern Recognition , 1986 .

[30]  Lotfi A. Zadeh,et al.  Fuzzy logic, neural networks, and soft computing , 1993, CACM.

[31]  Sankar K. Pal,et al.  Computational Theory Perception (CTP), Rough-Fuzzy Uncertainty Analysis and Mining in Bioinformatics and Web Intelligence: A Unified Framework , 2010, Trans. Rough Sets.

[32]  A. Nakamura,et al.  Fuzzy rough sets , 1988 .

[33]  Yee Leung,et al.  Generalized fuzzy rough sets determined by a triangular norm , 2008, Inf. Sci..

[34]  Sankar K. Pal,et al.  Rough fuzzy MLP: knowledge encoding and classification , 1998, IEEE Trans. Neural Networks.

[35]  Yanqing Zhang,et al.  Granular Neural Networks With Evolutionary Interval Learning , 2008, IEEE Transactions on Fuzzy Systems.

[36]  D. Dubois,et al.  ROUGH FUZZY SETS AND FUZZY ROUGH SETS , 1990 .

[37]  Sankar K. Pal,et al.  Fuzzy sets and decisionmaking approaches in vowel and speaker recognition , 1977 .

[38]  M. E. Abd El-Monsef,et al.  Generalized rough sets , 2004 .

[39]  Abraham Kandel,et al.  Granular neural networks for numerical-linguistic data fusion and knowledge discovery , 2000, IEEE Trans. Neural Networks Learn. Syst..

[40]  Andrzej Skowron,et al.  Rudiments of rough sets , 2007, Inf. Sci..