A Novel Classification Approach through Integration of Rough Sets and Back-Propagation Neural Network

Classification is an important theme in data mining. Rough sets and neural networks are the most common techniques applied in data mining problems. In order to extract useful knowledge and classify ambiguous patterns effectively, this paper presented a hybrid algorithm based on the integration of rough sets and BP neural network to construct a novel classification system. The attribution values were discretized through PSO algorithm firstly to establish a decision table. The attribution reduction algorithm and rules extraction method based on rough sets were proposed, and the flowchart of proposed approach was designed. Finally, a prototype system was developed and some simulation examples were carried out. Simulation results indicated that the proposed approach was feasible and accurate and was outperforming others.

[1]  S. M. Nikulin,et al.  Creating a model of passive electronic components using a neural network approach , 2013, Autom. Remote. Control..

[2]  Michael Y. Hu,et al.  A principled approach for building and evaluating neural network classification models , 2004, Decis. Support Syst..

[3]  Mustafa Yilmaz,et al.  Classification of EMG signals using wavelet neural network , 2006, Journal of Neuroscience Methods.

[4]  Yang Jia-xin.  Method of Rule Extraction Based on Rough Set Theory , 2011 .

[5]  Jinmao Wei,et al.  ROUGH SET BASED APPROACH TO SELECTION OF NODE , 2002 .

[6]  Jenq-Shyong Chen.  Neural network-based modelling and error compensation of thermally-induced spindle errors , 1996 .

[7]  A. K. Moschovakis,et al.  Neural network simulations of the primate oculomotor system IV. A distributed bilateral stochastic model of the neural integrator of the vertical saccadic system , 2002, Biological Cybernetics.

[8]  Ian S. Curthoys,et al.  Testable predictions from realistic neural network simulations of vestibular compensation: integrating the behavioural and physiological data , 1999, Biological Cybernetics.

[9]  Chang Li-yun,et al.  An Approach for Attribute Reduction and Rule Generation Based on Rough Set Theory , 1999 .

[10]  Yasser F. Hassan,et al.  Rough sets for adapting wavelet neural networks as a new classifier system , 2011, Applied Intelligence.

[11]  William Zhu,et al.  On Three Types of Covering-Based Rough Sets , 2014, IEEE Transactions on Knowledge and Data Engineering.

[12]  Wojciech Ziarko,et al.  The Discovery, Analysis, and Representation of Data Dependencies in Databases , 1991, Knowledge Discovery in Databases.

[13]  Michael R. Lyu,et al.  A hybrid particle swarm optimization-back-propagation algorithm for feedforward neural network training , 2007, Appl. Math. Comput..

[14]  X. Liao,et al.  An improved BP neural network based on evaluating and forecasting model of water quality in Second Songhua River of China , 2006 .

[15]  Zdzislaw Pawlak,et al.  Some Issues on Rough Sets , 2004, Trans. Rough Sets.

[16]  Abdulkadir Sengür,et al.  Wavelet packet neural networks for texture classification , 2007, Expert Syst. Appl..

[17]  Dongmei Zhang,et al.  The Application of Improved BP Neural Network Algorithm in Lithology Recognition , 2008, ISICA.

[18]  Jacek M. Zurada,et al.  Computational intelligence methods for rule-based data understanding , 2004, Proceedings of the IEEE.

[19]  ChunXia Zhao,et al.  Particle swarm optimization with adaptive population size and its application , 2009, Appl. Soft Comput..

[20]  James J. Buckley,et al.  Fuzzy neural network with fuzzy signals and weights , 1993, Int. J. Intell. Syst..

[21]  K. Thangavel,et al.  Dimensionality reduction based on rough set theory: A review , 2009, Appl. Soft Comput..

[22]  Y Wu,et al.  Method for improving classification performance of neural network based on fuzzy input and network inversion , 2005 .

[23]  Zhou Weihong,et al.  Optimization of BP Neural Network Classifier Using Genetic Algorithm , 2013 .

[24]  Michael R. Lyu,et al.  A hybrid particle swarm optimization-back-propagation algorithm for feedforward neural network training , 2007, Appl. Math. Comput..

[25]  Eiichiro Tazaki,et al.  Decision Making Using Hybrid Rough Sets and Neural Networks , 2002, Int. J. Neural Syst..

[26]  Andrzej Skowron,et al.  Rough sets: Some extensions , 2007, Inf. Sci..

[27]  Eiichiro Tazaki,et al.  Emergent rough set data analysis , 2005 .

[28]  G. Dulikravich,et al.  Evolutionary Wavelet Neural Network for Large Scale Function Estimation in Optimization , 2006 .

[29]  Yu Zhi,et al.  A simple method for predicting drag characteristics of the Wells turbine , 2006 .

[30]  H. Ishibuchi,et al.  A learning algorithm of fuzzy neural networks with triangular fuzzy weights , 1995 .