Rough Neural Network Ensemble for Interval Data Classification

The ensemble of rough neural networks designed for the classification of objects described by vectors of intervals is proposed. In contrast to imputation, marginalisation and similar solutions for dealing with imperfect data, the proposed architecture is able to provide an imprecise answer as a result of input data imperfection. It is achieved thanks to incorporating the rough set theory to feedforward neural networks. The AdaBoost algorithm is adapted as a meta-learning of the rough ensemble. We describe gradient training for member rough networks. The proposed architecture and training methodology was tested on a wide range of interval data.

[1]  Qinghua Hu,et al.  On Robust Fuzzy Rough Set Models , 2012, IEEE Transactions on Fuzzy Systems.

[2]  Zdzislaw Pawlak,et al.  Rough sets, decision algorithms and Bayes' theorem , 2002, Eur. J. Oper. Res..

[3]  Pawan Lingras,et al.  Fuzzy-rough and rough-fuzzy serial combinations in neurocomputing , 2001, Neurocomputing.

[4]  Robert Nowicki,et al.  On Combining Neuro-Fuzzy Architectures with the Rough Set Theory to Solve Classification Problems with Incomplete Data , 2008, IEEE Transactions on Knowledge and Data Engineering.

[5]  T. Stijnen,et al.  Review: a gentle introduction to imputation of missing values. , 2006, Journal of clinical epidemiology.

[6]  De-gang Chen,et al.  The Model of Fuzzy Variable Precision Rough Sets , 2007, 2007 International Conference on Machine Learning and Cybernetics.

[7]  M Daszykowski,et al.  Dealing with missing values and outliers in principal component analysis. , 2007, Talanta.

[8]  Yau-Hwang Kuo,et al.  Cross-Lingual Document Representation and Semantic Similarity Measure: A Fuzzy Set and Rough Set Based Approach , 2010, IEEE Transactions on Fuzzy Systems.

[9]  Leo Breiman,et al.  Bias, Variance , And Arcing Classifiers , 1996 .

[10]  D. Rubin,et al.  Statistical Analysis with Missing Data , 1988 .

[11]  Robert E. Schapire,et al.  A Brief Introduction to Boosting , 1999, IJCAI.

[12]  Qinghua Hu,et al.  Communication Between Information Systems Using Fuzzy Rough Sets , 2013, IEEE Transactions on Fuzzy Systems.

[13]  Geoffrey E. Hinton,et al.  Learning representations by back-propagating errors , 1986, Nature.

[14]  Decui Liang,et al.  A Novel Risk Decision Making Based on Decision-Theoretic Rough Sets Under Hesitant Fuzzy Information , 2015, IEEE Transactions on Fuzzy Systems.

[15]  A. Asuncion,et al.  UCI Machine Learning Repository, University of California, Irvine, School of Information and Computer Sciences , 2007 .

[16]  Rafal Scherer,et al.  Novel rough neural network for classification with missing data , 2016, 2016 21st International Conference on Methods and Models in Automation and Robotics (MMAR).

[17]  Pawan Lingras,et al.  Comparison of Neofuzzy and Rough Neural Networks , 1998, Inf. Sci..

[18]  Gunnar Rätsch,et al.  An Introduction to Boosting and Leveraging , 2002, Machine Learning Summer School.

[19]  Robert Nowicki,et al.  Rough Neuro-Fuzzy Structures for Classification With Missing Data , 2009, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).