Fuzzy-Rough Cognitive Networks

Rough Cognitive Networks (RCNs) are a kind of granular neural network that augments the reasoning rule present in Fuzzy Cognitive Maps with crisp information granules coming from Rough Set Theory. While RCNs have shown promise in solving different classification problems, this model is still very sensitive to the similarity threshold upon which the rough information granules are built. In this paper, we cast the RCN model within the framework of fuzzy rough sets in an attempt to eliminate the need for a user-specified similarity threshold while retaining the model's discriminatory power. As far as we know, this is the first study that brings fuzzy sets into the domain of rough cognitive mapping. Numerical results in the presence of 140 well-known pattern classification problems reveal that our approach, referred to as Fuzzy-Rough Cognitive Networks, is capable of outperforming most traditional classifiers used for benchmarking purposes. Furthermore, we explore the impact of using different heterogeneous distance functions and fuzzy operators over the performance of our granular neural network.

[1]  Barbara Di Eugenio,et al.  Squibs and Discussions: The Kappa Statistic: A Second Look , 2004, CL.

[2]  W S McCulloch,et al.  A logical calculus of the ideas immanent in nervous activity , 1990, The Philosophy of Artificial Intelligence.

[3]  Robert Hecht-Nielsen,et al.  Theory of the backpropagation neural network , 1989, International 1989 Joint Conference on Neural Networks.

[4]  John B. Shoven,et al.  I , Edinburgh Medical and Surgical Journal.

[5]  François Laviolette,et al.  Domain-Adversarial Training of Neural Networks , 2015, J. Mach. Learn. Res..

[6]  Chris Cornelis,et al.  Fuzzy Rough Sets: from Theory into Practice , 2008, GrC 2008.

[7]  Koen Vanhoof,et al.  Rough Cognitive Networks , 2016, Knowl. Based Syst..

[8]  S. Sathiya Keerthi,et al.  Improvements to Platt's SMO Algorithm for SVM Classifier Design , 2001, Neural Computation.

[9]  D. Dubois,et al.  ROUGH FUZZY SETS AND FUZZY ROUGH SETS , 1990 .

[10]  Harry Zhang,et al.  A Fast Decision Tree Learning Algorithm , 2006, AAAI.

[11]  Theresa Beaubouef,et al.  Rough Sets , 2019, Lecture Notes in Computer Science.

[12]  Bart Kosko,et al.  Fuzzy Cognitive Maps , 1986, Int. J. Man Mach. Stud..

[13]  John G. Cleary,et al.  K*: An Instance-based Learner Using and Entropic Distance Measure , 1995, ICML.

[14]  Chris Cornelis,et al.  A New Approach to Fuzzy-Rough Nearest Neighbour Classification , 2008, RSCTC.

[15]  Koen Vanhoof,et al.  On the convergence of sigmoid Fuzzy Cognitive Maps , 2016, Inf. Sci..

[16]  Tony R. Martinez,et al.  Improved Heterogeneous Distance Functions , 1996, J. Artif. Intell. Res..

[17]  M. Friedman.  The Use of Ranks to Avoid the Assumption of Normality Implicit in the Analysis of Variance , 1937 .

[18]  F. Wilcoxon.  Individual Comparisons by Ranking Methods , 1945 .

[19]  Koen Vanhoof,et al.  A Granular Intrusion Detection System Using Rough Cognitive Networks , 2016, Recent Advances in Computational Intelligence in Defense and Security.

[20]  Nikola K. Kasabov,et al.  Evolving fuzzy neural networks for supervised/unsupervised online knowledge-based learning , 2001, IEEE Trans. Syst. Man Cybern. Part B.

[21]  Snjezana Soltic,et al.  Knowledge Extraction from Evolving Spiking Neural Networks with Rank Order Population Coding , 2010, Int. J. Neural Syst..

[22]  Eibe Frank,et al.  Logistic Model Trees , 2003, Machine Learning.

[23]  Shigeo Abe DrEng.  Pattern Classification , 2001, Springer London.

[24]  Pat Langley,et al.  Estimating Continuous Distributions in Bayesian Classifiers , 1995, UAI.

[25]  Jesús Alcalá-Fdez,et al.  KEEL Data-Mining Software Tool: Data Set Repository, Integration of Algorithms and Experimental Analysis Framework , 2011, J. Multiple Valued Log. Soft Comput..

[26]  Yiyu Yao,et al.  The superiority of three-way decisions in probabilistic rough set models , 2011, Inf. Sci..

[27]  BenavoliAlessio,et al.  Should we really use post-hoc tests based on mean-ranks? , 2016 .

[28]  Nikola K. Kasabov,et al.  DENFIS: dynamic evolving neural-fuzzy inference system and its application for time-series prediction , 2002, IEEE Trans. Fuzzy Syst..

[29]  อนิรุธ สืบสิงห์,et al.  Data Mining Practical Machine Learning Tools and Techniques , 2014 .

[30]  Chris Cornelis,et al.  Fuzzy-rough nearest neighbour classification and prediction , 2011, Theor. Comput. Sci..

[31]  Francisco Herrera,et al.  Self-labeled techniques for semi-supervised learning: taxonomy, software and empirical study , 2015, Knowledge and Information Systems.

[32]  Ian H. Witten,et al.  The WEKA data mining software: an update , 2009, SKDD.

[33]  Ron Kohavi,et al.  The Power of Decision Tables , 1995, ECML.

[34]  Koen Vanhoof,et al.  Rough cognitive ensembles , 2017, Int. J. Approx. Reason..

[35]  Anna Maria Radzikowska,et al.  A comparative study of fuzzy rough sets , 2002, Fuzzy Sets Syst..

[36]  J. Ross Quinlan,et al.  C4.5: Programs for Machine Learning , 1992 .

[37]  D. Kibler,et al.  Instance-based learning algorithms , 2004, Machine Learning.

[38]  Yiyu Yao,et al.  Three-Way Decision: An Interpretation of Rules in Rough Set Theory , 2009, RSKT.

[39]  Haijia Shi.  Best-first Decision Tree Learning , 2007 .

[40]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[41]  Eibe Frank,et al.  Speeding Up Logistic Model Tree Induction , 2005, PKDD.

[42]  Yali Amit,et al.  Shape Quantization and Recognition with Randomized Trees , 1997, Neural Computation.