Fuzzy-Rough Nearest Neighbour Classification

A new fuzzy-rough nearest neighbour (FRNN) classification algorithm is presented in this paper, as an alternative to Sarkar's fuzzy-rough ownership function (FRNN-O) approach. By contrast to the latter, our method uses the nearest neighbours to construct lower and upper approximations of decision classes, and classifies test instances based on their membership to these approximations. In the experimental analysis, we evaluate our approach with both classical fuzzy-rough approximations (based on an implicator and a t-norm), as well as with the recently introduced vaguely quantified rough sets. Preliminary results are very good, and in general FRNN outperforms FRNN-O, as well as the traditional fuzzy nearest neighbour (FNN) algorithm.

[1]  Xiangyang Wang,et al.  Fuzzy-Rough Set Based Nearest Neighbor Clustering Classification Algorithm , 2005, FSKD.

[2]  Vladik Kreinovich,et al.  Handbook of Granular Computing , 2008 .

[3]  Xizhao Wang,et al.  Learning fuzzy rules from fuzzy samples based on rough set technique , 2007, Inf. Sci..

[4]  Chris Cornelis,et al.  Feature Selection with Fuzzy Decision Reducts , 2008, RSKT.

[6]  金田 重郎,et al.  C4.5: Programs for Machine Learning (書評) , 1995 .

[7]  J. Ross Quinlan,et al.  C4.5: Programs for Machine Learning , 1992 .

[8]  Guoyin Wang,et al.  Rough Sets, Fuzzy Sets, Data Mining, and Granular Computing , 2013, Lecture Notes in Computer Science.

[9]  Qiang Shen,et al.  Computational Intelligence and Feature Selection - Rough and Fuzzy Approaches , 2008, IEEE Press series on computational intelligence.

[10]  Yong Wang.  A New Approach to Fitting Linear Models in High Dimensional Spaces , 2000 .

[11]  Ian H. Witten,et al.  Data mining: practical machine learning tools and techniques with Java implementations , 2002, SGMD.

[12]  William W. Cohen.  Fast Effective Rule Induction , 1995, ICML.

[13]  Nan-Chen Hsieh.  Rule Extraction with Rough-Fuzzy Hybridization Method , 2008, PAKDD.

[14]  Catherine Blake,et al.  UCI Repository of machine learning databases , 1998 .

[15]  Richard O. Duda,et al.  Pattern classification and scene analysis , 1974, A Wiley-Interscience publication.

[16]  C. Cornelis,et al.  Vaguely Quantified Rough Sets , 2009, RSFDGrC.

[17]  Manish Sarkar,et al.  Fuzzy-rough nearest neighbors algorithm , 2000, Smc 2000 conference proceedings. 2000 ieee international conference on systems, man and cybernetics. 'cybernetics evolving to systems, humans, organizations, and their complex interactions' (cat. no.0.

[18]  Masahiro Inuiguchi,et al.  Fuzzy rough sets and multiple-premise gradual decision rules , 2006, Int. J. Approx. Reason..

[19]  Chris Cornelis,et al.  Fuzzy Rough Sets: from Theory into Practice , 2008, GrC 2008.

[20]  James M. Keller,et al.  A fuzzy K-nearest neighbor algorithm , 1985, IEEE Transactions on Systems, Man, and Cybernetics.

[21]  Elizabeth A. Peck,et al.  Introduction to Linear Regression Analysis , 2001 .

[22]  Qiang Shen,et al.  Fuzzy-Rough Sets Assisted Attribute Selection , 2007, IEEE Transactions on Fuzzy Systems.

[23]  David W. Aha,et al.  Instance-Based Learning Algorithms , 1991, Machine Learning.

[24]  Alberto Maria Segre,et al.  Programs for Machine Learning , 1994 .

[25]  Anna Maria Radzikowska,et al.  A comparative study of fuzzy rough sets , 2002, Fuzzy Sets Syst..

[26]  Janusz Zalewski,et al.  Rough sets: Theoretical aspects of reasoning about data , 1996 .

[27]  Bernhard Schölkopf,et al.  A tutorial on support vector regression , 2004, Stat. Comput..

[28]  Qiang Shen,et al.  A rough-fuzzy approach for generating classification rules , 2002, Pattern Recognit..

[29]  A. L. Edwards,et al.  An introduction to linear regression and correlation. , 1985 .

[30]  Rajen B. Bhatt,et al.  FRID: fuzzy-rough interactive dichotomizers , 2004, 2004 IEEE International Conference on Fuzzy Systems (IEEE Cat. No.04CH37542).

[31]  Ian H. Witten,et al.  Generating Accurate Rule Sets Without Global Optimization , 1998, ICML.

[32]  H. Bian,et al.  Fuzzy-rough nearest-neighbor classification approach , 2003, 22nd International Conference of the North American Fuzzy Information Processing Society, NAFIPS 2003.

[33]  John C. Platt,et al.  Fast training of support vector machines using sequential minimal optimization, advances in kernel methods , 1999 .

[34]  Tzung-Pei Hong,et al.  Learning with Hierarchical Quantitative Attributes by Fuzzy Rough Sets , 2006, JCIS.

[35]  Manish Sarkar,et al.  Fuzzy-rough nearest neighbor algorithms in classification , 2007, Fuzzy Sets Syst..