An extended numerical analysis of an intuitionistic fuzzy classifier for imbalanced classes

Recognizing relatively smaller classes (called imbalanced classes) from data is an important task both from a theoretical and practical points of view. In many real world problems smaller classes are usually more interesting from the user point of view but they are more difficult to obtain by a classifier. This paper, which is a continuation of our previous works, discusses a classifier that is based on Atanassovs intuitionistic fuzzy sets (A-IFSs, for short) and shows that it can be a good tool for recognizing imbalanced classes. Our considerations are illustrated on benchmark examples. Special attention is paid to a detailed behavior of the classifier proposed (different measures besides the general accuracy are examined). A simple cross validation method is applied (with 10 experiments). Results are compared with a fuzzy classifier reported to be good in the literature. Also the influence of the type granulation, symmetrical or asymmetrical, and of the number of intervals is considered.

[1]  Janusz Kacprzyk,et al.  A New Similarity Measure for Intuitionistic Fuzzy Sets: Straightforward Approaches may not work , 2007, 2007 IEEE International Fuzzy Systems Conference.

[2]  D. Dubois,et al.  Unfair coins and necessity measures: Towards a possibilistic interpretation of histograms , 1983 .

[3]  K. Yamada.  Probability-possibility transformation based on evidence theory , 2001, Proceedings Joint 9th IFSA World Congress and 20th NAFIPS International Conference (Cat. No. 01TH8569).

[4]  Eulalia Szmidt,et al.  Intuitionistic Fuzzy Set Functions, Mass Assignment Theory, Possibility Theory and Histograms , 2006, 2006 IEEE International Conference on Fuzzy Systems.

[5]  James F. Baldwin,et al.  Combining evidences for evidential reasoning , 1991, Int. J. Intell. Syst..

[6]  Robert C. Holte,et al.  C4.5, Class Imbalance, and Cost Sensitivity: Why Under-Sampling beats Over-Sampling , 2003 .

[7]  James F. Baldwin,et al.  Intelligent reasoning using general knowledge to update specific information: A database approach , 1995, Journal of Intelligent Information Systems.

[8]  Eulalia Szmidt,et al.  Atanassov's Intuitionistic Fuzzy Sets in Classification of Imbalanced and Overlapping Classes , 2008, Intelligent Techniques and Tools for Novel System Architectures.

[9]  H. B. V. M. E. B. M. Pagola.  An Algorithm for Calculating the Threshold of an Image Representing Uncertainty through A-IFSs , 2006 .

[10]  J. Kacprzyk,et al.  Distances Between Intuitionistic Fuzzy Sets: Straightforward Approaches may not work , 2006, 2006 3rd International IEEE Conference Intelligent Systems.

[11]  Krassimir T. Atanassov,et al.  On Intuitionistic Fuzzy Sets Theory , 2012, Studies in Fuzziness and Soft Computing.

[12]  Janusz Kacprzyk,et al.  Entropy for intuitionistic fuzzy sets , 2001, Fuzzy Sets Syst..

[13]  Hsiao-Fan Wang.  Intelligent Data Analysis: Developing New Methodologies Through Pattern Discovery and Recovery , 2008 .

[14]  J. Baldwin,et al.  Entropy for Intuitionistic Fuzzy, Set Theory and Mass Assignment Theory , 2004 .

[15]  Chris. Drummond,et al.  C 4 . 5 , Class Imbalance , and Cost Sensitivity : Why Under-Sampling beats OverSampling , 2003 .

[16]  J. Kacprzyk,et al.  An intuitionistic fuzzy set based approach to intelligent data analysis: an application to medical diagnosis , 2003 .

[17]  E. Szmidt,et al.  Classification of Imbalanced and Overlapping Classes using Intuitionistic Fuzzy Sets , 2006, 2006 3rd International IEEE Conference Intelligent Systems.

[18]  Janusz Kacprzyk,et al.  A New Concept of a Similarity Measure for Intuitionistic Fuzzy Sets and Its Use in Group Decision Making , 2005, MDAI.

[19]  David Mease,et al.  Boosted Classification Trees and Class Probability/Quantile Estimation , 2007, J. Mach. Learn. Res..

[20]  Tom Fawcett,et al.  Adaptive Fraud Detection , 1997, Data Mining and Knowledge Discovery.

[21]  Krassimir T. Atanassov,et al.  Intuitionistic Fuzzy Sets - Theory and Applications , 1999, Studies in Fuzziness and Soft Computing.

[22]  Krassimir T. Atanassov,et al.  Intuitionistic fuzzy sets , 1986 .

[23]  Jonathan Lawry,et al.  The Application of Generalised Fuzzy Rules to Machine Learning and Automated Knowledge Discovery , 1998, Int. J. Uncertain. Fuzziness Knowl. Based Syst..

[24]  Jonathan Lawry,et al.  A mass assignment theory of the probability of fuzzy events , 1996, Fuzzy Sets Syst..

[25]  Didier Dubois,et al.  The three semantics of fuzzy sets , 1997, Fuzzy Sets Syst..

[26]  Janusz Kacprzyk,et al.  Distances between intuitionistic fuzzy sets , 2000, Fuzzy Sets Syst..

[27]  L. Zadeh.  Fuzzy sets as a basis for a theory of possibility , 1999 .

[28]  J. Park,et al.  New similarity measure for Intuitionistic Fuzzy Sets , 2015 .

[29]  Eulalia Szmidt,et al.  Assigning the parameters for intuitionistic fuzzy sets , 2005 .

[30]  Janusz Kacprzyk,et al.  Some Problems with Entropy Measures for the Atanassov Intuitionistic Fuzzy Sets , 2007, WILF.

[31]  David D. Lewis,et al.  Heterogeneous Uncertainty Sampling for Supervised Learning , 1994, ICML.

[32]  Haibo He,et al.  Learning from Imbalanced Data , 2009, IEEE Transactions on Knowledge and Data Engineering.

[33]  Robert C. Holte,et al.  Concept Learning and the Problem of Small Disjuncts , 1989, IJCAI.

[34]  Eulalia Szmidt,et al.  A New Approach to Classification of Imbalanced Classes via Atanassov's Intuitionistic Fuzzy Sets , 2009 .

[35]  Dunja Mladenic,et al.  Feature Selection for Unbalanced Class Distribution and Naive Bayes , 1999, ICML.

[36]  Stan Matwin,et al.  Machine Learning for the Detection of Oil Spills in Satellite Radar Images , 1998, Machine Learning.

[37]  Nikola Kasabov.  Fril—fuzzy and evidential reasoning in artificial intelligence , 1996 .