Multiobjective Fuzzy Genetics-Based Machine Learning for Multi-Label Classification

In multi-label classification problems, multiple class labels are assigned to each instance. Two approaches have been studied in the literature. One is a data transformation approach, which transforms a multi-label dataset into a number of singlelabel datasets. However, this approach often loses the correlation information among classes in the multi-class assignment. The other is a method adaptation approach where a conventional classification method is extended to multi-label classification. Recently, some explainable classification models for multi-label classification have been proposed. Their high interpretability has also been discussed with respect to the transparency of the classification process. Although the explainability is a well-known advantage of fuzzy systems, their applications to multi-label classification have not been well studied. Since multi-label classification problems often have vague class boundaries, fuzzy systems seem to be a promising approach to multi-label classification. In this paper, we propose a new multiobjective evolutionary fuzzy system, which can be categorized as a method adaptation approach. The proposed algorithm produces nondominated classifiers with different tradeoffs between accuracy and complexity. We examine the behavior of the proposed algorithm using synthetic multi-label datasets. We also compare the proposed algorithm with five representative algorithms. Our experimental results on real-world datasets show that the obtained fuzzy classifiers with a small number of fuzzy rules have high transparency and comparable generalization ability to the other examined multi-label classification algorithms.

[1]  Piotr Synak,et al.  Multi-Label Classification of Emotions in Music , 2006, Intelligent Information Systems.

[2]  Yi Yang,et al.  Weakly Supervised Multilabel Clustering and its Applications in Computer Vision , 2016, IEEE Transactions on Cybernetics.

[3]  Anna Monreale,et al.  Explaining Multi-label Black-Box Classifiers for Health Applications , 2019, Precision Health and Medicine.

[4]  Alberto Maria Segre,et al.  Programs for Machine Learning , 1994 .

[5]  Ronaldo C. Prati,et al.  Fuzzy rule classifiers for multi-label classification , 2015, 2015 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE).

[6]  Eneldo Loza Mencía,et al.  Efficient Discovery of Expressive Multi-label Rules using Relaxed Pruning , 2019, DS.

[7]  Francisco Charte,et al.  A first approach towards a fuzzy decision tree for multilabel classification , 2017, 2017 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE).

[8]  G MohanaPrabha,et al.  Design and development of an efficient hierarchical approach for multi-label protein function prediction , 2017 .

[9]  Francisco Herrera,et al.  A Review of the Application of Multiobjective Evolutionary Fuzzy Systems: Current Status and Further Directions , 2013, IEEE Transactions on Fuzzy Systems.

[10]  Amanda Clare,et al.  Knowledge Discovery in Multi-label Phenotype Data , 2001, PKDD.

[11]  Hisao Ishibuchi,et al.  Multiobjective Genetic Fuzzy Systems , 2015, Handbook of Computational Intelligence.

[12]  Grigorios Tsoumakas,et al.  MULAN: A Java Library for Multi-Label Learning , 2011, J. Mach. Learn. Res..

[13]  Abdollah Homaifar,et al.  Multi-label Classification Using Genetic-Based Machine Learning , 2018, 2018 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[14]  Kalyanmoy Deb,et al.  A fast and elitist multiobjective genetic algorithm: NSGA-II , 2002, IEEE Trans. Evol. Comput..

[15]  María José del Jesús,et al.  Evolutionary Fuzzy Systems for Explainable Artificial Intelligence: Why, When, What for, and Where to? , 2019, IEEE Computational Intelligence Magazine.

[16]  Hisao Ishibuchi,et al.  Analysis of interpretability-accuracy tradeoff of fuzzy systems by multiobjective fuzzy genetics-based machine learning , 2007, Int. J. Approx. Reason..

[17]  M. Kumarasamy,et al.  Design and development of an efficient hierarchical approach for multi-label protein function prediction , 2017 .

[18]  I. Hatono,et al.  Fuzzy decision trees by fuzzy ID3 algorithm and its application to diagnosis systems , 1994, Proceedings of 1994 IEEE 3rd International Fuzzy Systems Conference.

[19]  Fernando de la Prieta,et al.  A model for multi-label classification and ranking of learning objects , 2012, Expert Syst. Appl..

[20]  Grigorios Tsoumakas,et al.  Evaluating Feature Selection Methods for Multi-Label Text Classication , 2013, BioASQ@CLEF.

[21]  萩原 将文 「Classification and Modeling with Linguistic Information Granules: Advanced Approach to Linguistic Data Mining」 , 2006 .