A comparative study of fuzzy PSO and fuzzy SVD-based RBF neural network for multi-label classification

In multi-label classification problems, every instance is associated with multiple labels at the same time. Binary classification, multi-class classification and ordinal regression problems can be seen as unique cases of multi-label classification where each instance is assigned only one label. Text classification is the main application area of multi-label classification techniques. However, relevant works are found in areas like bioinformatics, medical diagnosis, scene classification and music categorization. There are two approaches to do multi-label classification: The first is an algorithm-independent approach or problem transformation in which multi-label problem is dealt by transforming the original problem into a set of single-label problems, and the second approach is algorithm adaptation, where specific algorithms have been proposed to solve multi-label classification problem. Through our work, we not only investigate various research works that have been conducted under algorithm adaptation for multi-label classification but also perform comparative study of two proposed algorithms. The first proposed algorithm is named as fuzzy PSO-based ML-RBF, which is the hybridization of fuzzy PSO and ML-RBF. The second proposed algorithm is named as FSVD-MLRBF that hybridizes fuzzy c-means clustering along with singular value decomposition. Both the proposed algorithms are applied to real-world datasets, i.e., yeast and scene dataset. The experimental results show that both the proposed algorithms meet or beat ML-RBF and ML-KNN when applied on the test datasets.

[1]  Elena P. Sapozhnikova,et al.  ART-Based Neural Networks for Multi-label Classification , 2009, IDA.

[2]  Zhi-Hua Zhou,et al.  ML-KNN: A lazy learning approach to multi-label learning , 2007, Pattern Recognit..

[3]  Sunita Sarawagi,et al.  Discriminative Methods for Multi-labeled Classification , 2004, PAKDD.

[4]  Naonori Ueda,et al.  Single-shot detection of multiple categories of text using parametric mixture models , 2002, KDD.

[5]  Jason Weston,et al.  A kernel method for multi-labelled classification , 2001, NIPS.

[6]  Elias Oliveira,et al.  Multi-Label Text Categorization Using a Probabilistic Neural Network , 2009 .

[7]  Vikas Agrawal,et al.  Statistical Sampling to Instantiate Materialized View Selection Problems in Data Warehouses , 2007, Int. J. Data Warehous. Min..

[8]  Xi Liu,et al.  Voting conditional random fields for multi-label image classification , 2010, 2010 3rd International Congress on Image and Signal Processing.

[9]  Xiaoyan Zhu,et al.  A Generative Probabilistic Model for Multi-label Classification , 2008, 2008 Eighth IEEE International Conference on Data Mining.

[10]  Lipo Wang,et al.  Improved Multilabel Classification with Neural Networks , 2008, PPSN.

[11]  Zhi-Hua Zhou,et al.  Multilabel Neural Networks with Applications to Functional Genomics and Text Categorization , 2006, IEEE Transactions on Knowledge and Data Engineering.

[12]  Jesse Read,et al.  A Pruned Problem Transformation Method for Multi-label Classification , 2008 .

[13]  Jianhua Xu,et al.  An efficient multi-label support vector machine with a zero label , 2012, Expert Syst. Appl..

[14]  S. V. N. Vishwanathan,et al.  Efficient max-margin multi-label classification with applications to zero-shot learning , 2012, Machine Learning.

[15]  Grigorios Tsoumakas,et al.  An Empirical Study of Lazy Multilabel Classification Algorithms , 2008, SETN.

[16]  Min-Ling Zhang,et al.  Ml-rbf: RBF Neural Networks for Multi-Label Learning , 2009, Neural Processing Letters.

[17]  Eyke Hüllermeier,et al.  Multilabel classification via calibrated label ranking , 2008, Machine Learning.

[18]  Grigorios Tsoumakas,et al.  Multi-Label Classification: An Overview , 2007, Int. J. Data Warehous. Min..

[19]  Grigorios Tsoumakas,et al.  Random k -Labelsets: An Ensemble Method for Multilabel Classification , 2007, ECML.

[20]  Fernando Benites,et al.  Multi-label classification by ART-based neural networks and hierarchy extraction , 2010, The 2010 International Joint Conference on Neural Networks (IJCNN).

[21]  Alberto Ferreira de Souza,et al.  Automated multi-label text categorization with VG-RAM weightless neural networks , 2009, Neurocomputing.

[22]  Yu-ping Qin,et al.  Study on Multi-label Text Classification Based on SVM , 2009, 2009 Sixth International Conference on Fuzzy Systems and Knowledge Discovery.

[23]  Andrew McCallum,et al.  Collective multi-label classification , 2005, CIKM '05.

[24]  Zheru Chi,et al.  Multi-instance multi-label image classification: A neural approach , 2013, Neurocomputing.

[25]  Víctor Robles,et al.  Feature selection for multi-label naive Bayes classification , 2009, Inf. Sci..

[26]  Yoram Singer,et al.  BoosTexter: A Boosting-based System for Text Categorization , 2000, Machine Learning.

[27]  Ahmed Ali Abdalla Esmin,et al.  A Hybrid Particle Swarm Optimization Applied for Multi-Label Classification Problem , 2016 .

[28]  Wen Li,et al.  A Naive Bayesian Multi-label Classication Algorithm With Application to Visualize Text Search Results , 2011 .

[29]  Eyke Hüllermeier,et al.  Label ranking by learning pairwise preferences , 2008, Artif. Intell..

[30]  Hui Xiong,et al.  Capturing correlations of multiple labels: A generative probabilistic model for multi-label learning , 2012, Neurocomputing.