Multi-label learning method based on ML-RBF and laplacian ELM

Abstract Multi-label data widely exist in the real world, and the multi-label learning deals with the problem in which samples contain many labels. The main task of the multi-label learning is to train a model which adapts to the multi-label data such that the label of unknown label data can be predicted. Multi-label radial basis function neural network (ML-RBF) is an effective multi-label learning model, which combines K-means clustering and RBF neural network. The laplacian extreme learning machine (Lap-ELM) improved the traditional ELM by considering the structural relationship between low-dimension data and high-dimension data. As a kind of single-hidden layer feed-forward neural network (SLFN), ELM has the characteristics of fast training and good generalization ability compared to RBF. Affinity Propagation (AP) clustering algorithm can automatically determine the number of clusters. In this paper, a novel multi-label learning method named ML-AP-RBF-Lap-ELM is proposed which integrates AP clustering algorithm, ML-RBF and Lap-ELM. In this new model, the ML-RBF is used to map in the input layer. The number of hidden nodes and the center of the RBF function can be automatically determined by the AP clustering algorithm. The weights from the hidden layer to the output layer are solved by Lap-ELM. The simulation results show that ML-AP-RBF-Lap-ELM performs well on the three common data sets, including Natural Scene, Yeast Gene and 20NG (20 New Groups).

[1]  Chee Kheong Siew,et al.  Extreme learning machine: Theory and applications , 2006, Neurocomputing.

[2]  Parag Kulkarni,et al.  Analysis of semi supervised learning methods towards multi label text classification , 2012 .

[3]  Zhi-Hua Zhou,et al.  Multilabel Neural Networks with Applications to Functional Genomics and Text Categorization , 2006, IEEE Transactions on Knowledge and Data Engineering.

[4]  Grigorios Tsoumakas,et al.  Multi-Label Classification: An Overview , 2007, Int. J. Data Warehous. Min..

[5]  Zhi-Hua Zhou,et al.  ML-KNN: A lazy learning approach to multi-label learning , 2007, Pattern Recognit..

[6]  Mohammed J. Zaki,et al.  Multi-label Lazy Associative Classification , 2007, PKDD.

[7]  Min-Ling Zhang,et al.  Ml-rbf: RBF Neural Networks for Multi-Label Learning , 2009, Neural Processing Letters.

[8]  Zhi-Hua Zhou,et al.  Ensemble approach based on conditional random field for multi-label image and video annotation , 2011, ACM Multimedia.

[9]  Deng Wan Research on Extreme Learning of Neural Networks , 2010 .

[10]  Delbert Dueck,et al.  Clustering by Passing Messages Between Data Points , 2007, Science.

[11]  Jason Weston,et al.  A kernel method for multi-labelled classification , 2001, NIPS.

[12]  Peter I. Cowling,et al.  MMAC: a new multi-class, multi-label associative classification approach , 2004, Fourth IEEE International Conference on Data Mining (ICDM'04).

[13]  Canlong Zhang,et al.  A New multi-instance multi-label learning approach for image and text classification , 2016, Multimedia Tools and Applications.

[14]  Shifei Ding,et al.  Extreme learning machine and its applications , 2013, Neural Computing and Applications.

[15]  Cheng Wu,et al.  Semi-Supervised and Unsupervised Extreme Learning Machines , 2014, IEEE Transactions on Cybernetics.

[16]  Jiebo Luo,et al.  Learning multi-label scene classification , 2004, Pattern Recognit..

[17]  Chee Kheong Siew,et al.  Extreme learning machine: RBF network case , 2004, ICARCV 2004 8th Control, Automation, Robotics and Vision Conference, 2004..

[18]  Hong Zhu,et al.  Optimizing radial basis function neural network based on rough sets and affinity propagation clustering algorithm , 2012, Journal of Zhejiang University SCIENCE C.

[19]  Yoram Singer,et al.  BoosTexter: A Boosting-based System for Text Categorization , 2000, Machine Learning.

[20]  Grigorios Tsoumakas,et al.  Random K-labelsets for Multilabel Classification , 2022 .

[21]  Shifei Ding,et al.  Multi layer ELM-RBF for multi-label learning , 2016, Appl. Soft Comput..

[22]  Cao Su-qun Gene function analysis of semi-supervised multi-label learning , 2008 .

[23]  Yihong Gong,et al.  Multi-labelled classification using maximum entropy method , 2005, SIGIR '05.

[24]  Naonori Ueda,et al.  Parametric Mixture Models for Multi-Labeled Text , 2002, NIPS.

[25]  Tao Mei,et al.  Correlative multi-label video annotation , 2007, ACM Multimedia.

[26]  Geoff Holmes,et al.  Classifier chains for multi-label classification , 2009, Machine Learning.

[27]  Guang-Bin Huang,et al.  An Insight into Extreme Learning Machines: Random Neurons, Random Features and Kernels , 2014, Cognitive Computation.

[28]  Guang-Bin Huang,et al.  Extreme learning machine: a new learning scheme of feedforward neural networks , 2004, 2004 IEEE International Joint Conference on Neural Networks (IEEE Cat. No.04CH37541).