Dynamic Multi-label Learning with Multiple New Labels

In a traditional multi-label learning task, an instance or object often has multiple labels. Previous works assume that the class labels are always fixed, i.e, the class labels in the test set are the same as that in the training set. Different from previous methods, we study a new problem setting where multiple new labels emerge in a dynamic environment. In this paper, we decompose the multiple labels pool to adjust the dynamic environment. The proposed method has several functions: classify instances on currently known labels, detect the emergence of several new labels then separate them using clustering, and construct a new classifier for each new label that works collaboratively with the classifier for known labels. Experimental results on publicly available data sets demonstrate that our method achieves superior performance, compared with the state-of-the-arts.

[1]  Geoff Holmes,et al.  Batch-Incremental versus Instance-Incremental Learning in Dynamic and Evolving Data , 2012, IDA.

[2]  Congyan Lang,et al.  A Self-Paced Regularization Framework for Partial-Label Learning , 2016, IEEE Transactions on Cybernetics.

[3]  Jieping Ye,et al.  Drosophila Gene Expression Pattern Annotation through Multi-Instance Multi-Label Learning , 2009, IEEE/ACM Transactions on Computational Biology and Bioinformatics.

[4]  Zhi-Hua Zhou,et al.  Multi-instance multi-label learning , 2008, Artif. Intell..

[5]  Chin-Hui Lee,et al.  A MFoM learning approach to robust multiclass multi-label text categorization , 2004, ICML.

[6]  Qingshan Liu,et al.  A Self-Paced Regularization Framework for Multilabel Learning , 2016, IEEE Transactions on Neural Networks and Learning Systems.

[7]  Geoff Holmes,et al.  Classifier chains for multi-label classification , 2009, Machine Learning.

[8]  Eyke Hüllermeier,et al.  Multilabel classification via calibrated label ranking , 2008, Machine Learning.

[9]  Changsheng Li,et al.  Learning ordinal discriminative features for age estimation , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[10]  Stefan Kramer,et al.  Online multi-label dependency topic models for text classification , 2018, Machine Learning.

[11]  Nam Nguyen,et al.  A New SVM Approach to Multi-instance Multi-label Learning , 2010, 2010 IEEE International Conference on Data Mining.

[12]  Mingxuan Sun,et al.  A Deep Multi-Modal CNN for Multi-Instance Multi-Label Image Classification , 2018, IEEE Transactions on Image Processing.

[13]  Zhi-Hua Zhou,et al.  Multi-Label Learning with Emerging New Labels , 2018, IEEE Transactions on Knowledge and Data Engineering.

[14]  Jesse Read,et al.  Multi-label Classification with Meta-Labels , 2014, 2014 IEEE International Conference on Data Mining.

[15]  Qingshan Liu,et al.  Dynamic Structure Embedded Online Multiple-Output Regression for Streaming Data , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Hans-Peter Kriegel,et al.  A Density-Based Algorithm for Discovering Clusters in Large Spatial Databases with Noise , 1996, KDD.

[17]  Xin Geng,et al.  Binary relevance for multi-label learning: an overview , 2018, Frontiers of Computer Science.

[18]  Zhi-Hua Zhou,et al.  Isolation Forest , 2008, 2008 Eighth IEEE International Conference on Data Mining.

[19]  Jiebo Luo,et al.  Learning multi-label scene classification , 2004, Pattern Recognit..

[20]  Changsheng Li,et al.  Self-Paced Multi-Task Learning , 2016, AAAI.

[21]  Stefan Rüping,et al.  Incremental Learning with Support Vector Machines , 2001, ICDM.

[22]  Zhi-Hua Zhou,et al.  Multi-Instance Multi-Label Learning with Application to Scene Classification , 2006, NIPS.

[23]  Changsheng Li,et al.  Ordinal Distance Metric Learning for Image Ranking , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[24]  Min-Ling Zhang,et al.  A Review on Multi-Label Learning Algorithms , 2014, IEEE Transactions on Knowledge and Data Engineering.

[25]  Xin Xu,et al.  A Class-Incremental Learning Method for Multi-Class Support Vector Machines in Text Classification , 2006, 2006 International Conference on Machine Learning and Cybernetics.

[26]  Changsheng Li,et al.  Human Age Estimation Based on Locality and Ordinal Information , 2015, IEEE Transactions on Cybernetics.