Discrete Binary Coding based Label Distribution Learning

Label Distribution Learning (LDL) is a general learning paradigm in machine learning, which includes both single-label learning (SLL) and multilabel learning (MLL) as its special cases. Recently, many LDL algorithms have been proposed to handle different application tasks such as facial age estimation, head pose estimation and visual sentiment distributions prediction. However, the training time complexity of most existing LDL algorithms is too high, which makes them unapplicable to large-scale LDL. In this paper, we propose a novel LDL method to address this issue, termed Discrete Binary Coding based Label Distribution Learning (DBC-LDL). Specifically, we design an efficiently discrete coding framework to learn binary codes for instances. Furthermore, both the pair-wise semantic similarities and the original label distributions are integrated into this framework to learn highly discriminative binary codes. In addition, a fast approximate nearest neighbor (ANN) search strategy is utilized to predict label distributions for testing instances. Experimental results on five real-world datasets demonstrate its superior performance over several state-of-the-art LDL methods with the lower time cost.

[1]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[2]  Naveen Kumar,et al.  Sentence Emotion Analysis and Recognition Based on Emotion Words Using Ren-CECps ∗ , 2010 .

[3]  Zhi-Hua Zhou,et al.  Facial Age Estimation by Learning from Label Distributions , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Alan F. Smeaton,et al.  Proceedings of the 23rd ACM international conference on Multimedia , 2015, MM 2015.

[5]  Jianxin Wu,et al.  Deep Label Distribution Learning With Label Ambiguity , 2016, IEEE Transactions on Image Processing.

[6]  Mary Ellen Zurko,et al.  Proceedings of the 10th international conference on World Wide Web , 2001, WWW 2001.

[7]  Xin Geng,et al.  Logistic Boosting Regression for Label Distribution Learning , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[8]  Liqiang Nie,et al.  Fast Scalable Supervised Hashing , 2018, SIGIR.

[9]  Wei Liu,et al.  Discrete Graph Hashing , 2014, NIPS.

[10]  Xin-Shun Xu,et al.  Scalable Supervised Discrete Hashing for Large-Scale Search , 2018, WWW.

[11]  Wu-Jun Li,et al.  Deep Discrete Supervised Hashing , 2017, IEEE Transactions on Image Processing.

[12]  Xin Geng,et al.  Label Distribution Learning , 2013, 2013 IEEE 13th International Conference on Data Mining Workshops.

[13]  Ke Wang,et al.  Binary Coding based Label Distribution Learning , 2018, IJCAI.

[14]  H. Damasio,et al.  IEEE Transactions on Pattern Analysis and Machine Intelligence: Special Issue on Perceptual Organization in Computer Vision , 1998 .

[15]  Zhi-Hua Zhou,et al.  Column Sampling Based Discrete Supervised Hashing , 2016, AAAI.

[16]  Bingbing Ni,et al.  Sense beauty via face, dressing, and/or voice , 2012, ACM Multimedia.

[17]  Yi Ren,et al.  Sense Beauty by Label Distribution Learning , 2017, IJCAI.

[18]  IEEE Transactions on Knowledge and Data Engineering, Vol. 14 , 2002 .

[19]  Kai Zhao,et al.  Label Distribution Learning Forests , 2017, NIPS.

[20]  Michael I. Jordan,et al.  Advances in Neural Information Processing Systems 30 , 1995 .

[21]  Antonio Torralba,et al.  Spectral Hashing , 2008, NIPS.

[22]  Yilong Yin,et al.  Supervised Discrete Hashing With Mutual Linear Regression , 2019, ACM Multimedia.

[23]  Tieniu Tan,et al.  Deep Supervised Discrete Hashing , 2017, NIPS.

[24]  Xin Geng,et al.  Pre-release Prediction of Crowd Opinion on Movies by Label Distribution Learning , 2015, IJCAI.

[25]  Zhenan Sun,et al.  Fast Supervised Discrete Hashing , 2018, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[26]  Wei Liu,et al.  Hashing with Graphs , 2011, ICML.