Captured multi-label relations via joint deep supervised autoencoder

Abstract The mapping relations learning between instances and multiple labels should reflect the underlying joint probability distribution following by the data sets. The general solution of such problem is to assume that the samples are subject to a certain distribution, i.e. normal distribution, but this hypothesis cannot excavate the real underlying mapping relations hidden in the data sets. Meanwhile, it is not advisable to suppose that multiple labels are independent of each other. Therefore, we propose the deep supervised autoencoder as a generative model to learn the posterior conditional probability rather than assigning the specific distribution in advance. In this way, we propose the different joint augmented matrices of training instances X i and corresponding label sets Y i under the three multi-label relations assumptions as the inputs to learn the posterior probability distribution. Finally, the experiments under model assumptions are conducted on six data sets, and we also set different noise levels to verify whether the optimal hypothesis has the ability to handle the corrupted labels. Experiments on images, biology and music real-world data sets show that our method outperforms most of state-of-the-art multi-label classifiers.