Conditionally Decorrelated Multi-Target Regression

Multi-target regression (MTR) has attracted an increasing amount of attention in recent years. The main challenge in multi-target regression is to create predictive models for problems with multiple continuous targets by considering the inter-target correlation which can greatly influence the predictive performance. There is another thing that most of existing methods omit, the impact of inputs in target correlations (conditional target correlation). In this paper, a novel MTR framework, termed as Conditionally Decorrelated Multi-Target Regression (CDMTR) is proposed. CDMTR learns from the MTR data following three elementary steps: clustering analysis, conditional target decorrelation and multi-target regression models induction. Experimental results on various benchmark MTR data sets approved that the proposed method enjoys significant advantages compared to other state-of-the art MTR methods.

[1]  Vojislav Kecman,et al.  Multi-target support vector regression via correlation regressor chains , 2017, Inf. Sci..

[2]  Saso Dzeroski,et al.  Tree ensembles for predicting structured outputs , 2013, Pattern Recognit..

[3]  Janez Demsar,et al.  Statistical Comparisons of Classifiers over Multiple Data Sets , 2006, J. Mach. Learn. Res..

[4]  A. Izenman.  Reduced-rank regression for the multivariate linear model , 1975 .

[5]  S. Džeroski,et al.  Using single- and multi-target regression trees and ensembles to model a compound index of vegetation condition , 2009 .

[6]  Bernhard Schölkopf,et al.  Learning to Find Pre-Images , 2003, NIPS.

[7]  Sebastián Ventura,et al.  A Tutorial on Multilabel Learning , 2015, ACM Comput. Surv..

[8]  Saso Dzeroski,et al.  Feature Ranking for Multi-target Regression with Tree Ensemble Methods , 2017, DS.

[9]  Xiaofei He,et al.  Multi-Target Regression via Robust Low-Rank Learning , 2018, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Concha Bielza,et al.  A survey on multi‐output regression , 2015, WIREs Data Mining Knowl. Discov..

[11]  Sebastián Ventura,et al.  An evolutionary algorithm for optimizing the target ordering in Ensemble of Regressor Chains , 2017, 2017 IEEE Congress on Evolutionary Computation (CEC).

[12]  P. Rousseeuw.  Silhouettes: a graphical aid to the interpretation and validation of cluster analysis , 1987 .

[13]  Wei Zhang,et al.  Multi-output LS-SVR machine in extended feature space , 2012, 2012 IEEE International Conference on Computational Intelligence for Measurement Systems and Applications (CIMSA) Proceedings.

[14]  Grigorios Tsoumakas,et al.  Multi-target regression via input space expansion: treating targets as inputs , 2012, Machine Learning.

[15]  Grigorios Tsoumakas,et al.  Multi-target Regression via Random Linear Target Combinations , 2014, ECML/PKDD.

[16]  Luis Alonso,et al.  Multioutput Support Vector Regression for Remote Sensing Biophysical Parameter Estimation , 2011, IEEE Geoscience and Remote Sensing Letters.

[17]  Grigorios Tsoumakas,et al.  MULAN: A Java Library for Multi-Label Learning , 2011, J. Mach. Learn. Res..

[18]  Guo-Zheng Li,et al.  A novel multi-target regression framework for time-series prediction of drug efficacy , 2017, Scientific Reports.