Feature relevance bounds for ordinal regression

The increasing occurrence of ordinal data, mainly sociodemographic, led to a renewed research interest in ordinal regression, i.e. the prediction of ordered classes. Besides model accuracy, the interpretation of these models itself is of high relevance, and existing approaches therefore enforce e.g. model sparsity. For high dimensional or highly correlated data, however, this might be misleading due to strong variable dependencies. In this contribution, we aim for an identification of feature relevance bounds which - besides identifying all relevant features - explicitly differentiates between strongly and weakly relevant features.

[1]  Tao Qin,et al.  Feature selection for ranking , 2007, SIGIR.

[2]  Walter Zucchini,et al.  Model Selection , 2011, International Encyclopedia of Statistical Science.

[3]  F. Maxwell Harper,et al.  The MovieLens Datasets: History and Context , 2016, TIIS.

[4]  Amnon Shashua,et al.  Ranking with Large Margin Principle: Two Approaches , 2002, NIPS.

[5]  Andrea Esuli,et al.  Feature selection for ordinal regression , 2010, SAC '10.

[6]  Barbara Hammer,et al.  Interpretation of linear classifiers by means of feature relevance bounds , 2018, Neurocomputing.

[7]  Eibe Frank,et al.  A Simple Approach to Ordinal Classification , 2001, ECML.

[8]  Pedro Antonio Gutiérrez,et al.  Exploitation of Pairwise Class Distances for Ordinal Classification , 2013, Neural Computation.

[9]  R. Tibshirani Regression Shrinkage and Selection via the Lasso , 1996 .

[10]  Witold R. Rudnicki,et al.  Feature Selection with the Boruta Package , 2010 .

[11]  H. Zou,et al.  Regularization and variable selection via the elastic net , 2005 .

[12]  Wei Chu,et al.  Support Vector Ordinal Regression , 2007, Neural Computation.

[13]  Peter Tiño,et al.  Adaptive Metric Learning Vector Quantization for Ordinal Classification , 2012, Neural Computation.

[14]  Peng Zhao,et al.  On Model Selection Consistency of Lasso , 2006, J. Mach. Learn. Res..

[15]  Fengzhen Tang,et al.  Ordinal regression based on learning vector quantization , 2017, Neural Networks.

[16]  Shivani Agarwal Generalization Bounds for Some Ordinal Regression Algorithms , 2008, ALT.

[17]  Tong Zhang,et al.  Covering Number Bounds of Certain Regularized Linear Function Classes , 2002, J. Mach. Learn. Res..

[18]  Gérard Dreyfus,et al.  Ranking a Random Feature for Variable and Feature Selection , 2003, J. Mach. Learn. Res..