Ordinal regression based on learning vector quantization

Recently, ordinal regression, which predicts categories of ordinal scale, has received considerable attention. In this paper, we propose a new approach to solve ordinal regression problems within the learning vector quantization framework. It extends the previous approach termed ordinal generalized matrix learning vector quantization with a more suitable and natural cost function, leading to more intuitive parameter update rules. Moreover, in our approach the bandwidth of the prototype weights is automatically adapted. Empirical investigation on a number of datasets reveals that overall the proposed approach tends to have superior out-of-sample performance, when compared to alternative ordinal regression methods.

[1]  Ivor W. Tsang,et al.  Transductive Ordinal Regression , 2011, IEEE Transactions on Neural Networks and Learning Systems.

[2]  Xiaoming Zhang,et al.  Kernel Discriminant Learning for Ordinal Regression , 2010, IEEE Transactions on Knowledge and Data Engineering.

[3]  Wei Chu,et al.  Support Vector Ordinal Regression , 2007, Neural Computation.

[4]  Michael Biehl,et al.  Adaptive Relevance Matrices in Learning Vector Quantization , 2009, Neural Computation.

[5]  Ling Li,et al.  Ordinal Regression by Extended Binary Classification , 2006, NIPS.

[6]  Thore Graepel,et al.  Large Margin Rank Boundaries for Ordinal Regression , 2000 .

[7]  Amnon Shashua,et al.  Ranking with Large Margin Principle: Two Approaches , 2002, NIPS.

[8]  Gerhard Widmer,et al.  Prediction of Ordinal Classes Using Regression Trees , 2001, Fundam. Informaticae.

[9]  Koby Crammer,et al.  Pranking with Ranking , 2001, NIPS.

[10]  Pedro Antonio Gutiérrez,et al.  Ordinal regression neural networks based on concentric hyperspheres , 2014, Neural Networks.

[11]  Pedro Antonio Gutiérrez,et al.  Exploitation of Pairwise Class Distances for Ordinal Classification , 2013, Neural Computation.

[12]  Eibe Frank,et al.  A Simple Approach to Ordinal Classification , 2001, ECML.

[13]  Peter Tiño,et al.  Adaptive Metric Learning Vector Quantization for Ordinal Classification , 2012, Neural Computation.

[14]  Wei Chu,et al.  New approaches to support vector ordinal regression , 2005, ICML.

[15]  Atsushi Sato,et al.  Generalized Learning Vector Quantization , 1995, NIPS.

[16]  Michael Biehl,et al.  Hyperparameter learning in probabilistic prototype-based models , 2010, Neurocomputing.

[17]  Peter Tiño,et al.  Volatility Trading ia Temporal Pattern Recognition in Quantised Financial Time Series , 2001, Pattern Analysis & Applications.

[18]  Thomas Villmann,et al.  Generalized relevance learning vector quantization , 2002, Neural Networks.

[19]  Ling Li,et al.  Reduction from Cost-Sensitive Ordinal Ranking to Weighted Binary Classification , 2012, Neural Computation.

[20]  Haibin Yan,et al.  Cost-sensitive ordinal regression for fully automatic facial beauty assessment , 2014, Neurocomputing.

[21]  Michael A. Arbib,et al.  The handbook of brain theory and neural networks , 1995, A Bradford book.

[22]  M J Campbell,et al.  A review of ordinal regression models applied on health-related quality of life assessments , 2002, Statistical methods in medical research.

[23]  Wei Chu,et al.  Gaussian Processes for Ordinal Regression , 2005, J. Mach. Learn. Res..