Preference Neural Network

This paper proposes a preference neural network (PNN) to address the problem of indifference preferences orders with new activation function. PNN also solves the Multi-label ranking problem, where labels may have indifference preference orders or subgroups are equally ranked. PNN follows a multi-layer feedforward architecture with fully connected neurons. Each neuron contains a novel smooth stairstep activation function based on the number of preference orders. PNN inputs represent data features and output neurons represent label indexes. The proposed PNN is evaluated using new preference mining dataset that contains repeated label values which have not experimented before. PNN outperforms five previously proposed methods for strict label ranking in terms of accurate results with high computational efficiency.

[1]  Carlos Soares,et al.  Discovering a taste for the unusual: exceptional models for preference mining , 2018, Machine Learning.

[2]  Gediminas Adomavicius,et al.  Toward the next generation of recommender systems: a survey of the state-of-the-art and possible extensions , 2005, IEEE Transactions on Knowledge and Data Engineering.

[3]  Eyke Hüllermeier,et al.  Label ranking by learning pairwise preferences , 2008, Artif. Intell..

[4]  Yoram Singer,et al.  Log-Linear Models for Label Ranking , 2003, NIPS.

[5]  Dan Roth,et al.  Constraint Classification: A New Approach to Multiclass Classification , 2002, ALT.

[6]  Jürgen Schmidhuber,et al.  Deep learning in neural networks: An overview , 2014, Neural Networks.

[7]  C. Spearman.  The proof and measurement of association between two things. , 2015, International journal of epidemiology.

[8]  Eyke Hüllermeier,et al.  Preference Learning: An Introduction , 2010, Preference Learning.

[9]  Eyke Hüllermeier,et al.  Instance-Based Label Ranking using the Mallows Model , 2008, ECCBR Workshops.

[10]  Koby Crammer,et al.  Pranking with Ranking , 2001, NIPS.

[11]  Xin Wang,et al.  Handwritten Character Recognition Based on BP Neural Network , 2009, 2009 Third International Conference on Genetic and Evolutionary Computing.

[12]  R. Forthofer,et al.  Rank Correlation Methods , 1981 .

[13]  Eyke Hüllermeier,et al.  Pairwise Preference Learning and Ranking , 2003, ECML.

[14]  Philip L. H. Yu,et al.  Decision Tree Modeling for Ranking Data , 2010, Preference Learning.

[15]  Ronen I. Brafman,et al.  Preference Handling - An Introductory Tutorial , 2009, AI Mag..

[16]  Carlos Soares,et al.  Mining association rules for label ranking , 2011 .

[17]  Susanne Ernst,et al.  Identification with Dynamic Neural Networks - Architectures, Comparisons, Applications , 1997 .

[18]  Eyke Hüllermeier,et al.  Preference Learning , 2005, Künstliche Intell..

[19]  C. Spearman.  The proof and measurement of association between two things. By C. Spearman, 1904. , 1987, The American journal of psychology.

[20]  Ying Wang,et al.  LSTM$$^{2}$$2: Multi-Label Ranking for Document Classification , 2017, Neural Processing Letters.

[21]  Slobodan Vucetic,et al.  Supervised clustering of label ranking data using label preference information , 2013, Machine Learning.

[22]  Guoping Qiu,et al.  Random Forest for Label Ranking , 2016, Expert Syst. Appl..

[23]  Hongming Zhou,et al.  Extreme Learning Machine for Regression and Multiclass Classification , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[24]  Josep Lluís de la Rosa i Esteva,et al.  A Taxonomy of Recommender Agents on the Internet , 2003, Artificial Intelligence Review.

[25]  Yangguang Liu,et al.  A Taxonomy of Label Ranking Algorithms , 2014, J. Comput..

[26]  Alekseĭ Grigorʹevich Ivakhnenko,et al.  Cybernetics and forecasting techniques , 1967 .

[27]  Ambuj Tewari,et al.  Online Boosting Algorithms for Multi-label Ranking , 2017, AISTATS.

[28]  J. M. Bevan,et al.  Rank Correlation Methods , 1949 .

[29]  Gregory N. Hullender,et al.  Learning to rank using gradient descent , 2005, ICML.

[30]  Chenping Hou,et al.  Low Rank Multi-Label Classification with Missing Labels , 2018, 2018 24th International Conference on Pattern Recognition (ICPR).

[31]  Fabio Aiolli.  A preference model for structured supervised learning tasks , 2005, Fifth IEEE International Conference on Data Mining (ICDM'05).

[32]  Carlos Soares,et al.  A Similarity-Based Adaptation of Naive Bayes for Label Ranking: Application to the Metalearning Problem of Algorithm Recommendation , 2010, Discovery Science.

[33]  Eyke Hüllermeier,et al.  Decision tree and instance-based learning for label ranking , 2009, ICML '09.

[34]  Dan Roth,et al.  Constraint Classification for Multiclass Classification and Ranking , 2002, NIPS.

[35]  Xiao Huang,et al.  Multi-label Adversarial Perturbations , 2018, 2018 IEEE International Conference on Data Mining (ICDM).

[36]  Nemanja Djuric,et al.  Learning from Pairwise Preference Data using Gaussian Mixture Model , 2012 .

[37]  Paulo Cortez,et al.  Label Ranking Forests , 2017, Expert Syst. J. Knowl. Eng..