Collaborative online ranking algorithms for multitask learning

There are many applications in which it is desirable to rank or order instances that belong to several different but related problems or tasks. Although unique, the individual ranking problem often shares characteristics with other problems in the group. Conventional ranking methods treat each task independently without considering the latent commonalities. In this paper, we study the problem of learning to rank instances that belong to multiple related tasks from the multitask learning perspective. We consider a case in which the information that is learned for a task can be used to enhance the learning of other tasks and propose a collaborative multitask ranking method that learns several ranking models for each of the related tasks together. The proposed algorithms operate in rounds by learning models from a sequence of data instances one at a time. In each round, our algorithms receive an instance that belongs to a task and make a prediction using the task’s ranking model. The model is then updated by leveraging both the task-specific data and the information provided by other models in a collaborative way. The experimental results demonstrate that our algorithms can improve the overall performance of ranking multiple correlated tasks collaboratively. Furthermore, our algorithms can scale well to large amounts of data and are particularly suitable for real-world applications in which data arrive continuously.

[1]  Rong Jin,et al.  DUOL: A Double Updating Approach for Online Learning , 2009, NIPS.

[2]  Koby Crammer,et al.  Pranking with Ranking , 2001, NIPS.

[3]  Wei Chu,et al.  Support Vector Ordinal Regression , 2007, Neural Computation.

[4]  Steven C. H. Hoi,et al.  Online Learning: A Comprehensive Survey , 2018, Neurocomputing.

[5]  Edward F. Harrington,et al.  Online Ranking/Collaborative Filtering Using the Perceptron Algorithm , 2003, ICML.

[6]  Hang Li,et al.  Learning to Rank for Information Retrieval and Natural Language Processing , 2011, Synthesis Lectures on Human Language Technologies.

[7]  Massimiliano Pontil,et al.  Regularized multi--task learning , 2004, KDD.

[8]  Charles A. Micchelli,et al.  Learning Multiple Tasks with Kernel Methods , 2005, J. Mach. Learn. Res..

[9]  Claudio Gentile,et al.  A Second-Order Perceptron Algorithm , 2002, SIAM J. Comput..

[10]  P. Bartlett,et al.  Optimal strategies and minimax lower bounds for online convex games [Technical Report No. UCB/EECS-2008-19] , 2008 .

[11]  Lars Schmidt-Thieme,et al.  BPR: Bayesian Personalized Ranking from Implicit Feedback , 2009, UAI.

[12]  Ling Li,et al.  Reduction from Cost-Sensitive Ordinal Ranking to Weighted Binary Classification , 2012, Neural Computation.

[13]  Tie-Yan Liu,et al.  Learning to Rank for Information Retrieval , 2011 .

[14]  Claudio Gentile,et al.  Linear Algorithms for Online Multitask Classification , 2010, COLT.

[15]  Gianluca Pollastri,et al.  A neural network approach to ordinal regression , 2007, 2008 IEEE International Joint Conference on Neural Networks (IEEE World Congress on Computational Intelligence).

[16]  Koby Crammer,et al.  Advances in Neural Information Processing Systems 14 , 2002 .

[17]  Rich Caruana,et al.  Multitask Learning , 1998, Encyclopedia of Machine Learning and Data Mining.

[18]  Koby Crammer,et al.  Online Ranking by Projecting , 2005, Neural Computation.

[19]  Koby Crammer,et al.  Adaptive regularization of weight vectors , 2009, Machine Learning.

[20]  F ROSENBLATT,et al.  The perceptron: a probabilistic model for information storage and organization in the brain. , 1958, Psychological review.

[21]  Michael R. Lyu,et al.  Online learning for multi-task feature selection , 2010, CIKM '10.

[22]  John Blitzer,et al.  Biographies, Bollywood, Boom-boxes and Blenders: Domain Adaptation for Sentiment Classification , 2007, ACL.

[23]  Pedro Antonio Gutiérrez,et al.  Ordinal Regression Methods: Survey and Experimental Study , 2016, IEEE Transactions on Knowledge and Data Engineering.

[24]  Amnon Shashua,et al.  Ranking with Large Margin Principle: Two Approaches , 2002, NIPS.

[25]  Tong Zhang,et al.  Subset Ranking Using Regression , 2006, COLT.

[26]  Ramesh C. Jain,et al.  Collaborative Online Multitask Learning , 2014, IEEE Transactions on Knowledge and Data Engineering.

[27]  Hang Li Learning to Rank for Information Retrieval and Natural Language Processing , 2011, Synthesis Lectures on Human Language Technologies.

[28]  Wei Chu,et al.  Gaussian Processes for Ordinal Regression , 2005, J. Mach. Learn. Res..

[29]  Avishek Saha,et al.  Online Learning of Multiple Tasks and Their Relationships , 2011, AISTATS.

[30]  Rich Caruana,et al.  Multitask Learning , 1997, Machine Learning.

[31]  Koby Crammer,et al.  Confidence-weighted linear classification , 2008, ICML '08.

[32]  Qiang Wu,et al.  McRank: Learning to Rank Using Multiple Classification and Gradient Boosting , 2007, NIPS.

[33]  Koby Crammer,et al.  Online Passive-Aggressive Algorithms , 2003, J. Mach. Learn. Res..