Online Learning of Acyclic Conditional Preference Networks from Noisy Data

We deal with online learning of acyclic Conditional Preference networks (CP-nets) from data streams, possibly corrupted with noise. We introduce a new, efficient algorithm relying on (i) information-theoretic measures defined over the induced preference rules, which allow us to deal with corrupted data in a principled way, and on (ii) the Hoeffding bound to define an asymptotically optimal decision criterion for selecting the best conditioned variable to update the learned network. This is the first algorithm dealing with online learning of CP-nets in the presence of noise. We provide a thorough theoretical analysis of the algorithm, and demonstrate its effectiveness through an empirical evaluation on synthetic and on real datasets.

[1]  Yann Chevaleyre,et al.  Learning Ordinal Preferences on Multiattribute Domains: The Case of CP-nets , 2010, Preference Learning.

[2]  Yue Lu,et al.  Latent aspect rating analysis on review text data: a rating regression approach , 2010, KDD.

[3]  Yi Xiong,et al.  Learning Conditional Preference Networks from Inconsistent Examples , 2014, IEEE Transactions on Knowledge and Data Engineering.

[4]  Yue Lu,et al.  Latent aspect rating analysis without aspect keyword supervision , 2011, KDD.

[5]  Loizos Michael,et al.  Ceteris Paribus Preference Elicitation with Predictive Guarantees , 2009, IJCAI.

[6]  Peter Vojtás,et al.  Learning User Preferences for 2CP-Regression for a Recommender System , 2010, SOFSEM.

[7]  Tuomas Sandholm,et al.  Expressive commerce and its application to sourcing: how we conducted $35 billion of generalized combinatorial auctions , 2007, AI Mag..

[8]  Bruno Zanuttini,et al.  Learning conditional preference networks , 2010, Artif. Intell..

[9]  Junwei Wang,et al.  Representing conditional preference by boosted regression trees for recommendation , 2016, Inf. Sci..

[10]  Malek Mouhoub,et al.  The Complexity of Learning Acyclic CP-Nets , 2016, IJCAI.

[11]  Loizos Michael,et al.  An Empirical Investigation of Ceteris Paribus Learnability , 2013, IJCAI.

[12]  Andrew W. Moore,et al.  Hoeffding Races: Accelerating Model Selection Search for Classification and Function Approximation , 1993, NIPS.

[13]  Alexis Tsoukiàs,et al.  From decision theory to decision aiding methodology , 2008, Eur. J. Oper. Res..

[14]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[15]  Yi Xiong,et al.  Learning conditional preference network from noisy samples using hypothesis testing , 2013, Knowl. Based Syst..

[16]  Toby Walsh,et al.  Representing and Reasoning with Preferences , 2007, AI Mag..

[17]  Ronen I. Brafman,et al.  CP-nets: A Tool for Representing and Reasoning withConditional Ceteris Paribus Preference Statements , 2011, J. Artif. Intell. Res..

[18]  W. Hoeffding Probability Inequalities for sums of Bounded Random Variables , 1963 .

[19]  Judy Goldsmith,et al.  Learning CP-Net Preferences Online from User Queries , 2013, AAAI.

[20]  Peter Vojtás,et al.  How to Learn Fuzzy User Preferences with Variable Objectives , 2009, IFSA/EUSFLAT Conf..

[21]  Peter Auer,et al.  Finite-time Analysis of the Multiarmed Bandit Problem , 2002, Machine Learning.

[22]  Geoff Hulten,et al.  Mining high-speed data streams , 2000, KDD '00.