COLLABORATIVE PREDICTION BY MULTIPLE BAYESIAN NETWORKS AND ITS APPLICATION TO PRINTER USAGE MODELING

Bayesian networks (BNs) have become increasingly popular tools for learning and prediction in the context of user modeling. However, due to the lacks of individual training data especially for inactive or new users, separate treatments of individual users often become quite problematic. In this article, we propose a novel scheme of ‘collaborative’ prediction, in which multiple BNs (each for a single user) are cooperatively employed for prediction of a single target user’s actions. The core idea is to simply use the Bayesian principle, but in a rather intricate way. Our method is simple, and thus readily applicable to rather difficult, cases with heterogeneous and preliminary unknown structures of individual BNs. We demonstrate the usefulness of our method with a real dataset related to our motivating user modeling task, i.e., printer usage prediction. The results show that our Bayesian collaboration method effectively improves the prediction accuracy from both non-collaborative and other naive collaborative approaches, especially in cases with small sample sizes. It also appears that our method can improve such a low prediction accuracy that is possibly caused by poor optimization in the structure learning.

[1]  Ingrid Zukerman,et al.  # 2001 Kluwer Academic Publishers. Printed in the Netherlands. Predictive Statistical Models for User Modeling , 1999 .

[2]  Tom Heskes,et al.  Task Clustering and Gating for Bayesian Multitask Learning , 2003, J. Mach. Learn. Res..

[3]  Hans-Peter Kriegel,et al.  Ieee Transactions on Knowledge and Data Engineering Probabilistic Memory-based Collaborative Filtering , 2022 .

[4]  Rich Caruana,et al.  Multitask Learning: A Knowledge-Based Source of Inductive Bias , 1993, ICML.

[5]  John Riedl,et al.  GroupLens: an open architecture for collaborative filtering of netnews , 1994, CSCW '94.

[6]  Lawrence Carin,et al.  Multi-Task Learning for Classification with Dirichlet Process Priors , 2007, J. Mach. Learn. Res..

[7]  David Maxwell Chickering,et al.  Learning Bayesian Networks: The Combination of Knowledge and Statistical Data , 1994, Machine Learning.

[8]  Claus Dethlefsen,et al.  deal: A Package for Learning Bayesian Networks , 2003 .

[9]  Geoffrey I. Webb,et al.  # 2001 Kluwer Academic Publishers. Printed in the Netherlands. Machine Learning for User Modeling , 1999 .

[10]  Anthony Jameson,et al.  Leveraging Data About Users in General in the Learning of Individual User Models , 2001, IJCAI.

[11]  Michael I. Jordan,et al.  Loopy Belief Propagation for Approximate Inference: An Empirical Study , 1999, UAI.

[12]  Gediminas Adomavicius,et al.  Toward the next generation of recommender systems: a survey of the state-of-the-art and possible extensions , 2005, IEEE Transactions on Knowledge and Data Engineering.

[13]  Thomas Hofmann,et al.  Latent Class Models for Collaborative Filtering , 1999, IJCAI.

[14]  Rich Caruana,et al.  Multitask Learning , 1997, Machine Learning.

[15]  Eric Horvitz,et al.  Collaborative Filtering by Personality Diagnosis: A Hybrid Memory and Model-Based Approach , 2000, UAI.

[16]  Sean M. McNee,et al.  Getting to know you: learning new user preferences in recommender systems , 2002, IUI '02.

[17]  Rich Caruana,et al.  Inductive Transfer for Bayesian Network Structure Learning , 2007, ICML Unsupervised and Transfer Learning.

[18]  Eric Horvitz,et al.  The Lumière Project: Bayesian User Modeling for Inferring the Goals and Needs of Software Users , 1998, UAI.

[19]  Philip S. Yu Editorial: State of the Transactions , 2004, IEEE Trans. Knowl. Data Eng..

[20]  David Heckerman,et al.  Empirical Analysis of Predictive Algorithms for Collaborative Filtering , 1998, UAI.

[21]  Jonathan Baxter,et al.  A Model of Inductive Bias Learning , 2000, J. Artif. Intell. Res..

[22]  David J. Spiegelhalter,et al.  Local computations with probabilities on graphical structures and their application to expert systems , 1990 .