Quality Enhancement Based on Reinforcement Learning and Feature Weighting for a Critiquing-Based Recommender

Personalizing the product recommendation task is a major focus of research in the area of conversational recommender systems. Conversational case-based recommender systems help users to navigate through product spaces, alternatively making product suggestions and eliciting users feedback. Critiquing is a common form of feedback and incremental critiquing-based recommender system has shown its efficiency to personalize products based primarily on a quality measure. This quality measure influences the recommendation process and it is obtained by the combination of compatibility and similarity scores. In this paper, we describe new compatibility strategies whose basis is on reinforcement learning and a new feature weighting technique which is based on the user's history of critiques. Moreover, we show that our methodology can significantly improve recommendation efficiency in comparison with the state-of-the-art approaches.

[1]  M. Friedman The Use of Ranks to Avoid the Assumption of Normality Implicit in the Analysis of Variance , 1937 .

[2]  M. Friedman A Comparison of Alternative Tests of Significance for the Problem of $m$ Rankings , 1940 .

[3]  David W. Aha,et al.  Tolerating Noisy, Irrelevant and Novel Attributes in Instance-Based Learning Algorithms , 1992, Int. J. Man Mach. Stud..

[4]  David W. Aha,et al.  Weighting Features , 1995, ICCBR.

[5]  Andrew W. Moore,et al.  Reinforcement Learning: A Survey , 1996, J. Artif. Intell. Res..

[6]  Barry Smyth,et al.  Advances in Case-Based Reasoning , 1996, Lecture Notes in Computer Science.

[7]  Kristian J. Hammond,et al.  Knowledge-Based Navigation of Complex Information Spaces , 1996, AAAI/IAAI, Vol. 1.

[8]  Luc Lamontagne,et al.  Case-Based Reasoning Research and Development , 1997, Lecture Notes in Computer Science.

[9]  Kristian J. Hammond,et al.  The FindMe Approach to Assisted Browsing , 1997, IEEE Expert.

[10]  Ron Kohavi,et al.  The Utility of Feature Weighting in Nearest-Neighbor Algorithms , 1997 .

[11]  Richard S. Sutton,et al.  Introduction to Reinforcement Learning , 1998 .

[12]  Cynthia A. Thompson,et al.  Personalized Conversational Case-Based Recommendation , 2000, EWCBR.

[13]  Barry Smyth,et al.  Comparison-Based Recommendation , 2002, ECCBR.

[14]  Barry Smyth,et al.  The Power of Suggestion , 2003, International Joint Conference on Artificial Intelligence.

[15]  Paul Douglas,et al.  International Conference on Information Technology : Coding and Computing , 2003 .

[16]  David McSherry,et al.  Similarity and Compromise , 2003, ICCBR.

[17]  Hideo Shimazu,et al.  ExpertGuide: A Conversational Case-Based Reasoning Tool for Developing Mentors in Knowledge Spaces , 2001, Applied Intelligence.

[18]  Robin D. Burke,et al.  Interactive Critiquing forCatalog Navigation in E-Commerce , 2002, Artificial Intelligence Review.

[19]  Erhard Rahm,et al.  Reinforcement learning architecture for Web recommendations , 2004, International Conference on Information Technology: Coding and Computing, 2004. Proceedings. ITCC 2004..

[20]  Barry Smyth,et al.  Incremental critiquing , 2005, Knowl. Based Syst..

[21]  Barry Smyth,et al.  Knowledge Discovery from User Preferences in Conversational Recommendation , 2005, PKDD.

[22]  Frans Coenen,et al.  Research and Development in Intelligent Systems XXI, Proceedings of AI-2004, the Twenty-fourth SGAI International Conference on Innovative Techniques and Applications of Artificial Intelligence, Queens' College, Cambridge, UK, 13-15 December 2004 , 2005, SGAI Conf..

[23]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[24]  David W. Aha,et al.  Conversational Case-Based Reasoning , 2001, Applied Intelligence.

[25]  Luís Torgo,et al.  Knowledge Discovery in Databases: PKDD 2005, 9th European Conference on Principles and Practice of Knowledge Discovery in Databases, Porto, Portugal, October 3-7, 2005, Proceedings , 2005, PKDD.

[26]  Janez Demsar,et al.  Statistical Comparisons of Classifiers over Multiple Data Sets , 2006, J. Mach. Learn. Res..

[27]  Aekyung Moon,et al.  A Service Recommendation Using Reinforcement Learning for Network-based Robots in Ubiquitous Computing Environments , 2007, RO-MAN 2007 - The 16th IEEE International Symposium on Robot and Human Interactive Communication.

[28]  Miltos Petridis,et al.  Research and Development in Intelligent Systems XXVI, Incorporating Applications and Innovations in Intelligent Systems XVII, Peterhouse College, Cambridge, UK, 15-17 December 2009 , 2010, SGAI Conferences.

[29]  Hideo ExpertClerk : A Conversational Case-Based Reasoning Tool for Developing Salesclerk Agents in E-Commerce , .