RecSys Issues Ontology: A Knowledge Classification of Issues for Recommender Systems Researchers

Scholarly research has extensively examined a number of issues and challenges affecting recommender systems (e.g. ‘cold-start’, ‘scrutability’, ‘trust’, ‘context’, etc.). However, a comprehensive knowledge classification of the issues involved with recommender systems research has yet to be developed. A holistic knowledge representation of the issues affecting a domain is critical for research advancement. The aim of this study is to advance scholarly research within the domain of recommender systems through formal knowledge classification of issues and their relationships to one another within recommender systems research literature. In this study, we employ a rigorous ontology engineering process for development of a recommender system issues ontology. This ontology provides a formal specification of the issues affecting recommender systems research and development. The ontology answers such questions as, “What issues are associated with ‘trust’ in recommender systems research?”, “What are issues associated with improving and evaluating the ‘performance’ of a recommender system?” or “What ‘contextual’ factors might a recommender systems developer wish to consider in order to improve the relevancy and usefulness of recommendations?” Additionally, as an intermediate representation step in the ontology acquisition process, a concept map of recommender systems issues has been developed to provide conceptual visualization of the issues so that researchers may discern broad themes as well as relationships between concepts. These knowledge representations may aid future researchers wishing to take an integrated approach to addressing the challenges and limitations associated with current recommender systems research.

[1]  WangWei,et al.  Recommender system application developments , 2015 .

[2]  Bo Pang,et al.  Thumbs up? Sentiment Classification using Machine Learning Techniques , 2002, EMNLP.

[3]  Samee Ullah Khan,et al.  A survey on context-aware recommender systems based on computational intelligence techniques , 2015, Computing.

[4]  Yehuda Koren,et al.  Matrix Factorization Techniques for Recommender Systems , 2009, Computer.

[5]  Robin D. Burke,et al.  Hybrid Recommender Systems: Survey and Experiments , 2002, User Modeling and User-Adapted Interaction.

[6]  Izak Benbasat,et al.  The Effects of Personalizaion and Familiarity on Trust and Adoption of Recommendation Agents , 2006, MIS Q..

[7]  Bart P. Knijnenburg,et al.  Explaining the user experience of recommender systems , 2012, User Modeling and User-Adapted Interaction.

[8]  CARLOS A. GOMEZ-URIBE,et al.  The Netflix Recommender System , 2015, ACM Trans. Manag. Inf. Syst..

[9]  John Riedl,et al.  E-Commerce Recommendation Applications , 2004, Data Mining and Knowledge Discovery.

[10]  Wil M. P. van der Aalst,et al.  Business Process Variability Modeling , 2017, ACM Comput. Surv..

[11]  Yair Wand,et al.  Research Note - How Semantics and Pragmatics Interact in Understanding Conceptual Models , 2014, Inf. Syst. Res..

[12]  Paul Resnick,et al.  Manipulation-resistant recommender systems through influence limits , 2008, SECO.

[13]  Eric Horvitz,et al.  Collaborative Filtering by Personality Diagnosis: A Hybrid Memory and Model-Based Approach , 2000, UAI.

[14]  John Riedl,et al.  Do You Trust Your Recommendations? An Exploration of Security and Privacy Issues in Recommender Systems , 2006, ETRICS.

[15]  Dan Frankowski,et al.  Collaborative Filtering Recommender Systems , 2007, The Adaptive Web.

[16]  Neil J. Hurley,et al.  Collaborative recommendation: A robustness analysis , 2004, TOIT.

[17]  Caleb Warren,et al.  Values and Preferences: Defining Preference Construction , 2011, Wiley interdisciplinary reviews. Cognitive science.

[18]  Christophe Cruz,et al.  A Survey on Ontology Evaluation Methods , 2015, KEOD.

[19]  Francesco Ricci,et al.  Case-Based Recommender Systems: A Unifying View , 2003, ITWP.

[20]  Victoria Y. Yoon,et al.  Semantic similarity of ontology instances using polarity mining , 2013, J. Assoc. Inf. Sci. Technol..

[21]  Barry Smyth,et al.  Similarity vs. Diversity , 2001, ICCBR.

[22]  Param Vir Singh,et al.  A Hidden Markov Model for Collaborative Filtering , 2010, MIS Q..

[23]  Darijus Strasunskas,et al.  Empirical Insights on a Value of Ontology Quality in Ontology-Driven Web Search , 2008, OTM Conferences.

[24]  Sung-Hyuk Park,et al.  From Accuracy to Diversity in Product Recommendations: Relationship Between Diversity and Customer Retention , 2013, Int. J. Electron. Commer..

[25]  Johnny Saldaña,et al.  The Coding Manual for Qualitative Researchers , 2009 .

[26]  Peter B. Sloep,et al.  A simulation for content-based and utility-based recommendation of candidate coalitions in virtual creativity teams , 2010, RecSysTEL@RecSys.

[27]  Kweku-Muata Osei-Bryson,et al.  Ontology-based data mining model management for self-service knowledge discovery , 2017, Inf. Syst. Frontiers.

[28]  David H. Jonassen.  Tools for Representing Problems and the Knowledge Required to Solve Them , 2005, Knowledge and Information Visualization.

[29]  Gordon B. Davis,et al.  User Acceptance of Information Technology: Toward a Unified View , 2003, MIS Q..

[30]  Gediminas Adomavicius,et al.  Toward the next generation of recommender systems: a survey of the state-of-the-art and possible extensions , 2005, IEEE Transactions on Knowledge and Data Engineering.

[31]  Fred D. Davis,et al.  User Acceptance of Computer Technology: A Comparison of Two Theoretical Models , 1989 .

[32]  Paulo S. C. Alencar,et al.  The use of machine learning algorithms in recommender systems: A systematic review , 2015, Expert Syst. Appl..

[33]  Yifan Hu,et al.  Collaborative Filtering for Implicit Feedback Datasets , 2008, 2008 Eighth IEEE International Conference on Data Mining.

[34]  Ulrike Gretzel,et al.  Persuasion in Recommender Systems , 2006, Int. J. Electron. Commer..

[35]  Judith Masthoff,et al.  A Survey of Explanations in Recommender Systems , 2007, 2007 IEEE 23rd International Conference on Data Engineering Workshop.

[36]  Deborah J. Mayhew,et al.  The usability engineering lifecycle , 1998, CHI Conference Summary.

[37]  Georgia Koutrika,et al.  FlexRecs: expressing and combining flexible recommendations , 2009, SIGMOD Conference.

[38]  Rob Kling,et al.  Reconceptualizing Users as Social Actors in Information Systems Research , 2003, MIS Q..

[39]  Wei-Lun Chang,et al.  A hybrid approach for personalized service staff recommendation , 2017, Inf. Syst. Frontiers.

[40]  Leonard J. Bass,et al.  Scenario-Based Analysis of Software Architecture , 1996, IEEE Softw..

[41]  Yoav Shoham,et al.  Fab: content-based, collaborative recommendation , 1997, CACM.

[42]  Mary Corbett,et al.  SUMI: the Software Usability Measurement Inventory , 1993, Br. J. Educ. Technol..

[43]  Seyed Reza Shahamiri,et al.  A systematic review of scholar context-aware recommender systems , 2015, Expert Syst. Appl..

[44]  Chao Liu,et al.  Recommender systems with social regularization , 2011, WSDM '11.

[45]  Ahmed Eldawy,et al.  LARS: A Location-Aware Recommender System , 2012, 2012 IEEE 28th International Conference on Data Engineering.

[46]  Chris Kimble,et al.  Competence management in knowledge intensive organizations using consensual knowledge and ontologies , 2016, Inf. Syst. Frontiers.

[47]  F. O. Isinkaye,et al.  Recommendation systems: Principles, methods and evaluation , 2015 .

[48]  Jane Yung-jen Hsu,et al.  Who likes it more?: mining worth-recommending items from long tails by modeling relative preference , 2014, WSDM.

[49]  GeunSik Jo,et al.  Collaborative Tagging in Recommender Systems , 2007, Australian Conference on Artificial Intelligence.

[50]  Shawn P. Curley,et al.  Effects of Online Recommendations on Consumers’ Willingness to Pay , 2012, Decisions@RecSys.

[51]  John Riedl,et al.  Analysis of recommendation algorithms for e-commerce , 2000, EC '00.

[52]  Fei Liu,et al.  Quantifying textual terms of items for similarity measurement , 2017, Inf. Sci..

[53]  Bamshad Mobasher,et al.  Towards Trustworthy Recommender Systems : An Analysis of Attack Models and Algorithm Robustness , 2007 .

[54]  Yehuda Koren,et al.  Scalable Collaborative Filtering with Jointly Derived Neighborhood Interpolation Weights , 2007, Seventh IEEE International Conference on Data Mining (ICDM 2007).

[55]  Lila Rao-Graham,et al.  Building ontology based knowledge maps to assist business process re-engineering , 2012, Decis. Support Syst..

[56]  Jakob Nielsen,et al.  The usability engineering life cycle , 1992, Computer.

[57]  Eric J. Johnson,et al.  The adaptive decision maker , 1993 .

[58]  Arkalgud Ramaprasad,et al.  Ontological Meta-Analysis and Synthesis , 2013, Commun. Assoc. Inf. Syst..

[59]  M. Lepper,et al.  When choice is demotivating: Can one desire too much of a good thing? , 2000 .

[60]  Roberto Turrin,et al.  Performance of recommender algorithms on top-n recommendation tasks , 2010, RecSys '10.

[61]  Shiu-li Huang,et al.  Designing utility-based recommender systems for e-commerce: Evaluation of preference-elicitation methods , 2011, Electron. Commer. Res. Appl..

[62]  Marko Grobelnik,et al.  A SURVEY OF ONTOLOGY EVALUATION TECHNIQUES , 2005 .

[63]  Bijan Parsia,et al.  A Study on the Atomic Decomposition of Ontologies , 2014, SEMWEB.

[64]  V. Braun,et al.  Using thematic analysis in psychology , 2006 .

[65]  Li Chen,et al.  A user-centric evaluation framework for recommender systems , 2011, RecSys '11.

[66]  Asunción Gómez-Pérez,et al.  Ontology Engineering in a Networked World , 2012, Springer Berlin Heidelberg.

[67]  Armelle Brun,et al.  When Diversity Is Needed... But Not Expected , 2013 .

[68]  Francesco Ricci,et al.  Learning and adaptivity in interactive recommender systems , 2007, ICEC.

[69]  Francesco Ricci,et al.  Context-Aware Recommender Systems , 2011, AI Mag..

[70]  Asunción Gómez-Pérez,et al.  The NeOn Methodology for Ontology Engineering , 2012, Ontology Engineering in a Networked World.

[71]  York Sure-Vetter,et al.  The DILIGENT knowledge processes , 2005, J. Knowl. Manag..

[72]  Giovanni Toffetti Carughi,et al.  Web Usability: Principles and Evaluation Methods , 2006, Web Engineering.

[73]  Alexander Felfernig,et al.  Constraint-based recommender systems: technologies and research issues , 2008, ICEC.

[74]  Richard Zeckhauser,et al.  Recommender systems for evaluating computer messages , 1997, CACM.

[75]  Joseph D. Novak,et al.  Learning How to Learn , 1984 .

[76]  Fred D. Davis.  Perceived Usefulness, Perceived Ease of Use, and User Acceptance of Information Technology , 1989, MIS Q..

[77]  Dit-Yan Yeung,et al.  Collaborative Deep Learning for Recommender Systems , 2014, KDD.

[78]  Kinshuk,et al.  Mining e-Learning domain concept map from academic articles , 2008, Comput. Educ..

[79]  Thomas R. Gruber,et al.  Toward principles for the design of ontologies used for knowledge sharing? , 1995, Int. J. Hum. Comput. Stud..

[80]  Dávid Zibriczky,et al.  Recommender Systems meet Finance: a Literature Review , 2016, FINREC.

[81]  Mohammed Bennamoun,et al.  Ontology learning from text: A look back and into the future , 2012, CSUR.

[82]  Gediminas Adomavicius,et al.  Maximizing Aggregate Recommendation Diversity: A Graph-Theoretic Approach , 2011, RecSys 2011.

[83]  Guy Shani,et al.  An MDP-Based Recommender System , 2002, J. Mach. Learn. Res..

[84]  John Riedl,et al.  An Algorithmic Framework for Performing Collaborative Filtering , 1999, SIGIR Forum.

[85]  Asunción Gómez-Pérez,et al.  Ontological Engineering: With Examples from the Areas of Knowledge Management, e-Commerce and the Semantic Web , 2004, Advanced Information and Knowledge Processing.

[86]  Neil J. Hurley,et al.  Detecting noise in recommender system databases , 2006, IUI '06.

[87]  Anthony Jameson,et al.  More than the sum of its members: challenges for group recommender systems , 2004, AVI.

[88]  Alexander Maedche,et al.  Designing Social Nudges for Enterprise Recommendation Agents: An Investigation in the Business Intelligence Systems Context , 2018, J. Assoc. Inf. Syst..

[89]  Cheng-Jung Lin,et al.  A recommender system to avoid customer churn: A case study , 2009, Expert Syst. Appl..

[90]  Jia Li,et al.  Latent Cross: Making Use of Context in Recurrent Recommender Systems , 2018, WSDM.

[91]  Jonathan L. Herlocker,et al.  Evaluating collaborative filtering recommender systems , 2004, TOIS.

[92]  Iván Cantador,et al.  Time-aware recommender systems: a comprehensive survey and analysis of existing evaluation protocols , 2013, User Modeling and User-Adapted Interaction.

[93]  Paul Resnick,et al.  Recommender systems , 1997, CACM.

[94]  Asunción Gómez-Pérez,et al.  METHONTOLOGY: From Ontological Art Towards Ontological Engineering , 1997, AAAI 1997.

[95]  H. Simon,et al.  A Behavioral Model of Rational Choice , 1955 .

[96]  Taghi M. Khoshgoftaar,et al.  A Survey of Collaborative Filtering Techniques , 2009, Adv. Artif. Intell..

[97]  Caro Lucas,et al.  A recommender system based on invasive weed optimization algorithm , 2007, 2007 IEEE Congress on Evolutionary Computation.

[98]  Yiyu Yao.  Measuring retrieval effectiveness based on user preference of documents , 1995 .

[99]  John W. Payne,et al.  The adaptive decision maker: Name index , 1993 .

[100]  Diego Fernández,et al.  Comparison of collaborative filtering algorithms , 2011, ACM Trans. Web.

[101]  Qiang Yang,et al.  Transfer Learning in Collaborative Filtering for Sparsity Reduction , 2010, AAAI.

[102]  Lior Rokach,et al.  Recommender Systems Handbook , 2010 .

[103]  Greg Linden,et al.  Amazon . com Recommendations Item-to-Item Collaborative Filtering , 2001 .

[104]  Bamshad Mobasher,et al.  Classification features for attack detection in collaborative recommender systems , 2006, KDD '06.

[105]  Barry Smyth,et al.  Case-based recommender systems , 2005, The Knowledge Engineering Review.

[106]  Derek Bridge,et al.  Diversity, Serendipity, Novelty, and Coverage , 2016, ACM Trans. Interact. Intell. Syst..

[107]  Saul Vargas,et al.  Improving sales diversity by recommending users to items , 2014, RecSys '14.

[108]  David M. Pennock,et al.  Categories and Subject Descriptors , 2001 .

[109]  Stephen Burgess,et al.  Trust perceptions of online travel information by different content creators: Some social and legal implications , 2011, Inf. Syst. Frontiers.

[110]  Alexander Tuzhilin.  Customer relationship management and Web mining: the next frontier , 2012, Data Mining and Knowledge Discovery.

[111]  Enrico Motta,et al.  What Makes a Good Ontology? A Case-Study in Fine-Grained Knowledge Reuse , 2009, ASWC.

[112]  Erik Brynjolfsson,et al.  Research Commentary - Long Tails vs. Superstars: The Effect of Information Technology on Product Variety and Sales Concentration Patterns , 2010, Inf. Syst. Res..

[113]  Ralph E. Steuer,et al.  Multiple Criteria Decision Making, Multiattribute Utility Theory: The Next Ten Years , 1992 .

[114]  Donna L. Hoffman,et al.  Building consumer trust online , 1999, CACM.

[115]  Loren Terveen,et al.  User Personality and User Satisfaction with Recommender Systems , 2017, Information Systems Frontiers.

[116]  Bruce Krulwich,et al.  LIFESTYLE FINDER: Intelligent User Profiling Using Large-Scale Demographic Data , 1997, AI Mag..

[117]  Mark S. Ackerman,et al.  Expertise recommender: a flexible recommendation system and architecture , 2000, CSCW '00.

[118]  Alexander Tuzhilin,et al.  Research Note - In CARSs We Trust: How Context-Aware Recommendations Affect Customers' Trust and Other Business Performance Measures of Recommender Systems , 2016, Inf. Syst. Res..

[119]  Mark P. Graus,et al.  Understanding choice overload in recommender systems , 2010, RecSys '10.

[120]  Josep Lluís de la Rosa i Esteva,et al.  Collaboration Analysis in Recommender Systems Using Social Networks , 2004, CIA.

[121]  Asunción Gómez-Pérez,et al.  Towards a framework to verify knowledge sharing technology , 1996 .

[122]  Leo Obrst,et al.  The Evaluation of Ontologies , 2007 .

[123]  Sophie Ahrens,et al.  Recommender Systems , 2012 .

[124]  Judith Masthoff,et al.  Group Recommender Systems: Combining Individual Models , 2011, Recommender Systems Handbook.

[125]  R. Shavelson,et al.  Problems and Issues in the Use of Concept Maps in Science Assessment. , 1996 .

[126]  Yang Guo,et al.  A survey of collaborative filtering based social recommender systems , 2014, Comput. Commun..

[127]  Tor Guimaraes,et al.  Assessing the moderating effect of consumer product knowledge and online shopping experience on using recommendation agents for customer loyalty , 2013, Decis. Support Syst..

[128]  Gaël Varoquaux,et al.  Scikit-learn: Machine Learning in Python , 2011, J. Mach. Learn. Res..

[129]  J. Bobadilla,et al.  Recommender systems survey , 2013, Knowl. Based Syst..

[130]  Mouzhi Ge,et al.  Beyond accuracy: evaluating recommender systems by coverage and serendipity , 2010, RecSys '10.

[131]  Peter Vojtás,et al.  Using Implicit Preference Relations to Improve Content Based Recommending , 2015, EC-Web.

[132]  Sean M. McNee,et al.  Getting to know you: learning new user preferences in recommender systems , 2002, IUI '02.

[133]  Ram D. Gopal,et al.  Empirical Analysis of the Impact of Recommender Systems on Sales , 2010, J. Manag. Inf. Syst..

[134]  Barry Smyth,et al.  Trust in recommender systems , 2005, IUI.

[135]  Douglas B. Terry,et al.  Using collaborative filtering to weave an information tapestry , 1992, CACM.

[136]  Peter Vojtás,et al.  Using Implicit Preference Relations to Improve Recommender Systems , 2017, Journal on Data Semantics.

[137]  John Riedl,et al.  Explaining collaborative filtering recommendations , 2000, CSCW '00.

[138]  Thomas W. Malone,et al.  Intelligent Information Sharing Systems , 1986 .

[139]  Ting Li,et al.  Willing to pay for quality personalization? Trade-off between quality and privacy , 2012, Eur. J. Inf. Syst..

[140]  Richard Granger,et al.  Beyond Incremental Processing: Tracking Concept Drift , 1986, AAAI.

[141]  Sean M. McNee,et al.  Being accurate is not enough: how accuracy metrics have hurt recommender systems , 2006, CHI Extended Abstracts.

[142]  Izak Benbasat,et al.  E-Commerce Product Recommendation Agents: Use, Characteristics, and Impact , 2007, MIS Q..

[143]  N. F. Noy,et al.  Ontology Development 101: A Guide to Creating Your First Ontology , 2001 .

[144]  Michael Gruninger,et al.  Methodology for the Design and Evaluation of Ontologies , 1995, IJCAI 1995.

[145]  Erik Duval,et al.  Context-Aware Recommender Systems for Learning: A Survey and Future Challenges , 2012, IEEE Transactions on Learning Technologies.

[146]  Roliana Ibrahim,et al.  Cross Domain Recommender Systems , 2017, ACM Comput. Surv..

[147]  J. Hagel,et al.  Net Worth: Shaping Markets When Customers Make the Rules , 1999 .

[148]  Wei Wang,et al.  Recommender system application developments: A survey , 2015, Decis. Support Syst..

[149]  Geoffrey S. Hubona,et al.  A Scientific Basis for Rigor in Information Systems Research , 2009, MIS Q..

[150]  J. B. Brooke,et al.  SUS: A 'Quick and Dirty' Usability Scale , 1996 .

[151]  Irena Koprinska,et al.  People-to-People Reciprocal Recommenders , 2015, Recommender Systems Handbook.

[152]  Vyacheslav Tuzlukov,et al.  Signal Processing Noise , 2002 .

[153]  Kecheng Liu,et al.  Collaborative personal profiling for web service ranking and recommendation , 2014, Information Systems Frontiers.

[154]  Tevfik Aytekin,et al.  Incorporating Aggregate Diversity in Recommender Systems Using Scalable Optimization Approaches , 2017, INFORMS J. Comput..

[155]  Mark Claypool,et al.  Combining Content-Based and Collaborative Filters in an Online Newspaper , 1999, SIGIR 1999.

[156]  José Maria Parente de Oliveira,et al.  Concept maps as the first step in an ontology construction method , 2013, Inf. Syst..

[157]  Qiang Yang,et al.  Transfer learning for collaborative filtering via a rating-matrix generative model , 2009, ICML '09.

[158]  Alan R. Hevner,et al.  Design Science in Information Systems Research , 2004, MIS Q..