A hybrid recommender system integrated into LAMS for learning designers

In the constantly evolving field of e-learning, the Learning Design (LD) sector constitutes a critical success factor, as it has the potential to preserve and disseminate effective pedagogical approaches and enhance the quality of the educational process. Recognizing the LD process as demanding in terms of time and expertise this paper answers the research question of how to leverage Recommender Systems (RSs) and reuse pre-existing LD solutions in order to support teachers in the LD process. In particular, this paper presents the implementation and the first evaluation results of Mentor. Mentor is an RS that supports teachers in finding pre-existing LDs, which cater better for their needs and preferences, so as to re-design them. Mentor is integrated into LAMS, which is a well-known tool for designing, managing and delivering sequences of learning activities. The first user-centric evaluation experiment results are presented and confirm the underlying assumption that Mentor can facilitate teachers in the LD process. Further results concerning the user’s general perception and the perceived usefulness of Mentor are discussed.

[1]  Jennifer Xu,et al.  Data Mining for Social Network Data , 2010, Annals of Information Systems.

[2]  Paul Resnick,et al.  Recommender systems , 1997, CACM.

[3]  Lior Rokach,et al.  Introduction to Recommender Systems Handbook , 2011, Recommender Systems Handbook.

[4]  Grainne Conole,et al.  The design of Cloudworks: Applying social networking practice to foster the exchange of learning and teaching ideas and designs , 2010, Comput. Educ..

[5]  Carmel McNaught,et al.  Balancing Online and In-class Activities Using the Learning Activity Management System (LAMS) , 2007 .

[6]  Delbert Dueck,et al.  Clustering by Passing Messages Between Data Points , 2007, Science.

[7]  Christoph Rensing,et al.  Evaluating Recommender Systems for Technology Enhanced Learning: A Quantitative Survey , 2015, IEEE Transactions on Learning Technologies.

[8]  J. Bobadilla,et al.  Recommender systems survey , 2013, Knowl. Based Syst..

[9]  Allison Littlejohn.  Littlejohn, A. (2003) Re-Using online resources: a sustainable approach to e-learning. Chapter 1: Seven issues in the reuse and sharing of Online Resources , 2003 .

[10]  Bart P. Knijnenburg,et al.  Explaining the user experience of recommender systems , 2012, User Modeling and User-Adapted Interaction.

[11]  Spyros Papadakis,et al.  Integrating LMSs in the Educational Process: Greek Teachers' Initial Perceptions about LAMS. , 2012 .

[12]  Erik Duval,et al.  Quantitative Analysis of Learning Object Repositories , 2008, IEEE Transactions on Learning Technologies.

[13]  Christopher Meek,et al.  A unified approach to building hybrid recommender systems , 2009, RecSys '09.

[14]  Barry Smyth,et al.  Case-Based Recommendation , 2007, The Adaptive Web.

[15]  Mojtaba Salehi,et al.  Personalized recommendation of learning material using sequential pattern mining and attribute based collaborative filtering , 2012, Education and Information Technologies.

[16]  Sean M. McNee,et al.  On the recommending of citations for research papers , 2002, CSCW '02.

[17]  Mercedes Gómez-Albarrán,et al.  Recommendation and Students' Authoring in Repositories of Learning Objects: A Case-Based Reasoning Approach , 2009, iJET.

[18]  Andreas Hotho,et al.  Social Tagging Systems , 2012 .

[19]  Maria Satratzemi,et al.  Mentor: A Hybrid Recommender System in Order to Support Teachers in Learning Design Authoring Process , 2014, 2014 IEEE 14th International Conference on Advanced Learning Technologies.

[20]  Sean M. McNee,et al.  Improving recommendation lists through topic diversification , 2005, WWW '05.

[21]  Hendrik Drachsler,et al.  Towards a Social Trust-Aware Recommender for Teachers , 2014, Recommender Systems for Technology Enhanced Learning.

[22]  Maria Kordaki,et al.  THE ROLE OF CONTEXT FREE COLLABORATION DESIGN PATTERNS IN LEARNING DESIGN WITHIN LAMS: LESSONS LEARNED FROM AN EMPIRICAL STUDY , 2011 .

[23]  Franca Garzotto,et al.  Investigating the Persuasion Potential of Recommender Systems from a Quality Perspective: An Empirical Study , 2012, TIIS.

[24]  Judith Masthoff,et al.  Designing and Evaluating Explanations for Recommender Systems , 2011, Recommender Systems Handbook.

[25]  Nikos Manouselis,et al.  Open educational resources repositories literature review - Towards a comprehensive quality approaches framework , 2015, Comput. Hum. Behav..

[26]  Angshul Majumdar,et al.  Addressing coldstart problem in recommender systems , 2016 .

[27]  H. Sobhanam,et al.  Addressing cold start problem in recommender systems using association rules and clustering technique , 2013, 2013 International Conference on Computer Communication and Informatics.

[28]  Spyros Papadakis,et al.  Using Blended Learning in Traditional Face-to-Face Instruction: A case study teaching Algorithms to undergraduate students. , 2006 .

[29]  Barry Harper,et al.  Learning Designs as a Stimulus and Support for Teachers’ Design Practices , 2019, Rethinking Pedagogy for a Digital Age.

[30]  Eva Dobozy,et al.  The Larnaca Declaration on Learning Design , 2016 .

[31]  Tova Milo,et al.  Diversification and refinement in collaborative filtering recommender , 2011, CIKM '11.

[32]  James Dalziel,et al.  Using LAMS Version 2 for a game-based Learning Design , 2008 .

[33]  Sue Bennett,et al.  Reusable learning designs in university education , 2005 .

[34]  Li Chen,et al.  A user-centric evaluation framework for recommender systems , 2011, RecSys '11.

[35]  Patricia Charlton,et al.  Enabling creative learning design through semantic technologies , 2012 .

[36]  Michael J. Pazzani,et al.  Content-Based Recommendation Systems , 2007, The Adaptive Web.

[37]  James Dalziel,et al.  Implementing learning design : the Learning Activity Management System (LAMS) , 2003 .

[38]  Allison Littlejohn.  Issues in Reusing Online Resources: Chapter 1 , 2003 .

[39]  Erik Duval,et al.  How to Share and Reuse Learning Resources: The ARIADNE Experience , 2010, EC-TEL.

[40]  Martin Weller,et al.  Learning objects and the e-learning cost dilemma , 2004 .

[41]  Jane Yung-jen Hsu,et al.  Who likes it more?: mining worth-recommending items from long tails by modeling relative preference , 2014, WSDM.

[42]  Carla Limongelli,et al.  A Teaching-Style Based Social Network for Didactic Building and Sharing , 2013, AIED.

[43]  Rob Koper,et al.  Using the IMS LD Standard to Describe Learning Designs , 2007 .

[44]  Alireza Noruzi,et al.  Folksonomies: Why do we need controlled vocabulary? , 2007, Webology.

[45]  Guy Shani,et al.  Evaluating Recommendation Systems , 2011, Recommender Systems Handbook.

[46]  Robin D. Burke,et al.  Hybrid Web Recommender Systems , 2007, The Adaptive Web.

[47]  Alexandros Nanopoulos,et al.  Social tagging in recommender systems: a survey of the state-of-the-art and possible extensions , 2010, Artificial Intelligence Review.

[48]  Leanne Cameron.  Documenting learning environments and experiences , 2007 .

[49]  Nava Tintarev,et al.  Evaluating the effectiveness of explanations for recommender systems , 2012, User Modeling and User-Adapted Interaction.

[50]  James Dalziel,et al.  Implementing learning design : a decade of lessons learned , 2013 .

[51]  Franca Garzotto,et al.  Looking for "Good" Recommendations: A Comparative Evaluation of Recommender Systems , 2011, INTERACT.

[52]  Raja Chiky,et al.  Personalized recommender system for e-Learning environment , 2016, Education and Information Technologies.

[53]  Gráinne Conole,et al.  A learning design toolkit to create pedagogically effective learning activities. (in Special Issue on Advances in Learning Design) , 2005 .

[54]  M. Xenos,et al.  Assisting tutors at the Hellenic Open University in the processes of designing , planning , managing and reusing learning activities , 2009 .

[55]  Miquel Palmer,et al.  Correlational patterns between invertebrate species composition and the presence of an invasive plant , 2004 .

[56]  Sean M. McNee,et al.  Being accurate is not enough: how accuracy metrics have hurt recommender systems , 2006, CHI Extended Abstracts.

[57]  Pasquale Lops,et al.  Personalized finance advisory through case-based recommender systems and diversification strategies , 2015, Decis. Support Syst..

[58]  Philippa Levy,et al.  Designing for inquiry-based learning with the Learning Activity Management System , 2009, J. Comput. Assist. Learn..

[59]  Demetrios G. Sampson,et al.  Learning Object Recommendations for Teachers Based On Elicited ICT Competence Profiles , 2016, IEEE Transactions on Learning Technologies.

[60]  Davinia Hernández Leo,et al.  ILDE: Community Environment for Conceptualizing, Authoring and Deploying Learning Activities , 2014, EC-TEL.

[61]  Miquel Sànchez-Marrè,et al.  A Case-Based Recommendation Approach for Market Basket Data , 2015, IEEE Intelligent Systems.

[62]  Koraljka Golub,et al.  EnTag: enhancing social tagging for discovery , 2009, JCDL '09.

[63]  Deborah Richards,et al.  Applying Learning Design concepts to problem-based learning , 2008 .

[64]  Chris Pegler.  Herzberg, hygiene and the motivation to reuse: Towards a three-factor theory to explain motivation to share and use OER , 2012 .

[65]  Chhavi Rana,et al.  Diversity in Recommender System , 2013 .

[66]  Juan I. Asensio-Pérez,et al.  User-Centered Design: Supporting Learning Designs’ Versioning in a Community Platform , 2016 .

[67]  Hong Joo Lee,et al.  Use of social network information to enhance collaborative filtering performance , 2010, Expert Syst. Appl..

[68]  Katrien Verbert,et al.  Panorama of Recommender Systems to Support Learning , 2015, Recommender Systems Handbook.

[69]  Davinia Hernández Leo,et al.  A Framework for the Conceptualization of Approaches to "Create-by-Reuse" of Learning Design Solutions , 2007, J. Univers. Comput. Sci..

[70]  Simon Walker,et al.  PROMOTING INSTITUTIONAL CHANGE: EMBEDDING LEARNING DESIGN USING LAMS IN ESOL , 2009 .

[71]  Guy Shani,et al.  A Survey of Accuracy Evaluation Metrics of Recommendation Tasks , 2009, J. Mach. Learn. Res..

[72]  Brock Craft,et al.  Editorial: The art and science of learning design , 2013 .

[73]  Tevfik Aytekin,et al.  Clustering-based diversity improvement in top-N recommendation , 2013, Journal of Intelligent Information Systems.

[74]  George Siemens.  Connectivism: A Learning Theory for the Digital Age , 2004 .

[75]  Derek Molloy,et al.  A Virtual Learning Process Environment and Comparison with Conventional E-Learning Systems , 2014 .

[76]  George D. Magoulas,et al.  A Review, Timeline, and Categorization of Learning Design Tools , 2016, ICWL.

[77]  Henda Chorfi,et al.  MOOC-Rec: A Case Based Recommender System for MOOCs☆ , 2015 .

[78]  A. Pritchard.  Ways of Learning: Learning Theories and Learning Styles in the Classroom , 2006 .

[79]  Sandra Wills,et al.  A Deeper Understanding of Reuse: Learning Designs, Activities, Resources and their Contexts , 2016 .

[80]  R. McCormick,et al.  An evaluation of European learning objects in use , 2006 .

[81]  Sue Bennett,et al.  Technology tools to support learning design: Implications derived from an investigation of university teachers' design practices , 2015, Comput. Educ..

[82]  Jonathan L. Herlocker,et al.  Evaluating collaborative filtering recommender systems , 2004, TOIS.

[83]  Fernando Ortega,et al.  A collaborative filtering approach to mitigate the new user cold start problem , 2012, Knowl. Based Syst..

[84]  Brock Craft,et al.  A constructionist learning environment for teachers to model learning designs , 2013, J. Comput. Assist. Learn..

[85]  Matevz Kunaver,et al.  Diversity in recommender systems - A survey , 2017, Knowl. Based Syst..

[86]  Pasquale Lops,et al.  Integrating tags in a semantic content-based recommender , 2008, RecSys '08.

[87]  Ernie Ghiglione,et al.  Cloudworks as a 'pedagogical wrapper' for LAMS sequences: supporting the sharing of ideas across professional boundaries and facilitating collaborative design, evaluation and critical reflection , 2010 .

[88]  Michael Derntl,et al.  The Conceptual Structure of IMS Learning Design Does Not Impede Its Use for Authoring , 2012, IEEE Transactions on Learning Technologies.

[89]  Matt Bower,et al.  A Comparison of LAMS and Moodle as learning design technologies - teacher education students' perspective , 2011 .

[90]  George Veletsianos,et al.  Emergence and Innovation in Digital Learning , 2016 .

[91]  Barry Harper,et al.  An examination of learning design descriptions in a repository , 2009 .

[92]  Wahidah Husain,et al.  The development of personalized wellness therapy recommender system using hybrid case-based reasoning , 2010, 2010 2nd International Conference on Computer Technology and Development.

[93]  Yang Guo,et al.  A survey of collaborative filtering based social recommender systems , 2014, Comput. Commun..

[94]  Sandra Wills,et al.  Reusability of Online Role Play: Learning Objects or Learning Designs? , 2009 .

[95]  Niall Winters,et al.  Design approaches in technology-enhanced learning , 2007, Interact. Learn. Environ..

[96]  Wesley W. Chu,et al.  A Social Network-Based Recommender System (SNRS) , 2010, Data Mining for Social Network Data.

[97]  Spyros Papadakis,et al.  Supporting Electronic Collaborative Experiences at Universities Based on Learning Spaces and LAMS , 2017, Int. J. e Collab..

[98]  Gregory V. Bard,et al.  Spelling-Error Tolerant, Order-Independent Pass-Phrases via the Damerau-Levenshtein String-Edit Distance Metric , 2007, ACSW.

[99]  Yuefeng Li,et al.  The state-of-the-art in personalized recommender systems for social networking , 2012, Artificial Intelligence Review.