RiPPLE: A Crowdsourced Adaptive Platform for Recommendation of Learning Activities

This paper presents a platform called RiPPLE (Recommendation in Personalised Peer-Learning Environments) that recommends personalized learning activities to students based on their knowledge state from a pool of crowdsourced learning activities that are generated by educators and the students themselves. RiPPLE integrates insights from crowdsourcing, learning sciences, and adaptive learning, aiming to narrow the gap between these large bodies of research while providing a practical platform-based implementation that instructors can easily use in their courses. This paper provides a design overview of RiPPLE, which can be employed as a standalone tool or embedded into any learning management system (LMS) or online platform that supports the Learning Tools Interoperability (LTI) standard. The platform has been evaluated based on a pilot in an introductory course with 453 students at The University of Queensland. Initial results suggest that the use of the \name platform led to measurable learning gains and that students perceived the platform as beneficially supporting their learning.

[1]  Sheizaf Rafaeli,et al.  On-line question-posing and peer-assessment as means for web-based knowledge sharing in learning , 2004, Int. J. Hum. Comput. Stud..

[2]  Ross K. Galloway,et al.  Student-generated content: using PeerWise to enhance engagement and outcomes in introductory physics courses , 2012 .

[3]  K. VanLehn The Relative Effectiveness of Human Tutoring, Intelligent Tutoring Systems, and Other Tutoring Systems , 2011 .

[4]  B. Bloom,et al.  Taxonomy of Educational Objectives. Handbook I: Cognitive Domain , 1966 .

[5]  Alfred Essa A possible future for next generation adaptive learning systems , 2016, Smart Learning Environments.

[6]  Peter Brusilovsky,et al.  Adaptive Technologies for Training and Education: Adaptive Hypermedia for Education and Training , 2012 .

[7]  Vladimir Zadorozhny,et al.  Adaptive Social Learning Based on Crowdsourcing , 2017, IEEE Transactions on Learning Technologies.

[8]  Albert T. Corbett,et al.  Cognitive Tutor: Applied research in mathematics education , 2007, Psychonomic bulletin & review.

[9]  Hassan Khosravi,et al.  RiPLE: Recommendation in Peer-Learning Environments Based on Knowledge Gaps and Interests , 2017, EDM.

[10]  Jacob Cohen,et al.  A power primer. , 1992, Psychological bulletin.

[11]  Jacob Whitehill,et al.  Do Learners Know What's Good for Them? Crowdsourcing Subjective Ratings of OERs to Predict Learning Gains , 2019, EDM.

[12]  John Hamer,et al.  Students sharing and evaluating MCQs in a large first year engineering course , 2009 .

[13]  Briana B. Morrison,et al.  Khan academy gamifies computer science , 2014, SIGCSE.

[14]  Catherine Mulryan-Kyne,et al.  Teaching large classes at college and university level: challenges and opportunities , 2010 .

[15]  Linda Darling-Hammond,et al.  Teaching Diverse Learners , 2016 .

[16]  Kelly E. Matthews,et al.  Five Propositions for Genuine Students as Partners Practice , 2017 .

[17]  Jean-Claude Falmagne,et al.  The Assessment of Knowledge, in Theory and in Practice , 2006, ICFCA.

[18]  Hassan Khosravi,et al.  Graph-based visual topic dependency models: supporting assessment design and delivery at scale , 2018, LAK.

[19]  P. Austin An Introduction to Propensity Score Methods for Reducing the Effects of Confounding in Observational Studies , 2011, Multivariate behavioral research.

[20]  A. King Facilitating Elaborative Learning Through Guided Student-Generated Questioning , 1992 .

[21]  Catherine Bovill,et al.  Students and staff co-creating curricula - a new trend or an old idea we never got around to implementing? , 2013 .

[22]  David Boud,et al.  Developing evaluative judgement: enabling students to make decisions about the quality of work , 2018 .

[23]  Neil T. Heffernan,et al.  The ASSISTments Ecosystem: Building a Platform that Brings Scientists and Teachers Together for Minimally Invasive Research on Human Learning and Teaching , 2014, International Journal of Artificial Intelligence in Education.

[24]  Beat Kleiner,et al.  Graphical Methods for Data Analysis , 1983 .

[25]  B. Bloom Taxonomy of educational objectives , 1956 .

[26]  Judy Kay,et al.  Open learner models and learning analytics dashboards: a systematic review , 2018, LAK.

[27]  Neil T. Heffernan,et al.  The Future of Adaptive Learning: Does the Crowd Hold the Key? , 2016, International Journal of Artificial Intelligence in Education.

[28]  Olusola O. Adesope,et al.  Intelligent tutoring systems and learning outcomes: A meta-analysis , 2014 .

[29]  Gail M Sullivan,et al.  Getting off the "gold standard": randomized controlled trials and education research. , 2011, Journal of graduate medical education.

[30]  John R. Anderson,et al.  Cognitive Tutors: Lessons Learned , 1995 .

[31]  Dragan Gasevic,et al.  A Multivariate ELO-based Learner Model for Adaptive Educational Systems , 2019, EDM.

[32]  Mandy Lupton,et al.  Designing for student-facing learning analytics , 2017 .

[33]  Hassan Khosravi,et al.  Topic Dependency Models: Graph-Based Visual Analytics for Communicating Assessment Data , 2018, J. Learn. Anal..

[34]  John Hamer,et al.  The quality of a PeerWise MCQ repository , 2010, ACE '10.

[35]  John M. Chambers,et al.  Graphical Methods for Data Analysis , 1983 .

[36]  Ok-Choon Park,et al.  Adaptive Instructional Systems , 2007 .

[37]  Rishi Desai,et al.  Crowdsourcing for assessment items to support adaptive learning , 2018, Medical teacher.

[38]  Frank C. Gomez,et al.  Rethinking Education in the Age of Technology: The Digital Revolution and Schooling in America , 2016 .

[39]  Susan Bull,et al.  Introduction of learning visualisations and metacognitive support in a persuadable open learner model , 2016, LAK.

[40]  Ryan S. Baker,et al.  Studying Adaptive Learning Efficacy using Propensity Score Matching , 2018 .

[41]  Albert T. Corbett,et al.  Intelligent Tutoring Systems , 1985, Science.

[42]  D. Rubin,et al.  The central role of the propensity score in observational studies for causal effects , 1983 .

[43]  Amanda Chapman,et al.  Co-creation of Marking Criteria: Students as Partners in the Assessment ProcessCo-creation of Marking Criteria: Students as Partners in the Assessment Process , 2014 .

[44]  Sébastien George,et al.  TrAVis to enhance online tutoring and learning activities: Real-time visualization of students tracking data , 2011, Interact. Technol. Smart Educ..

[45]  Simon Burns,et al.  Doing it for themselves: students creating a high quality peer-learning environment , 2015 .

[46]  Burak Yilmaz,et al.  Effects of Adaptive Learning Technologies on Math Achievement: A Quantitative Study of ALEKS Math Software , 2017 .

[47]  R. Anwar,et al.  A Review of the Uses of Crowdsourcing in Higher Education , 2013 .

[48]  Paul Denny,et al.  Formative student-authored question bank: perceptions, question quality and association with summative performance , 2017, Postgraduate Medical Journal.

[49]  J. Biggs What the student does: teaching for enhanced learning , 1999 .

[50]  Judy Kay,et al.  Open Learner Models , 2010, Advances in Intelligent Tutoring Systems.

[51]  John Hamer,et al.  PeerWise: students sharing their multiple choice questions , 2008, ICER '08.

[52]  Peter Brusilovsky,et al.  User Models for Adaptive Hypermedia and Adaptive Educational Systems , 2007, The Adaptive Web.

[53]  Neil T. Heffernan,et al.  AXIS: Generating Explanations at Scale with Learnersourcing and Machine Learning , 2016, L@S.

[54]  Stephen W. Draper,et al.  Catalytic assessment: understanding how MCQs and EVS can foster deep learning , 2009, Br. J. Educ. Technol..

[55]  Simon Bates,et al.  Assessing the quality of a student-generated question repository , 2013, 1308.2202.

[56]  J. Bransford,et al.  Preparing Teachers for a Changing World: What Teachers Should Learn and Be Able to Do. , 2005 .

[57]  Radek Pelanek,et al.  Applications of the Elo rating system in adaptive educational systems , 2016, Comput. Educ..

[58]  Eileen Wood,et al.  Encouraging Mindful Use of Prior Knowledge: Attempting to Construct Explanatory Answers Facilitates Learning , 1992 .