Assessing the Impact of the Combination of Self-directed Learning, Immediate Feedback and Visualizations on Student Engagement in Online Learning

This paper introduces OPEL, a novel Online Learning Environment currently used by undergraduate university students to learn SQL programming and database design as part of their degree program. As student engagement in online learning remains a key challenge faced by researchers, this work aims to support learner engagement through self-directed learning coupled with immediate student feedback and personalized visual dashboards. The self-directed learning supported by OPEL enables students to find and use online resources of their choice, including papers, books, tutorials, and videos to study the topics defined in the course curriculum. The feedback provides learners with advice immediately after exercises are submitted and the personalized visual dashboards enable the students to scrutinize and explore their learning activity data and their knowledge models. An evaluation is discussed which compares the engagement of the students using OPEL against its predecessor (an online learning environment used for the same module in previous years but did not support self-directed learning or immediate feedback).

[1]  John Steele,et al.  Five Elements that Impact Quality Feedback in the Online Asynchronous Classroom , 2018, Journal of Educators Online.

[2]  Judy Kay,et al.  Open learner models and learning analytics dashboards: a systematic review , 2018, LAK.

[3]  Erik Duval,et al.  The student activity meter for awareness and self-reflection , 2012, CHI Extended Abstracts.

[4]  Owen Conlan,et al.  Supporting Student Engagement Through Explorable Visual Narratives , 2018, IEEE Transactions on Learning Technologies.

[5]  Laura Gibson.  Student-Directed Learning: An Exercise in Student Engagement , 2011 .

[6]  Athanasios Staikopoulos,et al.  Motivating Students to Enhance Their Knowledge Levels Through Personalized and Scrutable Visual Narratives , 2018, EC-TEL.

[7]  Marcia D. Dixson.  Measuring Student Engagement in the Online Course: The Online Student Engagement Scale (OSE). , 2015 .

[8]  J. Hattie,et al.  The Power of Feedback , 2007 .

[9]  Xin Chen,et al.  Checkable answers: Understanding student behaviors with instant feedback in a blended learning class , 2015, 2015 IEEE Frontiers in Education Conference (FIE).

[10]  Birgitta König-Ries,et al.  Progressor: social navigation support through open social student modeling , 2013, New Rev. Hypermedia Multim..

[11]  Vincent P. Wade,et al.  AMASE: A framework for supporting personalised activity-based learning on the web , 2014, Comput. Sci. Inf. Syst..

[12]  Mykola Pechenizkiy,et al.  Tailoring Feedback in Online Assessment: Influence of Learning Styles on the Feedback Preferences and Elaborated Feedback Effectiveness , 2008, 2008 Eighth IEEE International Conference on Advanced Learning Technologies.

[13]  George D. Kuh.  Assessing What Really Matters to Student Learning Inside The National Survey of Student Engagement , 2001 .

[14]  Vincent P. Wade,et al.  Enhancing Student Engagement through Personalized Motivations , 2015, 2015 IEEE 15th International Conference on Advanced Learning Technologies.

[15]  Curtis J. Bonk,et al.  Motivational factors in self-directed informal learning from online learning resources , 2016 .

[16]  Leonard Barolli,et al.  A web-based e-learning system for increasing study efficiency by stimulating learner’s motivation , 2006, Inf. Syst. Frontiers.

[17]  Curtis J. Bonk,et al.  Motivations, Achievements, and Challenges of Self-Directed Informal Learners in Open Educational Environments and MOOCs , 2017, Journal of Learning for Development.

[18]  Jessica Sandland,et al.  The Influence of Immediate Homework Feedback on Student Performance and Satisfaction in an Engineering MOOC , 2018, 2018 Learning With MOOCS (LWMOOCS).

[19]  Lorne Olfman,et al.  Leveraging a personalized system to improve self-directed learning in online educational environments , 2014, Comput. Educ..

[20]  Jeff Grann,et al.  Competency map: visualizing student learning to promote student success , 2014, LAK.

[21]  Shirley Williams,et al.  A Design for Generating Personalised Feedback in Knowledge Construction , 2005, ICWL.

[22]  Michael I. Jordan,et al.  Latent Dirichlet Allocation , 2001, J. Mach. Learn. Res..

[23]  Katy Jordan,et al.  Initial trends in enrolment and completion of massive open online courses , 2014 .

[24]  Daniel L. Schwartz,et al.  Choosing versus Receiving Feedback: The Impact of Feedback Valence on Learning in an Assessment Game , 2016, EDM.

[25]  Erik Duval,et al.  Addressing learner issues with StepUp!: an evaluation , 2013, LAK '13.

[26]  Neil T. Heffernan,et al.  Detection and Analysis of Off-Task Gaming Behavior in Intelligent Tutoring Systems , 2006, Intelligent Tutoring Systems.

[27]  Erik Duval,et al.  Goal-oriented visualizations of activity tracking: a case study with engineering students , 2012, LAK.

[28]  Maren Scheffel,et al.  Awareness Is Not Enough: Pitfalls of Learning Analytics Dashboards in the Educational Practice , 2017, EC-TEL.

[29]  Chien Chou,et al.  Learner readiness for online learning: Scale development and student perceptions , 2010, Comput. Educ..

[30]  Binshan Lin,et al.  Web-based teaching and learner control: a research review , 2001, Comput. Educ..

[31]  Alan F. Smeaton,et al.  An Exploratory Study on Student Engagement with Adaptive Notifications in Programming Courses , 2018, EC-TEL.

[32]  G. Brosvic,et al.  Immediate Feedback during Academic Testing , 2001, Psychological reports.

[33]  Daphne Koller,et al.  Self-Driven Mastery in Massive Open Online Courses , 2013 .

[34]  Beverly Park Woolf,et al.  Repairing Disengagement With Non-Invasive Interventions , 2007, AIED.