Progressive assessment of student engagement with web-based guided learning

Purpose – The purpose of this research is to investigate student engagement in guided web‐based learning systems. It looks into students' engagement and their behavioral patterns in two types of guided learning systems (i.e. a fully‐ and a partially‐guided). The research also aims to demonstrate how the engagement evolves from the beginning towards the end of the interactions; which enables analysis to be performed on the quality of engagement.Design/methodology/approach – An experimental study was conducted on 41 students from a public university in Malaysia using two web‐based systems as the main learning tools. The students' engagement data were captured three times during the interactions and once at the end of the experimental study using student self‐report.Findings – The main outcome of this study suggests that student engagement was changing over time either in positive or negative patterns. The directions of change in both types of guided learning were mainly influenced by the students' backgroun...

[1]  Theodore J. Kopcha,et al.  Learner preferences and prior knowledge in learner-controlled computer-based instruction , 2008 .

[2]  Mykola Pechenizkiy,et al.  Defining Adaptation in a Generic Multi Layer Model: CAM: The GRAPPLE Conceptual Adaptation Model , 2008, EC-TEL.

[3]  Saïd Assar,et al.  Student Learning Styles Adaptation Method Based on Teaching Strategies and Electronic Media , 2008, 2008 Eighth IEEE International Conference on Advanced Learning Technologies.

[4]  B. Patterson,et al.  Attrition in Online and Campus Degree Programs. , 2009 .

[5]  Chih-Ming Chen,et al.  Personalized curriculum sequencing utilizing modified item response theory for web-based instruction , 2006, Expert Syst. Appl..

[6]  Zoran Budimac,et al.  E-Learning personalization based on hybrid recommendation strategy and learning style identification , 2011, Comput. Educ..

[7]  J. Sweller,et al.  Why Minimally Guided Teaching Techniques Do Not Work: A Reply to Commentaries , 2007 .

[8]  Mia Stern,et al.  Curriculum Sequencing in a Web-Based Tutor , 1998, Intelligent Tutoring Systems.

[9]  Peter Brusilovsky,et al.  Adaptive navigation support in educational hypermedia: the role of student knowledge level and the case for meta-adaptation , 2003, Br. J. Educ. Technol..

[10]  Gordon I. McCalla,et al.  Smart Recommendation for an Evolving E-Learning System: Architecture and Experiment , 2005 .

[11]  Slava Kalyuga,et al.  Expertise reversal effect and its instructional implications: introduction to the special issue , 2010 .

[12]  Yu-Liang Chi,et al.  Ontology-based curriculum content sequencing system with semantic rules , 2009, Expert Syst. Appl..

[13]  Richard E. Clark,et al.  Why Minimal Guidance During Instruction Does Not Work: An Analysis of the Failure of Constructivist, Discovery, Problem-Based, Experiential, and Inquiry-Based Teaching , 2006 .

[14]  M. Csíkszentmihályi.  Beyond boredom and anxiety , 1975 .

[15]  Jonathan W. Palmer,et al.  Web Site Usability, Design, and Performance Metrics , 2002, Inf. Syst. Res..

[16]  Norliza Katuk,et al.  Does a Longer Usage Mean Flow Experience? An Evaluation of Learning Experience with Curriculum Sequencing Systems (CSS) , 2011, 2011 Sixth IEEE International Symposium on Electronic Design, Test and Application.

[17]  Nicola Henze,et al.  Setting up a framework for comparing adaptive educational hypermedia: First steps and application on curriculum sequencing , 2002 .

[18]  Sanja Maravic Cisar,et al.  Examples of adaptive Web-based educational systems , 2009, 2009 7th International Symposium on Intelligent Systems and Informatics.

[19]  Fan Zhu,et al.  PeRES: A Personalized Recommendation Education System Based on Multi-agents & SCORM , 2007, ICWL.

[20]  Angeliki Poulymenakou,et al.  Developing a Usability Evaluation Method for e-Learning Applications: Beyond Functional Usability , 2009, Int. J. Hum. Comput. Interact..

[21]  Slava Kalyuga,et al.  The Expertise Reversal Effect , 2003 .

[22]  Arthur C. Graesser,et al.  Better to be frustrated than bored: The incidence, persistence, and impact of learners' cognitive-affective states during interactions with three different computer-based learning environments , 2010, Int. J. Hum. Comput. Stud..

[23]  Richard E. Mayer,et al.  Multimedia Learning: INTRODUCTION TO MULTIMEDIA LEARNING , 2009 .

[24]  C.-I. Pena,et al.  Curriculum sequencing for an e-learning system based on learning styles , 2004, Information Technology Based Proceedings of the FIfth International Conference onHigher Education and Training, 2004. ITHET 2004..

[25]  Paloma Martínez,et al.  Learning Content Sequencing in an Educational Environment According to Student Needs , 2004, ALT.

[26]  Pamela B. Lawhead,et al.  Curriculum sequencing using quizzes and statistics , 2004 .

[27]  Lorraine Angelino,et al.  Strategies to Engage Online Students and Reduce Attrition Rates. , 2007 .

[28]  E. Toms,et al.  What is user engagement? A conceptual framework for defining user engagement with technology , 2008, J. Assoc. Inf. Sci. Technol..

[29]  Hokyoung Ryu,et al.  To Flow and Not to Freeze: Applying Flow Experience to Mobile Learning , 2010, IEEE Transactions on Learning Technologies.

[30]  M. Csíkszentmihályi.  Flow. The Psychology of Optimal Experience. New York (HarperPerennial) 1990. , 1990 .

[31]  Norliza Katuk,et al.  Learning experience in dynamic and non-dynamic curriculum sequencing systems : a thesis presented in partial fulfilment of the requirements for the degree of Doctor of Philosophy in Information Technology at Massey University , 2012 .

[32]  Peter Brusilovsky,et al.  Layered evaluation of adaptive learning systems , 2004 .

[33]  M. Csíkszentmihályi.  Flow: The Psychology of Optimal Experience , 1990 .

[34]  Robert D. Macredie,et al.  Navigation in hypermedia learning systems: experts vs. novices , 2006, Comput. Hum. Behav..

[35]  Lena Paulo Kushnir,et al.  Think Before You Link: Understanding the Effects of Hypertext on Student Learning Outcomes and Reports of Overload , 2010 .

[36]  M. Csíkszentmihályi.  Finding Flow: The Psychology of Engagement with Everyday Life , 1997 .

[37]  J. Webster,et al.  The Dimensionality and Correlates of Flow in Human-Computer Interactions. , 1993 .

[38]  B. Schneider,et al.  Engaged in Engagement: We Are Delighted We Did It , 2008, Industrial and Organizational Psychology.