Learner Engagement in Blended Learning Environments: A Conceptual Framework

Learner engagement correlates with important educational outcomes, including academic achievement and satisfaction.  Although research is already exploring learner engagement in blended contexts, no theoretical framework guides inquiry or practice, and little consistency or specificity exists in engagement definitions and operationalizations.  Developing definitions, models, and measures of the factors that indicate learner engagement is important to establishing whether changes in instructional methods (facilitators) result in improved engagement (measured via indicators).  This article reviews the existing literature on learner engagement and identifies constructs most relevant to learning in general and blended learning in particular.  We present a possible conceptual framework for engagement that includes cognitive and emotional indicators, offering examples of research measuring these engagement indicators in technology-mediated learning contexts.  Finally, we suggest future studies to test the framework, which we believe can support advances in blended learning engagement research that is increasingly real-time, minimally intrusive, and maximally generalizable across subject matter contexts.

[1]  Richard L. Hazlett,et al.  Measuring emotional valence to understand the user's experience of software , 2007, Int. J. Hum. Comput. Stud..

[2]  V. Shute Focus on Formative Feedback , 2008 .

[3]  Charles R. Graham,et al.  Exploring the potential of LMS log data as a proxy measure of student engagement , 2017, Journal of Computing in Higher Education.

[4]  B. Fredrickson What Good Are Positive Emotions? , 1998, Review of general psychology : journal of Division 1, of the American Psychological Association.

[5]  Jason W. Osborne,et al.  Best practices in exploratory factor analysis: four recommendations for getting the most from your analysis. , 2005 .

[6]  J. Connell,et al.  Relationships matter: linking teacher support to student engagement and achievement. , 2004, The Journal of school health.

[7]  Corwin Senko,et al.  Pursuing their own learning agenda: How mastery-oriented students jeopardize their class performance , 2008 .

[8]  Robert M. Gonyea,et al.  Unmasking the Effects of Student Engagement on First-Year College Grades and Persistence , 2008 .

[9]  J. Dewey,et al.  How We Think , 2009 .

[10]  Jonathan P. Rowe,et al.  Integrating Learning, Problem Solving, and Engagement in Narrative-Centered Learning Environments , 2011, Int. J. Artif. Intell. Educ..

[11]  Robert Rueda,et al.  Situational interest, computer self-efficacy and self-regulation: Their impact on student engagement in distance education , 2012, Br. J. Educ. Technol..

[12]  Ruth V. Small,et al.  Curiosity, interest and engagement in technology-pervasive learning environments: a new research agenda , 2011 .

[13]  F. Floyd,et al.  Factor analysis in the development and refinement of clinical assessment instruments. , 1995 .

[14]  J. Reeve,et al.  Agency as a fourth aspect of students engagement during learning activities , 2011 .

[15]  Rosalind W. Picard,et al.  An affective model of interplay between emotions and learning: reengineering educational pedagogy-building a learning companion , 2001, Proceedings IEEE International Conference on Advanced Learning Technologies.

[16]  Robert W. Brennan,et al.  Life-long learning, conscientious disposition, and longitudinal measures of academic engagement in engineering design teamwork , 2015 .

[17]  Arthur C. Graesser,et al.  AutoTutor and affective autotutor: Learning by talking with cognitively and emotionally intelligent computers that talk back , 2012, TIIS.

[18]  M. Nystrand,et al.  Instructional Discourse, Student Engagement, and Literature Achievement , 1991, Research in the Teaching of English.

[19]  P. Pintrich A Manual for the Use of the Motivated Strategies for Learning Questionnaire (MSLQ). , 1991 .

[20]  M. Mehl,et al.  Handbook of research methods for studying daily life , 2012 .

[21]  S. Segura,et al.  How do respondents construe ambiguous response formats of affect items? , 2003, Journal of personality and social psychology.

[22]  Larry D. Yore,et al.  The Effects of Embedded Monitoring and Regulating Devices on the Achievement of High School Students Learning Science From Text , 1997 .

[23]  Heather Kanuka,et al.  Learning in Safety and Comfort: Towards Managing On-Line Learning Transactions , 1999 .

[24]  James M. McPartland,et al.  High School Reform and Student Engagement , 2012 .

[25]  A. Tellegen,et al.  Openness to absorbing and self-altering experiences ("absorption"), a trait related to hypnotic susceptibility. , 1974, Journal of abnormal psychology.

[26]  Nancy L. Stein,et al.  Making sense out of emotion: The representation and use of goal-structured knowledge. , 1990 .

[27]  Mary Ainley,et al.  Students’ Interest and Engagement in Classroom Activities , 2012 .

[28]  P. Pintrich,et al.  Motivational and self-regulated learning components of classroom academic performance. , 1990 .

[29]  James J. Appleton,et al.  Measuring cognitive and psychological engagement: Validation of the Student Engagement Instrument , 2006 .

[30]  Charles R. Graham,et al.  Measuring student engagement in technology-mediated learning: A review , 2015, Comput. Educ..

[31]  Arthur C. Graesser,et al.  Confusion and complex learning during interactions with computer learning environments , 2012, Internet High. Educ..

[32]  A. Parks,et al.  Increasing Happiness in the General Population: Empirically Supported Self-help? , 2013 .

[33]  A. Graesser,et al.  Confusion can be beneficial for learning. , 2014 .

[34]  Pamela Campanelli,et al.  Testing Survey Questions , 2008 .

[35]  Susan Leigh Star,et al.  Institutional Ecology, `Translations' and Boundary Objects: Amateurs and Professionals in Berkeley's Museum of Vertebrate Zoology, 1907-39 , 1989 .

[36]  James J. Appleton,et al.  Student engagement with school: Critical conceptual and methodological issues of the construct. , 2008 .

[37]  Kennon M. Sheldon,et al.  Teacher support, student motivation, student need satisfaction, and college teacher course evaluations: testing a sequential path model , 2008 .

[38]  B. Fredrickson The role of positive emotions in positive psychology. The broaden-and-build theory of positive emotions. , 2001, The American psychologist.

[39]  Michel Janosz,et al.  Part IV commentary: Outcomes of engagement and engagement as an outcome: Some consensus, divergences, and unanswered questions. , 2012 .

[40]  George D. Kuh The national survey of student engagement: Conceptual and empirical foundations , 2009 .

[41]  Kasia Muldner,et al.  Emotion Sensors Go To School , 2009, AIED.

[42]  Jacquelynne S. Eccles,et al.  School context, achievement motivation, and academic engagement: A longitudinal study of school engagement using a multidimensional perspective , 2013 .

[43]  Ming-Te Wang,et al.  Staying Engaged: Knowledge and Research Needs in Student Engagement. , 2014, Child development perspectives.

[44]  J. Russell Core affect and the psychological construction of emotion. , 2003, Psychological review.

[45]  Allison Littlejohn,et al.  Merlot Journal of Online Learning and Teaching Patterns of Engagement in Connectivist Moocs , 2022 .

[46]  Jerry Chih-Yuan Sun,et al.  Influence of polling technologies on student engagement: An analysis of student motivation, academic performance, and brainwave data , 2014, Comput. Educ..

[47]  Andrew J. Martin Examining a multidimensional model of student motivation and engagement using a construct validation approach. , 2007, The British journal of educational psychology.

[48]  James C. Lester,et al.  Modeling Learner Affect with Theoretically Grounded Dynamic Bayesian Networks , 2011, ACII.

[49]  David P. Diaz Online Drop Rate Revisited , 2002 .

[50]  Elaine Toms,et al.  What is user engagement? A conceptual framework for defining user engagement with technology , 2008, J. Assoc. Inf. Sci. Technol..

[51]  James Appleton Systems Consultation: Developing the Assessment-to-Intervention Link with the Student Engagement Instrument , 2012 .

[52]  S. D’Mello A selective meta-analysis on the relative incidence of discrete affective states during learning with technology , 2013 .

[53]  G. Ladd,et al.  Continuity and Change in Early School Engagement: Predictive of Children's Achievement Trajectories from First to Eighth Grade? , 2009, Journal of educational psychology.

[54]  Peter Shea,et al.  Learning presence: Towards a theory of self-efficacy, self-regulation, and the development of a communities of inquiry in online and blended learning environments , 2010, Comput. Educ..

[55]  J. Keller The Arcs Model of Motivational Design , 2010 .

[56]  Ryan S. Baker,et al.  The Potentials of Educational Data Mining for Researching Metacognition, Motivation and Self-Regulated Learning , 2013, EDM 2013.

[57]  J. Hughes,et al.  Teacher-Student Support, Effortful Engagement, and Achievement: A 3-Year Longitudinal Study. , 2008, Journal of educational psychology.

[58]  K. Ann Renninger,et al.  Studying Triggers for Interest and Engagement Using Observational Methods , 2015 .

[59]  D. Spalding The Principles of Psychology , 1873, Nature.

[60]  Lisa Linnenbrink-Garcia,et al.  Academic Emotions and Student Engagement , 2012 .

[61]  B. Zimmerman Becoming a Self-Regulated Learner: An Overview , 2002 .

[62]  Charles R. Graham BLENDED LEARNING SYSTEMS: DEFINITION, CURRENT TRENDS, AND FUTURE DIRECTIONS , 2005 .

[63]  Joseph E. Beck,et al.  Engagement tracing: using response times to model student disengagement , 2005, AIED.

[64]  Gregory Schraw,et al.  Measuring Self-Regulation in Computer-Based Learning Environments , 2010 .

[65]  Catherine Milne,et al.  Understanding engagement: Science demonstrations and emotional energy , 2007 .

[66]  Dirk T. Tempelaar,et al.  How achievement emotions impact students' decisions for online learning, and what precedes those emotions , 2012, Internet High. Educ..

[67]  D. Berlyne Curiosity and learning , 1978 .

[68]  Edward L. Thorndike An Introduction to the Theory of Mental and Social Measurements , 2007 .

[69]  E. Skinner,et al.  Developmental Dynamics of Student Engagement, Coping, and Everyday Resilience , 2012 .

[70]  Hamish Coates,et al.  Student Engagement in Campus-Based and Online Education: University Connections , 2006 .

[71]  W. Briggs,et al.  A Measure of College Student Course Engagement , 2005 .

[72]  J. Connell,et al.  What motivates children's behavior and emotion? Joint effects of perceived control and autonomy in the academic domain. , 1993, Journal of personality and social psychology.

[73]  Frank S. Freeman,et al.  Interpretation of educational measurements , 1928 .

[74]  Kerri-Lee Krause,et al.  Students’ engagement in first‐year university , 2008 .

[75]  P. Pintrich The role of motivation in promoting and sustaining self-regulated learning , 1999 .

[76]  Brian W. Miller Using Reading Times and Eye-Movements to Measure Cognitive Engagement , 2015 .

[77]  S. D’Mello,et al.  All Alone with your Emotions : An Analysis of Student Emotions during Effortful Problem Solving Activities , 2008 .

[78]  Ioannis Arapakis,et al.  Theories, methods and current research on emotions in library and information science, information retrieval and human-computer interaction , 2011, Inf. Process. Manag..

[79]  Chris Piech,et al.  Deconstructing disengagement: analyzing learner subpopulations in massive open online courses , 2013, LAK '13.

[80]  M. Yasar Ozden,et al.  The Optimum Blend: Affordances and Challenges of Blended Learning For Students , 2012 .

[81]  Leandre R. Fabrigar,et al.  Exploratory Factor Analysis , 2011 .

[82]  T. Whipple,et al.  The effects of aging on brand attitude measurement , 2004 .

[83]  S. Deshpande,et al.  Task Characteristics and the Experience of Optimal Flow in Human—Computer Interaction , 1994 .

[84]  Roger Azevedo,et al.  A Meta-Analysis of the Effects of Feedback in Computer-Based Instruction , 1995 .

[85]  Robert L. Bangert-Drowns,et al.  A Taxonomy of Student Engagement with Educational Software: An Exploration of Literate Thinking with Electronic Text , 2001 .

[86]  Suzanne Hidi,et al.  Interest and Its Contribution as a Mental Resource for Learning , 1990 .

[87]  George D. Kuh,et al.  Student Experiences With Information Technology And Their Relationship To Other Aspects Of Student Engagement , 2005 .

[88]  P. Ekman An argument for basic emotions , 1992 .

[89]  D. Garrison,et al.  Blended learning: Uncovering its transformative potential in higher education , 2004, Internet High. Educ..

[90]  T. Kindermann,et al.  A Motivational Perspective on Engagement and Disaffection , 2009 .

[91]  Siu Cheung Kong,et al.  An evaluation study of the use of a cognitive tool in a one-to-one classroom for promoting classroom-based dialogic interaction , 2011, Comput. Educ..

[92]  Hamish Coates,et al.  A model of online and general campus‐based student engagement , 2007 .

[93]  Charles R. Graham,et al.  A thematic analysis of the most highly cited scholarship in the first decade of blended learning research , 2014, Internet High. Educ..

[94]  Martin E. P. Seligman,et al.  Positive education: positive psychology and classroom interventions , 2009 .

[95]  K. Lewin Field theory in social science , 1951 .

[96]  Benjamin C. Heddy,et al.  The Challenges of Defining and Measuring Student Engagement in Science , 2015 .

[97]  D. Garrison,et al.  Critical thinking, cognitive presence, and computer conferencing in distance education , 2001 .

[98]  Francisco J. Martínez-López,et al.  Modelling students' flow experiences in an online learning environment , 2014, Comput. Educ..

[99]  W. Spirduso,et al.  Proposals That Work: A Guide for Planning Dissertations and Grant Proposals , 1987 .

[100]  Arthur C. Graesser,et al.  Question asking and eye tracking during cognitive disequilibrium: Comprehending illustrated texts on devices when the devices break down , 2005, Memory & cognition.

[101]  Arthur C. Graesser,et al.  Better to be frustrated than bored: The incidence, persistence, and impact of learners' cognitive-affective states during interactions with three different computer-based learning environments , 2010, Int. J. Hum. Comput. Stud..

[102]  S. Christenson,et al.  Jingle, Jangle, 1 and Conceptual Haziness 2 : Evolution and Future Directions of the Engagement Construct , 2012 .

[103]  Anthony G. Picciano Big Data and Learning Analytics in Blended Learning Environments: Benefits and Concerns , 2014, Int. J. Interact. Multim. Artif. Intell..

[104]  A. Astin Student involvement: A developmental theory for higher education. , 1999 .

[105]  E. Kahu Framing student engagement in higher education , 2013 .

[106]  Albert D. Ritzhaupt,et al.  Where should educational technologists publish their research?: An examination of peer-reviewed journals within the field of educational technology and factors influencing publication choice , 2012 .

[107]  David Watson,et al.  Emotions, moods, traits, and temperaments: Conceptual distinctions and empirical findings. , 1994 .

[108]  M. Lepper,et al.  Motivational techniques of expert human tutors: Lessons for the design of computer-based tutors. , 1993 .

[109]  Nicole Fruehauf Flow The Psychology Of Optimal Experience , 2016 .

[110]  George D. Kuh,et al.  Being (Dis)Engaged in Educationally Purposeful Activities: The Influences of Student and Institutional Characteristics , 2002 .

[111]  Thomas T. Liao,et al.  Book Review: Blended: Using Disruptive Innovation to Improve Schools , 2015 .

[112]  Pajares,et al.  Self-Efficacy Beliefs and Mathematical Problem-Solving of Gifted Students , 1996, Contemporary educational psychology.

[113]  T. Kindermann,et al.  Engagement and Disaffection in the Classroom: Part of a Larger Motivational Dynamic? , 2008 .

[114]  Mihaela Cocea,et al.  Disengagement Detection in Online Learning: Validation Studies and Perspectives , 2011, IEEE Transactions on Learning Technologies.

[115]  Omar AlZoubi,et al.  Affect Detection from Multichannel Physiology during Learning Sessions with AutoTutor , 2011, AIED.

[116]  Marie Bienkowski,et al.  Enhancing Teaching and Learning Through Educational Data Mining and Learning Analytics: An Issue Brief , 2012 .

[117]  Wendy McColskey,et al.  Measuring Student Engagement in Upper Elementary through High School: A Description of 21 Instruments. Summary. Issues & Answers. REL 2011-No. 098. , 2011 .

[118]  Shane Dawson,et al.  Mining LMS data to develop an "early warning system" for educators: A proof of concept , 2010, Comput. Educ..

[119]  D. Bergin,et al.  Measuring engagement in fourth to twelfth grade classrooms: the Classroom Engagement Inventory. , 2014, School psychology quarterly : the official journal of the Division of School Psychology, American Psychological Association.

[120]  Sidney D'Mello,et al.  The half-life of cognitive-affective states during complex learning , 2011, Cognition & emotion.

[121]  Reinhard Pekrun,et al.  Emotions as Drivers of Learning and Cognitive Development , 2011 .

[122]  Rebecca V. Frazee Using Relevance To Facilitate Online Participation in a Hybrid Course. , 2003 .

[123]  Matthew J. Koehler,et al.  Technological Pedagogical Content Knowledge: A Framework for Teacher Knowledge , 2006, Teachers College Record: The Voice of Scholarship in Education.

[124]  Angelina KewalRamani,et al.  Trends in High School Dropout and Completion Rates in the United States: 1972-2009. Compendium Report. NCES 2012-006. , 2010 .

[125]  J. Reeve A Self-determination Theory Perspective on Student Engagement , 2012 .

[126]  R. Azevedo Defining and Measuring Engagement and Learning in Science: Conceptual, Theoretical, Methodological, and Analytical Issues , 2015 .

[127]  Katrina A. Meyer,et al.  Student Engagement in Online Learning: What Works and Why , 2014 .

[128]  Lise Getoor,et al.  Modeling Learner Engagement in MOOCs using Probabilistic Soft Logic , 2013 .

[129]  Rebecca Saxe,et al.  Live face-to-face interaction during fMRI: A new tool for social cognitive neuroscience , 2010, NeuroImage.

[130]  C. Dziuban,et al.  Blended learning: A dangerous idea? , 2013, Internet High. Educ..

[131]  M. Furlong,et al.  Multiple Contexts of School Engagement: Moving Toward a Unifying Framework for Educational Research and Practice , 2003 .

[132]  Petrea Redmond,et al.  An Online Engagement Framework for Higher Education , 2018 .

[133]  Daniel Sonntag,et al.  Attention Engagement and Cognitive State Analysis for Augmented Reality Text Display Functions , 2015, IUI.

[134]  Scotty D. Craig,et al.  AutoTutor Detects and Responds to Learners Affective and Cognitive States , 2008 .

[135]  S. Jimerson,et al.  Toward an Understanding of Definitions and Measures of School Engagement and Related Terms , 2003 .

[136]  Sidney K. D'Mello,et al.  Monitoring Affect States During Effortful Problem Solving Activities , 2010, Int. J. Artif. Intell. Educ..

[137]  Dianne Conrad,et al.  Engagement, Excitement, Anxiety, and Fear: Learners' Experiences of Starting an Online Course , 2002 .

[138]  Charles R. Graham Emerging Practice and Research in Blended Learning , 2012 .

[139]  Richard C. Atkinson,et al.  Human Memory: A Proposed System and its Control Processes , 1968, Psychology of Learning and Motivation.

[140]  Carol A. Mullen,et al.  Self-Efficacy as an Engaged Learner , 2012 .

[141]  Jack T. Dennerlein,et al.  FRUSTRATING COMPUTERS USERS INCREASES EXPOSURE TO PHYSICAL FACTORS , 2002 .

[142]  Jennifer A. Fredricks,et al.  School Engagement: Potential of the Concept, State of the Evidence , 2004 .

[143]  Oscar Peters,et al.  Validation of the Instructional Materials Motivation Survey (IMMS) in a self-directed instructional setting aimed at working with technology , 2015, Br. J. Educ. Technol..

[144]  Barbara A. Greene Measuring Cognitive Engagement With Self-Report Scales: Reflections From Over 20 Years of Research , 2015 .

[145]  Cynthia Breazeal,et al.  Affective Learning — A Manifesto , 2004 .

[146]  Ling Tan,et al.  Can Engagement be Compared? Measuring Academic Engagement for Comparison , 2014, EDM.

[147]  E. Skinner,et al.  Motivation in the classroom: Reciprocal effects of teacher behavior and student engagement across the school year. , 1993 .

[148]  Elena Karahanna,et al.  Time Flies When You're Having Fun: Cognitive Absorption and Beliefs About Information Technology Usage , 2000, MIS Q..

[149]  Anthony G. Picciano BLENDING WITH PURPOSE: THE MULTIMODAL MODEL , 2009, Online Learning.

[150]  Ellen A. Skinner,et al.  Engagement and disaffection as organizational constructs in the dynamics of motivational development. , 2009 .

[151]  Russell W. Rumberger,et al.  The Relationship Between Engagement and High School Dropout , 2012 .

[152]  C. Dziuban,et al.  A time‐based blended learning model , 2011 .

[153]  J. Petrosko,et al.  The Measurement and Conceptualization of Curiosity , 2006, The Journal of genetic psychology.

[154]  S. Hidi,et al.  The Four-Phase Model of Interest Development , 2006 .

[155]  Doris U. Bolliger,et al.  Development and Validation of the Online Student Connectedness Survey (OSCS) , 2012 .

[156]  J. Reeve How students create motivationally supportive learning environments for themselves: The concept of agentic engagement. , 2013 .

[157]  R. Baker,et al.  Operationalizing and Detecting Disengagement Within Online Science Microworlds , 2015 .

[158]  J. Finn Withdrawing From School , 1989 .

[159]  Katariina Salmela-Aro,et al.  The trajectories of student emotional engagement and school burnout with academic and psychological development: Findings from Finnish adolescents , 2015 .

[160]  Rafael A. Calvo,et al.  The Impact of System Feedback on Learners' Affective and Physiological States , 2010, Intelligent Tutoring Systems.

[161]  Charles R. Graham,et al.  An analysis of high impact scholarship and publication trends in blended learning , 2012 .

[162]  M. Gettinger,et al.  Classroom Strategies to Enhance Academic Engaged Time , 2012 .

[163]  B. Means,et al.  The Effectiveness of Online and Blended Learning: A Meta-Analysis of the Empirical Literature , 2013, Teachers College Record: The Voice of Scholarship in Education.

[164]  Rafael A. Calvo,et al.  Affect Detection: An Interdisciplinary Review of Models, Methods, and Their Applications , 2010, IEEE Transactions on Affective Computing.

[165]  Charles D. Dziuban,et al.  The Sloan-C Pillars and Boundary Objects As a Framework for Evaluating Blended Learning , 2019 .

[166]  Paul Helm,et al.  Making the Connection in a Blended Learning Environment , 2004 .

[167]  M. Csíkszentmihályi,et al.  Experience Sampling Method: Measuring the Quality of Everyday Life , 2006 .

[168]  Barbara A. Greene,et al.  Engagement in Academic Work: The Role of Learning Goals, Future Consequences, Pleasing Others, and Perceived Ability , 1996, Contemporary educational psychology.

[169]  A. Schoenfeld,et al.  Improving Educational Research:Toward a More Useful, More Influential, and Better-Funded Enterprise , 2003 .

[170]  Michael J. Singer,et al.  Measuring Presence in Virtual Environments: A Presence Questionnaire , 1998, Presence.

[171]  Arthur C. Graesser,et al.  Theoretical Perspectives on Affect and Deep Learning , 2011 .

[172]  J. Connell,et al.  Competence, autonomy, and relatedness: A motivational analysis of self-system processes. , 1991 .

[173]  Robert K. Gable,et al.  Instrument Development in the Affective Domain , 1986 .

[174]  Dennis L. Hoffman,et al.  Marketing in Hypermedia Computer-Mediated Environments : Conceptual Foundations 1 ) , 1998 .