Design of a Microlevel Student Engagement Data Capture System

Student engagement is a known contributor to student success. In the ever increasing channels for online learning, both engagement and success has been seen to struggle particularly in the STEM subject areas where dropouts are high and grades are lower. Student engagement has been known to be measured in lengthy questionnaires at the end of a semester, whereas we propose and design a microlevel approach to timely capture student engagement that adds the cognitive and emotional dimensions to the more widely used behavioural engagement data. In this paper we present a data capture design we have carried out to re-design the conventional method of retrospective and lengthy engagement questionnaires into a more dynamic, timely method that uses micro-surveys at strategic points in a virtual learning environment using a newly developed data capture module. We discuss our findings based on a pilot study carried out at Universitat Oberta de Catalunya, Spain.

[1]  G. Susman,et al.  An Assessment of the Scientific Merits of Action Research. , 1978 .

[2]  David J. Shernoff,et al.  Optimal Learning Environments to Promote Student Engagement , 2013 .

[3]  M. Boekaerts,et al.  Solving math problems: Where and why does the solution process go astray? , 1995 .

[4]  P. Pintrich,et al.  Motivational and self-regulated learning components of classroom academic performance. , 1990 .

[5]  Ellen A. Skinner,et al.  Engagement and disaffection as organizational constructs in the dynamics of motivational development. , 2009 .

[6]  Erping Zhu,et al.  Interaction and cognitive engagement: An analysis of four asynchronous online discussions , 2006 .

[7]  Enric Mor,et al.  Assessment of Engagement: Using Microlevel Student Engagement as a Form of Continuous Assessment , 2017, TEA.

[8]  Wendy McColskey,et al.  The Measurement of Student Engagement: A Comparative Analysis of Various Methods and Student Self-report Instruments , 2012 .

[9]  Enric Mor,et al.  EXTENDING LEARNING ANALYTICS WITH MICROLEVEL STUDENT ENGAGEMENT DATA , 2017 .

[10]  James J. Appleton,et al.  Measuring cognitive and psychological engagement: Validation of the Student Engagement Instrument , 2006 .

[11]  Gregory Schraw,et al.  Assessing metacognitive awareness , 1994 .

[12]  David J. Shernoff,et al.  Further Evidence of an Engagement–Achievement Paradox Among U.S. High School Students , 2008 .

[13]  Amanda L. Griffith,et al.  Persistence of Women and Minorities in STEM Field Majors: Is it the School That Matters? , 2010 .

[14]  A. A. G. Putra,et al.  PIECING TOGETHER THE STUDENT SUCCESS PUZZLE: RESEARCH, PROPOSITIONS, AND RECOMMENDATIONS , 2013 .

[15]  Romain Martin,et al.  “My Questionnaire is Too Long!” The assessments of motivational-affective constructs with three-item and single-item measures , 2014 .

[16]  T. J. Kennedy,et al.  Engaging Students In STEM Education , 2014 .

[17]  Thomas Goetz,et al.  Assessing Academic Emotions via the Experience Sampling Method , 2016 .

[18]  Ruth Deakin Crick,et al.  Developing an Effective Lifelong Learning Inventory: the ELLI Project , 2004 .

[19]  G. Ladd,et al.  Continuity and Change in Early School Engagement: Predictive of Children's Achievement Trajectories from First to Eighth Grade? , 2009, Journal of educational psychology.

[20]  Jordi Conesa,et al.  Design of an emotion aware e-learning system , 2012, Int. J. Knowl. Learn..

[21]  Charles R. Graham,et al.  Measuring student engagement in technology-mediated learning: A review , 2015, Comput. Educ..

[22]  P. Pintrich,et al.  Reliability and Predictive Validity of the Motivated Strategies for Learning Questionnaire (Mslq) , 1993 .

[23]  Jennifer A. Fredricks,et al.  School Engagement: Potential of the Concept, State of the Evidence , 2004 .

[24]  Christoph Rensing,et al.  Evaluating Recommender Systems for Technology Enhanced Learning: A Quantitative Survey , 2015, IEEE Transactions on Learning Technologies.

[25]  George D. Kuh.  The national survey of student engagement: Conceptual and empirical foundations , 2009 .

[26]  Abelardo Pardo,et al.  Combining University Student Self-Regulated Learning Indicators and Engagement with Online Learning Events to Predict Academic Performance , 2017, IEEE Transactions on Learning Technologies.

[27]  Teresa Garcia,et al.  Assessing Students’ Motivation and Learning Strategies in the Classroom Context: The Motivated Strategies for Learning Questionnaire , 1996 .

[28]  Jane Sinclair,et al.  Measures of Student Engagement in Computer Science , 2015, ITiCSE.