Student access of online feedback is modified by the availability of assessment marks, gender and academic performance

We used educational data mining to quantify student access of online feedback files and explore the underlying drivers of feedback file access in a learning management system (LMS). We collated LMS access logs for 32 individual pieces of assessment representing 1462 feedback files for 484 students (males = 45%, females = 55%) that originated across three undergraduate years, from 20 different degree pathways. Over a third of assessment feedback files (38%, 553 files) were never accessed by students. When students could obtain their assessment mark without opening the associated feedback file, 42% of feedback files were not accessed by students (513 of 1224 files). When assessment marks were integrated into the feedback file (and not reported within the LMS), the proportion of unopened feedback dropped significantly to only 17% of files (40 of 238 files). We uncovered strong gender-specific differences in how students accessed feedback within the LMS that were dependent upon academic performance and the integration of marks within the feedback file. Poorly performing males were less likely to access feedback; however, integrating marks into the feedback files meant that males were over 27 times more likely to access the feedback file. In contrast, females exhibited a much weaker and more variable response to marks being reported within feedback files. Assessments with deadlines earlier in the semester were also viewed more often than those later in the semester.

[1]  Geraldine Clarebout,et al.  Content Management Systems: Enriched learning opportunities for all? , 2012, Comput. Hum. Behav..

[2]  J. Cleland,et al.  Undergraduate medical students: who seeks formative feedback? , 2007, Medical education.

[3]  Ali Farhan AbuSeileek,et al.  Using peer computer-mediated corrective feedback to support EFL learners' writing , 2014 .

[4]  E. Pomerantz,et al.  Making the Grade but Feeling Distressed: Gender Differences in Academic Performance and Internal Distress , 2002 .

[5]  Michael M. Grant,et al.  Mobile computing devices in higher education: Student perspectives on learning with cellphones, smartphones & social media , 2013, Internet High. Educ..

[6]  M. Price,et al.  Beyond ‘doing time’: investigating the concept of student engagement with feedback , 2011 .

[7]  Ali Farhan AbuSeileek,et al.  USING COMPUTER-MEDIATED CORRECTIVE FEEDBACK MODES IN DEVELOPING STUDENTS’ WRITING PERFORMANCE , 2015 .

[8]  Richard Walker,et al.  A longitudinal perspective regarding the use of VLEs by higher education institutions in the United Kingdom , 2006, Interact. Learn. Environ..

[9]  Pete Bridge,et al.  System failure: A comparison of electronic and paper-based assignment submission, marking, and feedback , 2005, Br. J. Educ. Technol..

[10]  M. Hast,et al.  “It’s like fifty-fifty”: Using the Student Voice towards Enhancing Undergraduates’ Engagement with Online Feedback Provision , 2018, Journal of Teaching and Learning with Technology.

[11]  Andrew Gelman,et al.  Data Analysis Using Regression and Multilevel/Hierarchical Models , 2006 .

[12]  H. Schielzeth Simple means to improve the interpretability of regression coefficients , 2010 .

[13]  Ji Won You,et al.  Identifying significant indicators using LMS data to predict course achievement in online learning , 2016, Internet High. Educ..

[14]  D. Carless Differing perceptions in the feedback process , 2006 .

[15]  Kirsten Zimbardi,et al.  Are they using my feedback? The extent of students’ feedback use has a large impact on subsequent academic performance , 2017 .

[16]  Sherria L. Hoskins,et al.  Motivation and ability: which students use online learning and what influence does it have on their achievement? , 2005, Br. J. Educ. Technol..

[17]  Leah Marks,et al.  Improving the effectiveness of feedback by use of assessed reflections and withholding of grades , 2016 .

[18]  Geraldine Clarebout,et al.  Tool-use in a blended undergraduate course: In Search of user profiles , 2011, Comput. Educ..

[19]  Mark R. Young,et al.  Exploring Students’ Initial Reactions to the Feedback They Receive on Coursework , 2012 .

[20]  Mark Stansfield,et al.  The Potential of Learning Analytics in Understanding Students’ Engagement with Their Assessment Feedback , 2017, 2017 IEEE 17th International Conference on Advanced Learning Technologies (ICALT).

[21]  Emilee B. Tison,et al.  Examination of the gender–student engagement relationship at one university , 2011 .

[22]  Naomi Winstone,et al.  ‘It'd be useful, but I wouldn't use it’: barriers to university students’ feedback seeking and recipience , 2017 .

[23]  C. Beaumont,et al.  Reconceptualising assessment feedback: a key to improving student learning? , 2011 .

[24]  Paul L Nesbit,et al.  Student justice perceptions following assignment feedback , 2006 .

[25]  Keithia Wilson,et al.  Feedback on assessment: students’ perceptions of quality and effectiveness , 2008 .

[26]  Zahra Taleb,et al.  Learning on the Move: The use of Mobile Technology to Support Learning for University Students , 2012 .

[27]  Jo Davies,et al.  Performance in e-learning: online participation and student grades , 2005, Br. J. Educ. Technol..

[28]  Ali Farhan AbuSeileek,et al.  Using track changes and word processor to provide corrective feedback to learners in writing , 2013, J. Comput. Assist. Learn..

[29]  Irwin Brown,et al.  Intended and unintended consequences of student use of an online questioning environment , 2009, Br. J. Educ. Technol..

[30]  Eugenia Y. Huang,et al.  What type of learning style leads to online participation in the mixed-mode e-learning environment? A study of software usage instruction , 2012, Comput. Educ..

[31]  María del Puerto Paule Ruíz,et al.  Students' LMS interaction patterns and their relationship with achievement: A case study in higher education , 2016, Comput. Educ..

[32]  Sebastián Ventura,et al.  Data mining in course management systems: Moodle case study and tutorial , 2008, Comput. Educ..

[33]  Kreng Heng The Relationships between Student Engagement and the Academic Achievement of First-Year University Students in Cambodia , 2014 .

[34]  Geraldine Clarebout,et al.  Regulation of tool-use within a blended course: Student differences and performance effects , 2013, Comput. Educ..

[35]  Ali Farhan AbuSeileek,et al.  Using comments and track changes in developing the writing skill: learners' attitude toward corrective feedback , 2013, Int. J. Learn. Technol..

[36]  J. Rand Misunderstandings and mismatches: The collective disillusionment of written summative assessment feedback , 2017 .

[37]  Loc Doan Is Feedback a Waste of Time? The Students’ Perspective , 2013 .

[38]  Alan Stone Online assessment: what influences students to engage with feedback? , 2014, The clinical teacher.

[39]  A. Gelman Prior distributions for variance parameters in hierarchical models (comment on article by Browne and Draper) , 2004 .

[40]  Yi-Shun Wang,et al.  Investigating the determinants and age and gender differences in the acceptance of mobile learning , 2009, Br. J. Educ. Technol..

[41]  Paul-Christian Bürkner,et al.  brms: An R Package for Bayesian Multilevel Models Using Stan , 2017 .

[42]  Cees P M van der Vleuten,et al.  Web‐based feedback after summative assessment: how do students engage? , 2013, Medical education.

[43]  Graham Holden,et al.  A role for technology in enhancing students’ engagement with feedback , 2012 .

[44]  J. Delfgaauw,et al.  The Effects of Student Feedback to Teachers: Evidence from a Field Experiment , 2018 .

[45]  Gender and achievement in clinical medical students: a path analysis , 2001 .

[46]  Sumio Watanabe,et al.  Asymptotic Equivalence of Bayes Cross Validation and Widely Applicable Information Criterion in Singular Learning Theory , 2010, J. Mach. Learn. Res..

[47]  Helen J. Parkin,et al.  Engaging students with feedback through adaptive release , 2013 .