Identifying the Impact of Feedback Over Time and at Scale: Opportunities for Learning Analytics

In contemporary higher education, learner behaviour is increasingly traced by digital systems. As such, there is a strong potential for data mining over time to track and represent learner actions in the context of their assessment performance. This chapter explores how learning analytics can assist educators to design impactful feedback processes and help learners identify the impact of feedback information, both across time and at scale. In doing so, it offers current examples of how learning analytics could guide educational designs and be employed to support learners to direct their own learning and study habits. This chapter also highlights how learning analytics can help understand and optimise learning, and the environments in which the learning occurs.

[1]  P. Winne,et al.  Feedback and Self-Regulated Learning: A Theoretical Synthesis , 1995 .

[2]  David Boud,et al.  Enhancing learning through self assessment , 1995 .

[3]  Graham Gibbs,et al.  Class size and student performance: 1984–94 , 1996 .

[4]  James Hartley,et al.  Qualitative and Quantitative Methods in Research on Essay Writing: No One Way , 2000 .

[5]  David Bridges,et al.  Back to the Future: The higher education curriculum in the 21st century , 2000 .

[6]  Samuel Messick,et al.  STANDARDS OF VALIDITY AND THE VALIDITY OF STANDARDS IN PERFORMANCE ASSESSMENT , 2005 .

[7]  J. Hattie,et al.  The Power of Feedback , 2007 .

[8]  Mark Huxham,et al.  Fast and effective feedback: are model answers the answer? , 2007 .

[9]  Joseph B. Cuseo.  The Empirical Case against Large Class Size: Adverse Effects on the Teaching, Learning, and Retention of First-Year Students. , 2007 .

[10]  Meredith Lawley,et al.  Educators' Perceptions of Automated Feedback Systems. , 2008 .

[11]  Shanthi Ameratunga,et al.  Student engagement in very large classes: the teachers’ perspective , 2010 .

[12]  M. Price,et al.  Feedback : all that effort, but what is the effect? , 2010 .

[13]  Abigail Selzer King,et al.  Using Signals for appropriate feedback: Perceptions and practices , 2011, Comput. Educ..

[14]  D. Carless,et al.  Developing sustainable feedback practices , 2011 .

[15]  Marek Hatala,et al.  A qualitative evaluation of evolution of a learning analytics tool , 2012, Comput. Educ..

[16]  George Siemens,et al.  Guest Editorial - Learning and Knowledge Analytics , 2012, J. Educ. Technol. Soc..

[17]  C. V. D. van der Vleuten,et al.  A model for programmatic assessment fit for purpose , 2012, Medical teacher.

[18]  Matthew D. Pistilli,et al.  Course signals at Purdue: using learning analytics to increase student success , 2012, LAK.

[19]  Hendrik Drachsler,et al.  Translating Learning into Numbers: A Generic Framework for Learning Analytics , 2012, J. Educ. Technol. Soc..

[20]  Zeynep Koçoğlu,et al.  Effects of Peer E-Feedback on Turkish EFL Students' Writing Performance , 2012 .

[21]  C. Moore,et al.  Engaging students in peer review: Feedback as learning , 2013 .

[22]  Geraldine Clarebout,et al.  Students' tool-use within a web enhanced course: Explanatory mechanisms of students' tool-use pattern , 2013, Comput. Hum. Behav..

[23]  Frances Deepwell,et al.  Evaluating assessment practices: the academic staff perspective , 2013 .

[24]  A. Wise,et al.  Broadening the notion of participation in online discussions: examining patterns in learners’ online listening behaviors , 2013 .

[25]  D. Boud,et al.  Rethinking models of feedback for learning: the challenge of design , 2013 .

[26]  D. Boud.  Feedback: ensuring that it leads to enhanced learning , 2015, The clinical teacher.

[27]  George Siemens,et al.  Let’s not forget: Learning analytics are about learning , 2015 .

[28]  Ching-Huei Chen,et al.  EFL writing revision with blind expert and peer review using a CMC open forum , 2015 .

[29]  Dragan Gasevic,et al.  Learning analytics should not promote one size fits all: The effects of instructional conditions in predicting academic success , 2016, Internet High. Educ..

[30]  Shu-Chen Huang,et al.  Understanding learners’ self-assessment and self-feedback on their foreign language speaking performance , 2016 .

[31]  Linda Corrin,et al.  A conceptual framework linking learning design with learning analytics , 2016, LAK.

[32]  A A Timmerman,et al.  A practical approach to programmatic assessment design , 2017, Advances in health sciences education : theory and practice.

[33]  Katrien Verbert,et al.  Review of Research on Student-Facing Learning Analytics Dashboards and Educational Recommender Systems , 2017, IEEE Transactions on Learning Technologies.

[34]  Dragan Gasevic,et al.  Effects of instructional conditions and experience on the adoption of a learning tool , 2017, Comput. Hum. Behav..

[35]  P. Miller,et al.  Contextualizing the Impacts of Homelessness on Academic Growth , 2017, Teachers College Record: The Voice of Scholarship in Education.

[36]  Stephanie D. Teasley.  Student Facing Dashboards: One Size Fits All? , 2017, Technol. Knowl. Learn..

[37]  Naomi Winstone,et al.  ‘It'd be useful, but I wouldn't use it’: barriers to university students’ feedback seeking and recipience , 2017 .

[38]  Dragan Gasevic,et al.  Learning analytics to unveil learning strategies in a flipped classroom , 2017, Internet High. Educ..

[39]  Katrien Verbert,et al.  Small data as a conversation starter for learning analytics: Exam results dashboard for first-year students in higher education , 2017 .

[40]  Abelardo Pardo,et al.  A feedback model for data-rich learning experiences , 2018 .

[41]  Ernesto Panadero,et al.  Developing evaluative judgement , 2018 .

[42]  Zachari Swiecki,et al.  Supporting teachers' intervention in students' virtual collaboration using a network based model , 2018, LAK.

[43]  Dragan Gasevic,et al.  Effects of instructional conditions and experience on student reflection: a video annotation study , 2018 .

[44]  David Boud,et al.  What makes for effective feedback: staff and student perspectives , 2019 .

[45]  Dragan Gasevic,et al.  Using learning analytics to scale the provision of personalised feedback , 2019, Br. J. Educ. Technol..

[46]  Abelardo Pardo,et al.  From Study Tactics to Learning Strategies: An Analytical Method for Extracting Interpretable Representations , 2019, IEEE Transactions on Learning Technologies.

[47]  Arthur C. Graesser,et al.  Linguistic characteristics of reflective states in video annotations under different instructional conditions , 2019, Comput. Hum. Behav..