Strengthening dialogic peer feedback aiming for deep learning in SPOCs

Abstract This study is focused on how peer feedback in SPOCs (Small Private Online Courses) can effectively lead to deep learning. Promoting deep learning in online courses, such as SPOCs, is often a challenge. We aimed for deep learning by reinforcement of ‘feedback dialogue’ as scalable intervention. Students provided peer feedback as a dialogue, both individually and as a group. They were instructed to rate each other's feedback, which was aimed at deep learning. Data from questionnaires from 41 students of a master epidemiology course were used to measure for each feedback assignment to what extent deep learning was perceived. The feedback received by students who scored extremely high or low on the questionnaire was analyzed in order to find out which features of the feedback led to deep learning. In addition, students were interviewed to retrieve information about the underlying mechanisms. The results support the view that peer feedback instruction and peer feedback rating lead to peer feedback dialogues that, in turn, promote deep learning in SPOCs. The value of peer feedback appears to predominantly result from the dialogue it triggers, rather than the feedback itself. Especially helpful for students is the constant attention to how one provides peer feedback: by instruction, by having to rate feedback and therefore by repeatedly having to reflect. The dialogue is strengthened because students question feedback from peers in contrast to feedback from their instructor. As a result, they continue to think longer and deeper, which enables deep learning.

[1]  Omid Noroozi,et al.  Facilitating argumentative knowledge construction through a transactive discussion script in CSCL , 2013, Comput. Educ..

[2]  Young Hoan Cho,et al.  Peer reviewers learn from giving comments , 2011 .

[3]  Patrick Onghena,et al.  Improving the effectiveness of peer feedback for learning , 2009 .

[4]  P. Orsmond,et al.  The Use of Student Derived Marking Criteria in Peer and Self-assessment , 2000 .

[5]  F. Paas,et al.  Effects of elicited reflections combined with tutor or peer feedback on self-regulated learning and learning outcomes , 2007 .

[6]  Renée M. Filius,et al.  Challenges concerning deep learning in SPOCs , 2018 .

[7]  R. Trevelyan,et al.  Using patchwork texts in assessment: clarifying and categorising choices in their use , 2012 .

[8]  F. Marton,et al.  Approaches to learning , 2003 .

[9]  David Nicol,et al.  From monologue to dialogue: improving written feedback processes in mass higher education , 2010 .

[10]  Martha Cleveland-Innes,et al.  Social and Academic Interaction in Higher Education Contexts and the Effect on Deep Learning , 2005 .

[11]  Richard Badger,et al.  A comparative study of peer and teacher feedback in a Chinese EFL writing class , 2006 .

[12]  Samantha N. Uribe,et al.  Facilitating student learning in distance education: a case study on the development and implementation of a multifaceted feedback system , 2017 .

[13]  Mark Pegrum,et al.  Can creative podcasting promote deep learning? The use of podcasting for learning content in an undergraduate science unit , 2015, Br. J. Educ. Technol..

[14]  John Raven,et al.  Changing the learning environment to promote deep learning approaches in first-year accounting students , 2004 .

[15]  N. Entwistle,et al.  Understanding Student Learning , 1983 .

[16]  Matthew B. Miles,et al.  Qualitative Data Analysis: An Expanded Sourcebook , 1994 .

[17]  K. Dearden,et al.  The power of positive deviance , 2004, BMJ : British Medical Journal.

[18]  Peggy A. Ertmer,et al.  Using Peer Feedback to Enhance the Quality of Student Online Postings: An Exploratory Study , 2007, J. Comput. Mediat. Commun..

[19]  Niall Seery,et al.  Promoting deep learning in a teacher education programme through self- and peer-assessment and feedback , 2012 .

[20]  Jan van den Akker,et al.  Principles and Methods of Development Research , 1999 .

[21]  Anne Line Wittek,et al.  Dialogic feedback and potentialities for student learning , 2017 .

[22]  Jae-Won Moon.  Reflection in Learning and Professional Development: Theory and Practice , 2005 .

[23]  Georgeta Ion,et al.  Written peer-feedback to enhance students’ current and future learning , 2016, International Journal of Educational Technology in Higher Education.

[24]  Zehra Akyol,et al.  Understanding cognitive presence in an online and blended community of inquiry: Assessing outcomes and processes for deep approaches to learning , 2011, Br. J. Educ. Technol..

[25]  Mieke Brekelmans,et al.  Auditing Quality of Research in Social Sciences , 2008 .

[26]  J. W. Gikandi,et al.  Designing and implementing peer formative feedback within online learning environments , 2016 .

[27]  Rob Martens,et al.  Exploring the Value of Peer Feedback in Online Learning for the Provider. , 2017 .

[28]  H. Duijnhouwer.  Feedback effects on students' writing motivation, process, and performance , 2010 .

[29]  D. Nicol.  Assessment for learner self‐regulation: enhancing achievement in the first year using learning technologies , 2009 .

[30]  J. Vermunt,et al.  Congruence and friction between learning and teaching , 1999 .

[31]  Frank Tuzi,et al.  The impact of e-feedback on the revisions of L2 writers in an academic writing course , 2004 .

[32]  Renée M. Filius,et al.  Promoting deep learning through online feedback in SPOCs , 2018, Frontline Learning Research.

[33]  Armando Fox,et al.  From MOOCs to SPOCs , 2013, CACM.

[34]  N. Entwistle,et al.  Approaches to learning, evaluations of teaching, and preferences for contrasting academic environments , 1990 .

[35]  Paul A. Kirschner,et al.  Effects of feedback on collaborative writing in an online learning environment , 2013 .

[36]  David Carless,et al.  Trust and its role in facilitating dialogic feedback , 2012 .

[37]  N. Entwistle,et al.  Approaches to Learning and Levels of , 1979 .

[38]  Fengfeng Ke,et al.  Toward deep learning for adult students in online courses , 2009, Internet High. Educ..

[39]  T. Laird,et al.  Deeply Affecting First-Year Students' Thinking: Deep Approaches to Learning and Three Dimensions of Cognitive Development , 2014 .

[40]  O. ten Cate,et al.  Student Interaction in Small Private Online Courses , 2017 .

[41]  D. Tranfield,et al.  Developing Design Propositions through Research Synthesis , 2008 .

[42]  J. Aken.  Management Research Based on the Paradigm of the Design Sciences: The Quest for Field-Tested and Grounded Technological Rules , 2004 .

[43]  M. Volman,et al.  Scaffolding in Teacher–Student Interaction: A Decade of Research , 2010 .

[44]  Trena M. Paulus,et al.  The Effect of Peer and Teacher Feedback on Student Writing , 1999 .

[45]  P. Booth,et al.  The quality of learning in accounting education: the impact of approaches to learning on academic performance , 1999 .

[46]  K. Trigwell,et al.  Relations between teachers' approaches to teaching and students' approaches to learning , 1999 .

[47]  G. Midgley.  Systemic Intervention: Philosophy, Methodology, and Practice , 2000 .

[48]  Kyung-Eun Park,et al.  An Exploratory Study about Inaccuracy and Invalidity in Adolescent Self-Report Surveys , 2006 .

[49]  Noa Aharony,et al.  The use of deep and surface learning strategies among students learning English as a foreign language in an Internet environment. , 2006, The British journal of educational psychology.

[50]  Larry Ambrose,et al.  The power of feedback. , 2002, Healthcare executive.

[51]  D. Boud,et al.  Rethinking models of feedback for learning: the challenge of design , 2013 .

[52]  P. Kirschner,et al.  Goal Orientation, Deep Learning, and Sustainable Feedback in Higher Business Education , 2015 .

[53]  Janine Delahunty,et al.  “I ‘feel’ like I am at university even though I am online.” Exploring how students narrate their engagement with higher education institutions in an online learning environment , 2015 .

[54]  Beth L. Hewett,et al.  Characteristics of interactive oral and computer-mediated peer group talk and its influence on revision , 2000 .

[55]  C. Schunn,et al.  The Nature of Feedback: How Peer Feedback Features Affect Students' Implementation Rate and Quality of Revisions. , 2016 .

[56]  R. Ruegg.  Differences in the Uptake of Peer and Teacher Feedback , 2015 .

[57]  Avril Thomson,et al.  Rethinking feedback practices in higher education: a peer review perspective , 2014 .

[58]  J. Biggs.  What the student does: teaching for enhanced learning , 1999 .

[59]  D. Garrison,et al.  Blended learning: Uncovering its transformative potential in higher education , 2004, Internet High. Educ..

[60]  John Biggs,et al.  What the student does: teaching for enhanced learning , 1999 .

[61]  G. Finn,et al.  Twelve tips for implementing a successful peer assessment , 2011, Medical teacher.