Promoting deep learning through online feedback in SPOCs

Higher education aims for deep learning and increasingly uses a specific form of online education: Small Private Online Courses (SPOCs). To overcome challenges that instructors face in order to promote deep learning through that format, the use of feedback may have significant potential. We interviewed eleven instructors and four students and organized a focus group to formulate scalable design propositions for instructors in SPOCs to promote deep learning. Propositions have been formulated according to the CIMO-logic. This study resulted in identification of four mechanisms by which the desired outcome (deep learning) can be achieved, which we describe here along with proposed interventions. Results show that the “online learning interaction model” can be deepened with these mechanisms: 1) Feeling personally committed, 2) Asking and providing relevant feedback, 3) Probing back and forth, and 4) Understanding one’s own learning process. To activate these mechanisms, scalable feedback interventions are described in three categories. Results at this relatively young field of SPOCs also show that feedback as a dialogical process may contribute to solving the current challenges of instructors in SPOCs to achieve deep learning with their students.

[1]  Aytaç Göğüş Peer learning and assessment , 2012 .

[2]  Wilfried Admiraal,et al.  Developing designs for community development in four types of student teacher groups , 2012 .

[3]  Terry Anderson,et al.  Using Peer Teams to Lead Online Discussions , 2002 .

[4]  Kim Schildkamp,et al.  Alternative quality standards in qualitative research? , 2012 .

[5]  Larry Ambrose,et al.  The power of feedback. , 2002, Healthcare executive.

[6]  D. Nicol Assessment for learner self‐regulation: enhancing achievement in the first year using learning technologies , 2009 .

[7]  J. Vermunt,et al.  Congruence and friction between learning and teaching , 1999 .

[8]  Marie Schmidt,et al.  Learning to Teach in Higher Education , 1992 .

[9]  Susanne Narciss Designing and evaluating tutoring Feedback Strategies for Digital Learning , 2013 .

[10]  Thomas C. Reeves,et al.  An introduction to educational design research , 2013 .

[11]  David Nicol,et al.  From monologue to dialogue: improving written feedback processes in mass higher education , 2010 .

[12]  G. Midgley Systemic Intervention: Philosophy, Methodology, and Practice , 2000 .

[13]  J. Creswell,et al.  Qualitative Inquiry and Research Design , 1998 .

[14]  Noel Entwistle,et al.  Approaches to learning and perceptions of the learning environment , 1991 .

[15]  N. Entwistle,et al.  Approaches to Learning and Levels of , 1979 .

[16]  V. Dennen,et al.  Instructor–Learner Interaction in Online Courses: The relative perceived importance of particular instructor actions on performance and satisfaction , 2007 .

[17]  Fengfeng Ke,et al.  Toward deep learning for adult students in online courses , 2009, Internet High. Educ..

[18]  Nicholas Athanassiou,et al.  Critical Thinking in the Management Classroom: Bloom's Taxonomy as a Learning Tool , 2003 .

[19]  K. Topping Peer Assessment Between Students in Colleges and Universities , 1998 .

[20]  G. Boulton‐Lewis Teaching for quality learning at university , 2008 .

[21]  Niall Seery,et al.  Promoting deep learning in a teacher education programme through self- and peer-assessment and feedback , 2012 .

[22]  Jan van den Akker,et al.  Principles and Methods of Development Research , 1999 .

[23]  Jae-Won Moon Reflection in Learning and Professional Development: Theory and Practice , 2005 .

[24]  A. Kluger,et al.  The effects of feedback interventions on performance: A historical review, a meta-analysis, and a preliminary feedback intervention theory. , 1996 .

[25]  Angela D. Benson,et al.  Assessing participant learning in online environments , 2003 .

[26]  S. Herring,et al.  Interaction, facilitation, and deep learning in cross-cultural chat: A case study , 2007, Internet High. Educ..

[27]  J. Biggs What the student does: teaching for enhanced learning , 1999 .

[28]  P. Sadler,et al.  The Impact of Self- and Peer-Grading on Student Learning , 2006 .

[29]  J. Aken Management Research Based on the Paradigm of the Design Sciences: The Quest for Field-Tested and Grounded Technological Rules , 2004 .

[30]  D. Caulley Qualitative research for education: An introduction to theories and methods , 2007 .

[31]  J. Vermunt,et al.  Fostering Meaning-Oriented Learning and Deliberate Practice in Teacher Education. , 2011 .

[32]  D. Berliner Learning about and learning from expert teachers , 2001 .

[33]  E. Guba Criteria for assessing the trustworthiness of naturalistic inquiries , 1981 .

[34]  Jennifer C. Richardson,et al.  Conceptualizing and Investigating Instructor Presence in Online Learning Environments. , 2015 .

[35]  Eckhard Klieme,et al.  Written feedback in mathematics: Mediated by students' perception, moderated by goal orientation , 2013 .

[36]  Marie Weisz,et al.  Developing Teaching And Learning In Higher Education , 2016 .

[37]  Mark Pegrum,et al.  Can creative podcasting promote deep learning? The use of podcasting for learning content in an undergraduate science unit , 2015, Br. J. Educ. Technol..

[38]  Laura Johnson,et al.  How Many Interviews Are Enough? , 2006 .

[39]  A. Rushton Formative assessment: a key to deep learning? , 2005, Medical teacher.

[40]  D. Sluijsmans,et al.  The use of self-, peer and co-assessment in higher education: A review , 1999 .

[41]  R. Powell,et al.  Focus groups. , 1996, International journal for quality in health care : journal of the International Society for Quality in Health Care.

[42]  Mieke Brekelmans,et al.  Auditing Quality of Research in Social Sciences , 2008 .

[43]  M. Taylor,et al.  Consequences of individual feedback on behavior in organizations. , 1979 .

[44]  Soledad Moya,et al.  The Effectiveness of Instructor Personalized and Formative Feedback Provided by Instructor in an Online Setting : Some Unresolved Issues , 2016 .

[45]  John Raven,et al.  Changing the learning environment to promote deep learning approaches in first-year accounting students , 2004 .

[46]  Kyung-Eun Park,et al.  An Exploratory Study about Inaccuracy and Invalidity in Adolescent Self-Report Surveys , 2006 .

[47]  Noa Aharony,et al.  The use of deep and surface learning strategies among students learning English as a foreign language in an Internet environment. , 2006, The British journal of educational psychology.

[48]  D. Carless,et al.  Developing sustainable feedback practices , 2011 .

[49]  D. Boud,et al.  Rethinking models of feedback for learning: the challenge of design , 2013 .

[50]  K. Trigwell,et al.  Relations between teachers' approaches to teaching and students' approaches to learning , 1999 .

[51]  Robert Davies,et al.  An evaluation of the use of computer supported peer review for developing higher-level skills , 1998, Comput. Educ..

[52]  D. Randy Garrison,et al.  Critical Inquiry in a Text-Based Environment: Computer Conferencing in Higher Education , 1999, Internet High. Educ..

[53]  D. Hay Using concept maps to measure deep, surface and non‐learning outcomes , 2007 .

[54]  L. Cohen,et al.  Research Methods in Education , 1980 .

[55]  P. Booth,et al.  The quality of learning in accounting education: the impact of approaches to learning on academic performance , 1999 .

[56]  Renée M. Filius,et al.  Challenges concerning deep learning in SPOCs , 2018 .

[57]  David Boud,et al.  Changing conceptions of feedback , 2013 .

[58]  H. Andrade,et al.  Rubric‐referenced self‐assessment and middle school students’ writing , 2010 .

[59]  Eric Zhi-Feng Liu,et al.  Web-based peer assessment: feedback for students with various thinking-styles , 2001, J. Comput. Assist. Learn..

[60]  N. Entwistle,et al.  Understanding Student Learning , 1983 .

[61]  Julian Park,et al.  The use of video technology for providing feedback to students: Can it enhance the feedback experience for staff and students? , 2012, Comput. Educ..

[62]  Jianxia Du,et al.  Dynamic online discussion: task‐oriented interaction for deep learning , 2005 .

[63]  P. Winne,et al.  Feedback and Self-Regulated Learning: A Theoretical Synthesis , 1995 .

[64]  Caroline Lodge,et al.  Gifts, ping-pong and loops – linking feedback and learning , 2004 .

[65]  J. Biggs,et al.  The revised two-factor Study Process Questionnaire: R-SPQ-2F. , 2001, The British journal of educational psychology.

[66]  P. Ramsden,et al.  Associations between research and teaching in Australian higher education , 1992 .

[67]  O. ten Cate,et al.  Student Interaction in Small Private Online Courses , 2017 .

[68]  P. Kirschner,et al.  Goal Orientation, Deep Learning, and Sustainable Feedback in Higher Business Education , 2015 .

[69]  Mieke Brekelmans,et al.  Fostering teacher community development: A review of design principles and a case study of an innovative interdisciplinary team , 2012 .

[70]  Dai Hounsell,et al.  Contrasting Conceptions of Essay-Writing , 1997 .

[71]  D. Garrison,et al.  Critical thinking, cognitive presence, and computer conferencing in distance education , 2001 .

[72]  D. Tranfield,et al.  Developing Design Propositions through Research Synthesis , 2008 .