Assessing student teachers’ reflective writing through quantitative content analysis

Students’ reflective essay writing can be stimulated by the formative assessments provided to them by their teachers. Such assessments contain information about the quality of students’ reflective writings and offer suggestions for improvement. Despite the importance of formatively assessing students’ reflective writings in teacher education programmes, it is difficult for teacher educators to provide high-quality formative assessments. In this article, a quantitative content analysis procedure (QCA) is used to assess the level of argument and content of 34 student teachers’ reflective writings over the course of two semesters. The study showed that the mean argument levels of students’ reflective essays differed between the two consecutive semesters. The modes of the reflective essays were primarily descriptive and evaluative. The results indicated that it is important to encourage students to focus on the content of the justification, dialogue and transformative learning in their reflective essays. It is concluded that QCA can be used as a procedure for teacher educators to formatively assess their students’ reflective writings, reliably and validly.

[1]  M. Manen.  Linking Ways of Knowing with Ways of Being Practical , 1977 .

[2]  J. Mezirow.  Transformative Dimensions of Adult Learning , 1991 .

[3]  Anne E. Oosterbaan,et al.  Reflection during portfolio-based conversations , 2010 .

[4]  J. M. Simmons,et al.  Reflective Pedagogical Thinking: How Can We Promote It and Measure It? , 1990 .

[5]  S. Messick.  Validity of Psychological Assessment: Validation of Inferences from Persons' Responses and Performances as Scientific Inquiry into Score Meaning. Research Report RR-94-45. , 1994 .

[6]  Patricia Cranton,et al.  Exploring the Scholarship of Teaching , 2000 .

[7]  David Kember,et al.  Determining the level of reflective thinking from students' written journals using a coding scheme based on the work of Mezirow , 1999 .

[8]  Suzanne Schwarz McCotter,et al.  Reflection as a Visible Outcome for Preservice Teachers. , 2004 .

[9]  M. Pedaste,et al.  How to determine the quality of students’ reflections? , 2012 .

[10]  Jodi Nickel,et al.  Formative Assessment and Syntheses in Reflection Journals , 2013 .

[11]  Nico Verloop,et al.  Teacher Beliefs and Teacher Behaviour in Portfolio Assessment. , 2008 .

[12]  Nico Verloop,et al.  The Portfolio as a Tool for Stimulating Reflection by Student Teachers. , 2007 .

[13]  José Chamoso,et al.  Analysis of the reflections of student-teachers of mathematics when working with learning portfolios in Spanish university classrooms , 2009 .

[14]  Brendan Calandra,et al.  Examining the effects of computer-based scaffolds on novice teachers’ reflective journal writing , 2010 .

[15]  James W. Peltier,et al.  The Reflective Learning Continuum: Reflecting on Reflection , 2005 .

[16]  L. Ring,et al.  A categorization scheme for assessing pharmacy students' levels of reflection during internships. , 2008, American journal of pharmaceutical education.

[17]  D. Kember,et al.  Assessing the level of student reflection from reflective journals. , 1995, Journal of advanced nursing.

[18]  Henriikka Clarkeburn,et al.  Fairness and using reflective journals in assessment , 2012 .

[19]  T. Bourner.  Assessing Reflective Learning. , 2003 .

[20]  Vicki Kubler LaBoskey,et al.  A Conceptual Framework for Reflection in Preservice Teacher Education , 2003 .

[21]  M. G. Sherin,et al.  Effects of Video Club Participation on Teachers' Professional Vision , 2009 .

[22]  Adele H. Stamp.  What is Critical Reflection? , 2012 .

[23]  Lily Orland-Barak,et al.  When Theory Meets Practice: What Student Teachers Learn from Guided Reflection on Their Own Classroom Discourse. , 2007 .

[24]  S. Quinton,et al.  Feeding forward: using feedback to promote student reflection and learning – a teaching model , 2010 .

[25]  Geert Kelchtermans,et al.  Who I am in how I teach is the message: self‐understanding, vulnerability and reflection , 2009 .

[26]  Brendan Calandra,et al.  Using Online Scaffolds to Enhance Preservice Teachers' Reflective Journal Writing: A Qualitative Analysis , 2007 .

[27]  Carina Granberg,et al.  Social software for reflective dialogue: questions about reflection and dialogue in student teachers’ blogs , 2010 .

[28]  J. Bain,et al.  Using Journal Writing to Enhance Student Teachers’ Reflectivity During Field Experience Placements , 1999 .

[29]  L. Darling-Hammond,et al.  Authentic assessment of teaching in context , 2000 .

[30]  Carol R. Rodgers,et al.  Defining Reflection: Another Look at John Dewey and Reflective Thinking , 2002, Teachers College Record: The Voice of Scholarship in Education.

[31]  Starla McCollum.  Insights Into the Process of Guidingreflection During an Early Fieldexperience of Preservice Teachers , 1997 .

[32]  Jan-Willem Strijbos,et al.  Content analysis: What are they talking about? , 2006, Comput. Educ..

[33]  Charlotte Meierdirk,et al.  Reflective practice in teacher education , 2016 .

[34]  Georgea Mohlman Sparks-Langer,et al.  Synthesis of Research on Teachers' Reflective Thinking. , 1991 .

[35]  Linda A. Hoover.  Reflective writing as a window on preservice teachers' thought processes , 1994 .

[36]  Dita Fischl,et al.  Reflective Writing in Pre-Service Teachers' Teaching: What Does It Promote?. , 2012 .

[37]  J. Badger.  Assessing reflective thinking: pre‐service teachers’ and professors’ perceptions of an oral examination , 2010 .

[38]  S. White-Means,et al.  The economic impact of a college of pharmacy. , 2008, American journal of pharmaceutical education.

[39]  Glenda Campbell-Evans,et al.  Using Interactive Journal Writing as a Strategy for Professional Growth , 2002 .

[40]  Joelle K. Jay,et al.  Capturing complexity: a typology of reflective practice for teacher education , 2002 .

[41]  N. Hatton,et al.  Reflection in teacher education: Towards definition and implementation , 1995 .

[42]  S. Callahan.  Responding to the invisible student , 2000 .

[43]  M. F. van der Schaaf,et al.  Secondary-school students' motivation for portfolio reflection , 2012 .

[44]  E. Spalding,et al.  Demystifying Reflection: A Study of Pedagogical Strategies That Encourage Reflective Journal Writing. , 2002 .

[45]  Susan E. King.  INSPIRING CRITICAL REFLECTION IN PRESERVICE TEACHERS , 2008 .

[46]  D. Boud.  Using Journal Writing to Enhance Reflective Practice , 2001 .

[47]  R. J. Bogumil,et al.  The reflective practitioner: How professionals think in action , 1985, Proceedings of the IEEE.

[48]  Michael J. Hannafin,et al.  Capturing and assessing evidence of student teacher inquiry: A case study , 2008 .

[49]  H. Scott,et al.  Teacher development by using writing as a tool , 1999 .

[50]  Roy Ballantyne,et al.  Developing Reflection on Practice Through Journal Writing: Impacts of variations in the focus and level of feedback , 2002 .

[51]  H. Tillema,et al.  Student teacher reflective writing: what does it reveal? , 2013 .

[52]  Linda R. Valli,et al.  Reflective teacher education : cases and critiques , 1992 .

[53]  E. V. Es,et al.  A new lens on teaching: learning to notice , 2003 .

[54]  L. A. Hausman.  How we Think , 1921 .

[55]  Kristy Kay Ballard,et al.  Using Van Manen's model to assess levels of reflectivity among preservice physical education teachers , 2006 .

[56]  N. Tsangaridou,et al.  Using Pedagogical Reflective Strategies to Enhance Reflection among Preservice Physical Education Teachers , 1995 .

[57]  E. Davis.  Characterizing productive reflection among preservice elementary teachers: Seeing what matters , 2006 .

[58]  M. F. Schaaf,et al.  Quantitative content analysis procedures to analyse students’ reflective essays: A methodological review of psychometric and edumetric aspects , 2012 .

[59]  Improvement,et al.  Encouraging Reflective Practice in Education: An Analysis of Issues and Programs , 1990 .

[60]  Effie Maclellan,et al.  How reflective is the academic essay , 2004 .

[61]  Hea-Jin Lee,et al.  Understanding and assessing preservice teachers’ reflective thinking , 2005 .

[62]  M. G. Sherin,et al.  Using Video to Support Teachers’ Ability to Notice Classroom Interactions , 2005 .

[63]  M. El-Dib.  Levels of reflection in action research. An overview and an assessment tool , 2007 .

[64]  R. Mladenovic,et al.  A critical evaluation of the usefulness of a coding scheme to categorise levels of reflective thinking , 2011 .

[65]  Larry Ambrose,et al.  The power of feedback. , 2002, Healthcare executive.

[66]  Heather Fry,et al.  Appraising and assessing reflection in students' writing on a structured worksheet , 2002, Medical education.

[67]  Ca Sawyer,et al.  Promoting Reflection in Teacher Preparation Programs , 2012 .

[68]  Andrew Kitchenham.  Teachers and Technology , 2006 .

[69]  D. Schoen,et al.  The Reflective Practitioner: How Professionals Think in Action , 1985 .

[70]  Linda R. Valli.  Listening to Other Voices: A Description of Teacher Reflection in the United States , 1997 .

[71]  W. Chien,et al.  Promoting self-reflection in clinical practice among Chinese nursing undergraduates in Hong Kong , 2012, Contemporary nurse.

[72]  Audrey A. Friedman,et al.  Reflective Practice Interventions: Raising Levels of Reflective Judgment , 2009 .

[73]  David Kember,et al.  A four‐category scheme for coding and assessing the level of reflection in written work , 2008 .

[74]  J. Hamann.  Reflective Practices and Confluent Educational Perspectives: Three Exploratory Studies. , 2002 .

[75]  J. Tartwijk,et al.  Using an analogy in the introduction of a portfolio , 2008 .

[76]  Barbara Richardson,et al.  Reflection and its Place in the Curriculum on an Undergraduate Course: Should it be assessed? , 2000 .

[77]  M. Lundeberg,et al.  Noticing Noticing , 2008 .

[78]  R. Rogers.  Reflection in Higher Education: A Concept Analysis , 2001 .

[79]  Inge Molenaar,et al.  It’s all about metacognitive activities: computerized scaffolding of self-regulated learning , 2011 .

[80]  A. Bannink.  How to capture growth? Video narratives as an instrument for assessment in teacher education , 2009 .

[81]  Phyllis Creme,et al.  Should student learning journals be assessed , 2005 .

[82]  D. Nicol,et al.  Formative assessment and self‐regulated learning: a model and seven principles of good feedback practice , 2006 .

[83]  S. Crawford,et al.  Assessing the effects of integrating the reflective framework for teaching in physical education (RFTPE) on the teaching and learning of undergraduate sport studies and physical education students , 2012 .