Factors confounding the assessment of reflection: a critical review

BackgroundReflection on experience is an increasingly critical part of professional development and lifelong learning. There is, however, continuing uncertainty about how best to put principle into practice, particularly as regards assessment. This article explores those uncertainties in order to find practical ways of assessing reflection.DiscussionWe critically review four problems: 1. Inconsistent definitions of reflection; 2. Lack of standards to determine (in)adequate reflection; 3. Factors that complicate assessment; 4. Internal and external contextual factors affecting the assessment of reflection.SummaryTo address the problem of inconsistency, we identified processes that were common to a number of widely quoted theories and synthesised a model, which yielded six indicators that could be used in assessment instruments. We arrived at the conclusion that, until further progress has been made in defining standards, assessment must depend on developing and communicating local consensus between stakeholders (students, practitioners, teachers, supervisors, curriculum developers) about what is expected in exercises and formal tests. Major factors that complicate assessment are the subjective nature of reflection's content and the dependency on descriptions by persons being assessed about their reflection process, without any objective means of verification. To counter these validity threats, we suggest that assessment should focus on generic process skills rather than the subjective content of reflection and where possible to consider objective information about the triggering situation to verify described reflections. Finally, internal and externalcontextual factors such as motivation, instruction, character of assessment (formative or summative) and the ability of individual learning environments to stimulate reflection should be considered.

[1]  S. Atkins,et al.  Reflection: a review of the literature. , 1993, Journal of advanced nursing.

[2]  J. Mezirow Learning as Transformation: Critical Perspectives on a Theory in Progress. The Jossey-Bass Higher and Adult Education Series. , 2000 .

[3]  D. Schoen,et al.  The Reflective Practitioner: How Professionals Think in Action , 1985 .

[4]  D. Kolb Experiential Learning: Experience as the Source of Learning and Development , 1983 .

[5]  Kevin W Eva,et al.  Self-Assessment in the Health Professions: A Reformulation and Research Agenda , 2005, Academic medicine : journal of the Association of American Medical Colleges.

[6]  J. Kruger,et al.  Unskilled and unaware of it: how difficulties in recognizing one's own incompetence lead to inflated self-assessments. , 1999, Journal of personality and social psychology.

[7]  L. Stockhausen The Clinical Learning Spiral: a model to develop reflective practitioners. , 1994, Nurse education today.

[8]  Lars Owe Dahlgren,et al.  To be and to have a critical friend in medical teaching , 2006, Medical education.

[9]  D. Boud,et al.  Reflection, turning experience into learning , 1985 .

[10]  A. Walmsley,et al.  Profile and competences for the graduating European dentist - update 2009. , 2010, European journal of dental education : official journal of the Association for Dental Education in Europe.

[11]  Cees P M van der Vleuten,et al.  Conditions for successful reflective use of portfolios in undergraduate medical education , 2005, Medical education.

[12]  J. Appleton,et al.  The use of reflection in a palliative care programme: a quantitative study of the development of reflective skills over an academic year. , 2000, Journal of advanced nursing.

[13]  M. Poskiparta,et al.  The development of reflective learning in the context of health counselling and health promotion during nurse education. , 2001, Journal of advanced nursing.

[14]  M. Oliver,et al.  Self-assessment in medical practice. , 2002, Journal of the Royal Society of Medicine.

[15]  J. Dewey,et al.  How We Think , 2009 .

[16]  A. Walmsley,et al.  Profile and competences for the European dentist. , 2005, European journal of dental education : official journal of the Association for Dental Education in Europe.

[17]  David Kember,et al.  Determining the level of reflective thinking from students' written journals using a coding scheme based on the work of Mezirow , 1999 .

[18]  Heather Fry,et al.  Appraising and assessing reflection in students' writing on a structured worksheet , 2002, Medical education.

[19]  Dineke E.H. Tigelaar,et al.  Portfolio as a tool to stimulate teachers' reflections , 2006, Medical teacher.

[20]  J. Sandars,et al.  Reflective learning and the Net Generation , 2008, Medical teacher.

[21]  Larrie Greenberg,et al.  The Reflective Practitioner: Reaching for Excellence in Practice , 2005, Pediatrics.

[22]  K. Mann,et al.  Motivation in medical education: how theory can inform our practice. , 1999, Academic medicine : journal of the Association of American Medical Colleges.

[23]  J. Eccles,et al.  Expectancy-Value Theory of Achievement Motivation. , 2000, Contemporary educational psychology.

[24]  BMC Medical Education , 2006 .

[25]  J. Cohen-schotanus,et al.  Development of a student rating scale to evaluate teachers’ competencies for facilitating reflective learning , 2011, Medical education.

[26]  Graham Cheetham,et al.  A new look at competent professional practice , 2000 .

[27]  T. Bourner Assessing Reflective Learning. , 2003 .

[28]  P. de Jonge,et al.  Assessing student reflection in medical practice. The development of an observer‐rated instrument: reliability, validity and initial experiences , 2004, Medical education.

[29]  J. Collins Lifelong learning in the 21st century and beyond. , 2009, Radiographics : a review publication of the Radiological Society of North America, Inc.

[30]  Maria Simi,et al.  Reflections about Reflection , 1991, KR.

[31]  Paul F. Wimmers,et al.  Clinical Competence: General Ability or Case-specific? , 2007, Advances in health sciences education : theory and practice.

[32]  O. Harlem,et al.  TOMORROW'S DOCTORS , 1972 .

[33]  P. Tomlinson,et al.  Evaluation of a reflective practice intervention to enhance family care. , 2005, Journal of advanced nursing.

[34]  L. Boyd Development of reflective judgement in the pre-doctoral dental clinical curriculum. , 2008, European journal of dental education : official journal of the Association for Dental Education in Europe.

[35]  Janke Cohen-Schotanus,et al.  The development of a scale to measure personal reflection in medical practice and education , 2007, Medical teacher.

[36]  Jae-Won Moon Reflection in Learning and Professional Development: Theory and Practice , 2005 .

[37]  J. Hargreaves So how do you feel about that? Assessing reflective practice. , 2004, Nurse education today.

[38]  Sobral An appraisal of medical students’ reflection‐in‐learning , 2000, Medical education.

[39]  Henk G Schmidt,et al.  Correlates of Reflective Practice in Medicine , 2005, Advances in health sciences education : theory and practice.

[40]  W. Branch,et al.  What's Important to You?: The Use of Narratives To Promote Self-Reflection and To Understand the Experiences of Medical Residents , 2002, Annals of Internal Medicine.

[41]  Christopher Murray,et al.  Twelve tips for using digital storytelling to promote reflective learning by medical students , 2008, Medical teacher.

[42]  N. Hatton,et al.  Reflection in teacher education: Towards definition and implementation , 1995 .

[43]  D. Schoen Educating the reflective practitioner , 1987 .

[44]  D. Kember,et al.  Assessing the level of student reflection from reflective journals. , 1995, Journal of advanced nursing.

[45]  Martin Valcke,et al.  Factors confounding the assessment of reflection , 2012 .

[46]  Experiential learning in women's health: medical student reflections , 2006, Medical education.

[47]  Paul Kinnersley,et al.  Students' views of reflective learning techniques: an efficacy study at a UK medical school , 2006, Medical education.

[48]  Fred A. J. Korthagen,et al.  Levels in reflection: core reflection as a means to enhance professional growth , 2005 .

[49]  Fred A. J. Korthagen,et al.  Refraining the Relationship Between Teacher Thinking and Teacher Behaviour: levels in learning about teaching , 1996 .

[50]  R. Harden,et al.  The Scottish doctor--learning outcomes for the medical undergraduate in Scotland: a foundation for competent and reflective practitioners , 2002, Medical teacher.

[51]  John Sandars,et al.  The use of reflection in medical education: AMEE Guide No. 44 , 2009, Medical teacher.

[52]  J. Mezirow Learning as Transformation: Critical Perspectives on a Theory in Progress , 2000 .

[53]  K. Mann,et al.  Reflection and reflective practice in health professions education: a systematic review , 2009, Advances in health sciences education : theory and practice.

[54]  Silvia Mamede,et al.  The structure of reflective practice in medicine , 2004, Medical education.

[55]  D. Irby,et al.  How Excellent Teachers Are Made: Reflecting on Success to Improve Teaching , 1998, Advances in health sciences education : theory and practice.

[56]  Learning based on patient case reviews: an interview study , 2008, BMC medical education.

[57]  Daniel C. West,et al.  Successful Self-Directed Lifelong Learning in Medicine: A Conceptual Model Derived From Qualitative Analysis of a National Survey of Pediatric Residents , 2010, Academic medicine : journal of the Association of American Medical Colleges.

[58]  J. Greenwood,et al.  Reflective practice: a critique of the work of Argyris and Schön. , 1993, Journal of advanced nursing.

[59]  David Kember,et al.  Development of a Questionnaire to Measure the Level of Reflective Thinking , 2000 .

[60]  S. Leinster,et al.  How medical students demonstrate their professionalism when reflecting on experience , 2009, Medical education.

[61]  Steven J Durning,et al.  Second‐year medical students’ motivational beliefs, emotions, and achievement , 2010, Medical education.

[62]  L. Aukes Personal reflection in medical education , 2008 .