Factors confounding the assessment of reflection

Background: Reflection on experience is an increasingly critical part of professional development and lifelong learning. There is, however, continuing uncertainty about how best to put principle into practice, particularly as regards assessment. This article explores those uncertainties in order to find practical ways of assessing reflection. Discussion: We critically review four problems: 1. Inconsistent definitions of reflection; 2. Lack of standards to determine (in)adequate reflection; 3. Factors that complicate assessment; 4. Internal and external contextual factors affecting the assessment of reflection. Summary: To address the problem of inconsistency, we identified processes that were common to a number of widely quoted theories and synthesised a model, which yielded six indicators that could be used in assessment instruments. We arrived at the conclusion that, until further progress has been made in defining standards, assessment must depend on developing and communicating local consensus between stakeholders (students, practitioners, teachers, supervisors, curriculum developers) about what is expected in exercises and formal tests. Major factors that complicate assessment are the subjective nature of reflection’s content and the dependency on descriptions by persons being assessed about their reflection process, without any objective means of verification. To counter these validity threats, we suggest that assessment should focus on generic process skills rather than the subjective content of reflection and where possible to consider objective information about the triggering situation to verify described reflections. Finally, internal and external contextual factors such as motivation, instruction, character of assessment (formative or summative) and the ability of individual learning environments to stimulate reflection should be considered.

[1]  Steven J Durning,et al.  Second‐year medical students’ motivational beliefs, emotions, and achievement , 2010, Medical education.

[2]  Larrie Greenberg,et al.  The Reflective Practitioner: Reaching for Excellence in Practice , 2005, Pediatrics.

[3]  K. Mann,et al.  Motivation in medical education: how theory can inform our practice. , 1999, Academic medicine : journal of the Association of American Medical Colleges.

[4]  Graham Cheetham,et al.  A new look at competent professional practice , 2000 .

[5]  T. Bourner Assessing Reflective Learning. , 2003 .

[6]  P. de Jonge,et al.  Assessing student reflection in medical practice. The development of an observer‐rated instrument: reliability, validity and initial experiences , 2004, Medical education.

[7]  S. Atkins,et al.  Reflection: a review of the literature. , 1993, Journal of advanced nursing.

[8]  L. Aukes Personal reflection in medical education , 2008 .

[9]  David Kember,et al.  Determining the level of reflective thinking from students' written journals using a coding scheme based on the work of Mezirow , 1999 .

[10]  P. Tomlinson,et al.  Evaluation of a reflective practice intervention to enhance family care. , 2005, Journal of advanced nursing.

[11]  Kevin W Eva,et al.  Self-Assessment in the Health Professions: A Reformulation and Research Agenda , 2005, Academic medicine : journal of the Association of American Medical Colleges.

[12]  S. Duke,et al.  The use of reflection in a palliative care programme: a quantitative study of the development of reflective skills over an academic year. , 2000, Journal of advanced nursing.

[13]  L. Stockhausen The Clinical Learning Spiral: a model to develop reflective practitioners. , 1994, Nurse education today.

[14]  Lars Owe Dahlgren,et al.  To be and to have a critical friend in medical teaching , 2006, Medical education.

[15]  D. Boud,et al.  Reflection, turning experience into learning , 1985 .

[16]  M. Poskiparta,et al.  The development of reflective learning in the context of health counselling and health promotion during nurse education. , 2001, Journal of advanced nursing.

[17]  Paul F. Wimmers,et al.  Clinical Competence: General Ability or Case-specific? , 2007, Advances in health sciences education : theory and practice.

[18]  A. Walmsley,et al.  Profile and competences for the European dentist. , 2005, European journal of dental education : official journal of the Association for Dental Education in Europe.

[19]  Daniel C. West,et al.  Successful Self-Directed Lifelong Learning in Medicine: A Conceptual Model Derived From Qualitative Analysis of a National Survey of Pediatric Residents , 2010, Academic medicine : journal of the Association of American Medical Colleges.

[20]  Henk G Schmidt,et al.  Correlates of Reflective Practice in Medicine , 2005, Advances in health sciences education : theory and practice.

[21]  Jae-Won Moon Reflection in Learning and Professional Development: Theory and Practice , 2005 .

[22]  W. Branch,et al.  What's Important to You?: The Use of Narratives To Promote Self-Reflection and To Understand the Experiences of Medical Residents , 2002, Annals of Internal Medicine.

[23]  Christopher Murray,et al.  Twelve tips for using digital storytelling to promote reflective learning by medical students , 2008, Medical teacher.

[24]  Philip Burnard,et al.  Reflections on reflection. , 2005, Nurse education today.

[25]  J. Hargreaves So how do you feel about that? Assessing reflective practice. , 2004, Nurse education today.

[26]  N. Hatton,et al.  Reflection in teacher education: Towards definition and implementation , 1995 .

[27]  J. Sandars,et al.  Reflective learning and the Net Generation , 2008, Medical teacher.

[28]  J. Greenwood,et al.  Reflective practice: a critique of the work of Argyris and Schön. , 1993, Journal of advanced nursing.

[29]  David Kember,et al.  Development of a Questionnaire to Measure the Level of Reflective Thinking , 2000 .

[30]  Donald A. Sch The reflective practitioner: how professionals think in action , 1983 .

[31]  Sobral An appraisal of medical students’ reflection‐in‐learning , 2000, Medical education.

[32]  S. Leinster,et al.  How medical students demonstrate their professionalism when reflecting on experience , 2009, Medical education.

[33]  J. Eccles,et al.  Expectancy-Value Theory of Achievement Motivation. , 2000, Contemporary educational psychology.

[34]  Heather Fry,et al.  Appraising and assessing reflection in students' writing on a structured worksheet , 2002, Medical education.

[35]  J. Cohen-schotanus,et al.  Development of a student rating scale to evaluate teachers’ competencies for facilitating reflective learning , 2011, Medical education.

[36]  Experiential learning in women's health: medical student reflections , 2006, Medical education.

[37]  Paul Kinnersley,et al.  Students' views of reflective learning techniques: an efficacy study at a UK medical school , 2006, Medical education.

[38]  Fred A. J. Korthagen,et al.  Levels in reflection: core reflection as a means to enhance professional growth , 2005 .

[39]  Fred A. J. Korthagen,et al.  Refraining the Relationship Between Teacher Thinking and Teacher Behaviour: levels in learning about teaching , 1996 .

[40]  John Sandars,et al.  The use of reflection in medical education: AMEE Guide No. 44 , 2009, Medical teacher.

[41]  D. Kolb Experiential Learning: Experience as the Source of Learning and Development , 1983 .

[42]  J. Kruger,et al.  Unskilled and unaware of it: how difficulties in recognizing one's own incompetence lead to inflated self-assessments. , 1999, Journal of personality and social psychology.

[43]  D. Irby,et al.  How Excellent Teachers Are Made: Reflecting on Success to Improve Teaching , 1998, Advances in health sciences education : theory and practice.

[44]  Learning based on patient case reviews: an interview study , 2008, BMC medical education.

[45]  A. W. Evans,et al.  Self-Assessment in Medical Practice , 2002 .

[46]  Dineke E.H. Tigelaar,et al.  Portfolio as a tool to stimulate teachers' reflections , 2006, Medical teacher.

[47]  D. Kember,et al.  Assessing the level of student reflection from reflective journals. , 1995, Journal of advanced nursing.

[48]  K. Mann,et al.  Reflection and reflective practice in health professions education: a systematic review , 2009, Advances in health sciences education : theory and practice.

[49]  L. Boyd Development of reflective judgement in the pre-doctoral dental clinical curriculum. , 2008, European journal of dental education : official journal of the Association for Dental Education in Europe.

[50]  Janke Cohen-Schotanus,et al.  The development of a scale to measure personal reflection in medical practice and education , 2007, Medical teacher.

[51]  Silvia Mamede,et al.  The structure of reflective practice in medicine , 2004, Medical education.