Evaluating postgraduate family medicine supervisor feedback in registrars’ learning portfolios

Background Postgraduate supervision forms a vital component of decentralised family medicine training. While the components of effective supervisory feedback have been explored in high-income countries, how this construct is delivered in resource-constrained low- to middle-income countries has not been investigated adequately. Aim This article evaluated supervisory feedback in family medicine registrars’ learning portfolios (LPs) as captured in their learning plans and mini-Clinical Evaluation Exercise (mini-CEX) forms and whether the training district or the year of training affected the nature of the feedback. Setting Registrars’ LPs from 2020 across five decentralised sites affiliated with the University of the Witwatersrand in South Africa were analysed. Methods Two modified tools were used to evaluate the quantity of the written feedback in 38 learning plans and 57 mini-CEX forms. Descriptive statistics, Fisher’s exact and Wilcoxon rank-sum tests were used for analysis. Content analysis was used to derive counts of areas of feedback. Results Most learning plans (61.2%) did not refer to registrars’ clinical knowledge or offer an improvement strategy (86.1%). The ‘extent of supervisors’ feedback’ was rated as ‘poor’ (63.2%), with only 14.0% rated as ‘good.’ The ‘some’ and ‘no’ feedback categories in the mini-CEX competencies (p < 0.001 to p = 0.014) and the ‘extent of supervisors’ feedback’ (p < 0.001) were significantly associated with training district. Feedback focused less on clinical reasoning and negotiation skills. Conclusion Supervisors should provide specific and constructive narrative feedback and an action plan to improve registrars’ future performance. Contribution Supervisory feedback in postgraduate family medicine training needs overall improvement to develop skilled family physicians.

[1]  L. Jenkins,et al.  Perceptions of postgraduate family medicine supervision at decentralised training sites, South Africa , 2022, African journal of primary health care & family medicine.

[2]  Ramesh Mehay The Essential Handbook for GP Training and Education , 2021 .

[3]  B. Rushforth,et al.  MRCGP in a Nutshell , 2021, The Essential Handbook for GP Training and Education.

[4]  E. Holmboe,et al.  Reimagining Feedback for the Milestones Era. , 2021, Journal of graduate medical education.

[5]  S. Parker,et al.  Guidance for providing effective feedback in clinical supervision in postgraduate medical education: a systematic review , 2021, Postgraduate Medical Journal.

[6]  S. Gawne,et al.  Developing a Workplace-Based Learning Culture in the NHS: Aspirations and Challenges , 2020, Journal of medical education and curricular development.

[7]  L. Schuwirth,et al.  Workplace‐based assessments in postgraduate medical education: A hermeneutic review , 2020, Medical education.

[8]  Jennifer D. Robinson,et al.  Developing Self-Directed Learners , 2020, American Journal of Pharmaceutical Education.

[9]  S. Nedjat,et al.  The utility of mini-Clinical Evaluation Exercise in undergraduate and postgraduate medical education: A BEME review: BEME Guide No. 59 , 2020, Medical teacher.

[10]  R. Mash,et al.  Implementing and evaluating an e-portfolio for postgraduate family medicine training in the Western Cape, South Africa , 2019, BMC medical education.

[11]  V. Burch The Changing Landscape of Workplace-Based Assessment. , 2019 .

[12]  J. Norcini,et al.  The educational impact of Mini-Clinical Evaluation Exercise (Mini-CEX) and Direct Observation of Procedural Skills (DOPS) and its association with implementation: A systematic review and meta-analysis , 2018, PloS one.

[13]  J. Blitz,et al.  Training of workplace-based clinical trainers in family medicine, South Africa: Before-and-after evaluation , 2018, African journal of primary health care & family medicine.

[14]  L. Jenkins,et al.  Family medicine training in Africa: Views of clinical trainers and trainees , 2018, African journal of primary health care & family medicine.

[15]  Erik W. Driessen,et al.  Portfolios in Personal and Professional Development , 2013, Understanding Medical Education.

[16]  R M Djajadi,et al.  Quantity and quality of written feedback, action plans, and student reflections before and after the introduction of a modified mini-CEX assessment form , 2017 .

[17]  R. Hatala,et al.  Guidelines: The do’s, don’ts and don’t knows of direct observation of clinical skills in medical education , 2017, Perspectives on medical education.

[18]  Hae-Young Kim,et al.  Statistical notes for clinical researchers: Chi-squared test and Fisher's exact test , 2017, Restorative dentistry & endodontics.

[19]  J. Blitz,et al.  Training the trainers: beyond providing a well-received course , 2016, Education for primary care : an official publication of the Association of Course Organisers, National Association of GP Tutors, World Organisation of Family Doctors.

[20]  T. Lockspeiser,et al.  Using Individualized Learning Plans to Facilitate Learner-Centered Teaching. , 2016, Journal of pediatric and adolescent gynecology.

[21]  P. Teunissen,et al.  Guidelines: the do’s, don’ts and don’t knows of feedback for clinical education , 2015, Perspectives on medical education.

[22]  M. Sibbald,et al.  Deliberate practice as a framework for evaluating feedback in residency training , 2015, Medical teacher.

[23]  Craig Mellis,et al.  Feedback and assessment for clinical placements: achieving the right balance , 2015, Advances in medical education and practice.

[24]  R. Mash,et al.  The contribution of family physicians to district health services: a national position paper for South Africa , 2015, South African Family Practice.

[25]  A. Gemperli,et al.  The mini‐clinical evaluation exercise during medical clerkships: are learning needs and learning goals aligned? , 2014, Medical education.

[26]  J. Rowley Designing and using research questionnaires , 2014 .

[27]  J. Launer Supervision, Mentoring and Coaching , 2013 .

[28]  A. Derese,et al.  The national portfolio for postgraduate family medicine training in South Africa: a descriptive study of acceptability, educational impact, and usefulness for assessment , 2013, BMC medical education.

[29]  C. V. D. van der Vleuten,et al.  Quality of written narrative feedback and reflection in a modified mini-clinical evaluation exercise: an observational study , 2012, BMC medical education.

[30]  H. Saedon,et al.  The role of feedback in improving the effectiveness of workplace based assessments: a systematic review , 2012, BMC medical education.

[31]  Russell K. Schutt,et al.  Research Methods in Education , 2011 .

[32]  M. Holtman,et al.  The Quality of Written Comments on Professional Behaviors in a Developmental Multisource Feedback Program , 2010, Academic medicine : journal of the Association of American Medical Colleges.

[33]  Tim Swanwick,et al.  Understanding Medical Education: Evidence, Theory and Practice, 1st edn , 2011 .

[34]  Daniel C. West,et al.  Successful Self-Directed Lifelong Learning in Medicine: A Conceptual Model Derived From Qualitative Analysis of a National Survey of Pediatric Residents , 2010, Academic medicine : journal of the Association of American Medical Colleges.

[35]  A. Merry,et al.  Mini-clinical evaluation exercise in anaesthesia training. , 2009, British journal of anaesthesia.

[36]  Erik W Driessen,et al.  Portfolios for assessment and learning: AMEE Guide no. 45 , 2009, Medical teacher.

[37]  Subha Ramani,et al.  AMEE Guide no. 34: teaching in the clinical environment , 2008, Medical teacher.

[38]  J. Norcini,et al.  Workplace-based assessment as an educational tool: AMEE Guide No. 31 , 2007, Medical teacher.

[39]  Janet Grant,et al.  AMEE Guide No. 27: Effective educational and clinical supervision , 2007, Medical teacher.

[40]  E. Holmboe,et al.  Feedback and the mini clinical evaluation exercise , 2004, Journal of General Internal Medicine.

[41]  D. Nicol,et al.  Formative assessment and self‐regulated learning: a model and seven principles of good feedback practice , 2006 .

[42]  E. Paice,et al.  Workplace assessment. , 2005, The British journal of general practice : the journal of the Royal College of General Practitioners.

[43]  Accreditation Council for Graduate Medical Education Mourns Marvin R. Dunn, Director of Residency Review Committee Activities , 2003, Journal of Investigative Medicine.

[44]  A Stanton,et al.  Effective clinical supervision. , 2000, Nursing management.

[45]  B. Wood Feedback: a key feature of medical training. , 2000, Radiology.

[46]  J. Norcini,et al.  The Mini-CEX (Clinical Evaluation Exercise): A Preliminary Investigation , 1995, Annals of Internal Medicine.

[47]  Klaus Krippendorff,et al.  Content Analysis: An Introduction to Its Methodology , 1980 .