Factors shaping e-feedback utilization following electronic Objective Structured Clinical Examinations.

The development of student-practitioners' practical clinical skills is essential in health professional education. Objective Structured Clinical Examinations are central to the assessment of students performing clinical procedures on simulated patients (actors). While feedback is considered core to learning providing timely, individualised student OSCE feedback is difficult. This study explored the perceptions of students about the multiple factors which shape the utility of e-feedback following an electronic Objective Structured Clinical Examinations, which utilized iPad and specialised software. The e-feedback was trialled in four courses within occupational therapy and physiotherapy pre-professional programs with a cohort of 204 students. Evaluation of student perceptions about feedback was collected using two surveys and eight focus groups. This data showed three factors shaped perceptions of the utility of e- Objective Structured Clinical Examinations feedback: 1) timely accessibility within one day of the assessment, 2) feedback demonstrating examiners' academic literacy and 3) feedback orientated to ways of improving future performance of clinical skills. The study found training in the provision of feedback using IPads and software is needed for examiners to ensure e-feedback meets students' needs for specific, future-oriented e-feedback and institutional requirements for justification of grades.

[1]  S. Parboteeah,et al.  Thematic analysis of written assignment feedback: implications for nurse education. , 2009, Nurse education today.

[2]  Janice Orrell,et al.  Feedback on learning achievement: rhetoric and reality , 2006 .

[3]  R. Ivanič,et al.  What am I supposed to make of this? : the messages conveyed to students by tutors' written comments. , 2000 .

[4]  Neil Duncan,et al.  ‘Feed‐forward’: improving students' use of tutors' comments , 2007 .

[5]  Jens-Christian Smeby.  Connecting to professional knowledge , 2007 .

[6]  Stephen Merry,et al.  Feedback alignment: effective and ineffective links between tutors’ and students’ understanding of coursework feedback , 2011 .

[7]  P. Black,et al.  Developing the theory of formative assessment , 2009 .

[8]  Schmidts Mb,et al.  OSCE logistics – handheld computers replace checklists and provide automated feedback , 2000 .

[9]  G. Gibbs,et al.  Conditions Under Which Assessment Supports Students’ Learning , 2005 .

[10]  Catherine Mathews,et al.  Rates of Missing Responses in Personal Digital Assistant (PDA) Versus Paper Assessments , 2008, Evaluation review.

[11]  M. Garner,et al.  Is the feedback in higher education assessment worth the paper it is written on? Teachers' reflections on their practices , 2010 .

[12]  A. Onwuegbuzie,et al.  Toward a Definition of Mixed Methods Research , 2007 .

[13]  Moon-Sook Yoo,et al.  Effects of case-based learning on communication skills, problem-solving ability, and learning motivation in nursing students. , 2015, Nursing & health sciences.

[14]  Larry Ambrose,et al.  The power of feedback. , 2002, Healthcare executive.

[15]  N. Denzin,et al.  Collecting and Interpreting Qualitative Materials , 2012 .

[16]  G. Nackman,et al.  Implementation of a novel web-based objective structured clinical evaluation. , 2006, Surgery.

[17]  David Gijbels,et al.  Changing students' approaches to learning: a two‐year study within a university teacher training course , 2009 .

[18]  D. Nicol,et al.  Formative assessment and self‐regulated learning: a model and seven principles of good feedback practice , 2006 .

[19]  M. Price,et al.  Feedback : all that effort, but what is the effect? , 2010 .

[20]  Su-Yoen Park,et al.  Patient safety education and baccalaureate nursing students' patient safety competency: A cross-sectional study. , 2016, Nursing & health sciences.

[21]  Jill Taylor,et al.  Using Mobile Technologies for Assessment and Learning in Practice Settings: Outcomes of Five Case Studies , 2009 .

[22]  V. Shute.  Focus on Formative Feedback , 2008 .

[23]  C. Beaumont,et al.  Reconceptualising assessment feedback: a key to improving student learning? , 2011 .

[24]  Daniel Trottier,et al.  Administering a Gross Anatomy Exam Using Mobile Technology: How one medical school made the switch from paper to paperless. , 2011, ELERN.

[25]  S. Drew.  Perceptions of What Helps Learn and Develop in Education , 2001 .

[26]  Jinrui Li,et al.  Review of assessment feedback , 2014 .

[27]  V. Shute.  Focus on Formative Feedback. Research Report. ETS RR-07-11. , 2007 .

[28]  D. Sadler.  Beyond feedback: developing student capability in complex appraisal , 2010 .

[29]  Johnny Saldaña,et al.  The Coding Manual for Qualitative Researchers , 2009 .

[30]  Darren A. Rivett,et al.  Implementation of an electronic Objective Structured Clinical Exam for assessing practical skills in pre-professional physiotherapy and occupational therapy programs: Examiner and course coordinator perspectives , 2014 .

[31]  T. Brown,et al.  Relationship between clinical fieldwork educator performance and health professional students' perceptions of their practice education learning environments. , 2013, Nursing & health sciences.