Improving radiation oncology providers' workload and performance: Can simulation-based training help?

PURPOSE To help with ongoing safety challenges in radiation therapy (RT), the objective of this research was to develop and assess the impact of a simulation-based training intervention on radiation oncology providers' workload and performance during treatment planning and quality assurance (QA) tasks. METHODS AND MATERIALS Eighteen radiation oncology professionals completed routine treatment planning and QA tasks on 2 clinical scenarios in a simulation laboratory as part of a prospective institutional review board-approved study. Workload was measured at the end of each assessment/scenario using the NASA Task-Load Index. Performance was quantified based on procedural compliance (adherence to preset/standard QA tasks), time-to-scenario completion, and clinically relevant performance. Participants were then randomized to receive (vs not receive) simulation-based training intervention (eg, standardized feedback on workload and performance) and underwent repeat measurements of workload and performance. Pre- and postintervention changes in workload and performance from participants who received (vs did not receive) were compared using 2-way analysis of variance. RESULTS Simulation-based training was associated with significant improvements in procedural compliance (P = .01) and increases in time-to-scenario completion (P < .01) but had no significant impact on subjective workload or clinically relevant performance. CONCLUSION Simulation-based training may be a tool to improve procedural compliance of RT professionals and to acquire new skills and knowledge to proactively maintain RT professionals' preoccupation with patient safety.

[1]  Sasa Mutic,et al.  Event (error and near-miss) reporting and learning system for process improvement in radiation oncology. , 2010, Medical physics.

[2]  Prithima R Mosaly,et al.  Quantifying the impact of cross coverage on physician's workload and performance in radiation oncology. , 2013, Practical radiation oncology.

[3]  Sandra G. Hart,et al.  Nasa-Task Load Index (NASA-TLX); 20 Years Later , 2006 .

[4]  R. Berg,et al.  A Randomized, Controlled Trial of In Situ Pediatric Advanced Life Support Recertification (“Pediatric Advanced Life Support Reconstructed”) Compared With Standard Pediatric Advanced Life Support Recertification for ICU Frontline Providers* , 2014, Critical care medicine.

[5]  T. Pawlicki,et al.  Commentary: Safety considerations in contemporary radiation oncology: Introduction to a series of ASTRO safety white papers. , 2011, Practical radiation oncology.

[6]  D. Murray,et al.  Simulation-based Assessment in Anesthesiology: Requirements for Practical Implementation , 2010, Anesthesiology.

[7]  T Pawlicki,et al.  Consensus recommendations for incident learning database structures in radiation oncology. , 2012, Medical physics.

[8]  N Sevdalis,et al.  The association of workflow interruptions and hospital doctors' workload: a prospective observational study , 2011, BMJ quality & safety.

[9]  Prithima R Mosaly,et al.  Relating physician's workload with errors during radiation therapy planning. , 2014, Practical radiation oncology.

[10]  Sasa Mutic,et al.  An evaluation of departmental radiation oncology incident reports: anticipating a national reporting system. , 2013, International journal of radiation oncology, biology, physics.

[11]  Dimitrios Stefanidis,et al.  Higher Mental Workload is Associated With Poorer Laparoscopic Performance as Measured by the NASA-TLX Tool , 2010, Simulation in healthcare : journal of the Society for Simulation in Healthcare.

[12]  J. Barsuk,et al.  Simulation-based education improves quality of care during cardiac arrest team responses at an academic teaching hospital: a case-control study. , 2008, Chest.

[13]  Mica R. Endsley,et al.  Toward a Theory of Situation Awareness in Dynamic Systems , 1995, Hum. Factors.

[14]  Rema Padman,et al.  Reducing Provider Cognitive Workload in CPOE Use: Optimizing Order Sets , 2013, MedInfo.

[15]  D. Gaba,et al.  Decision-Making and Cognitive Strategies , 2015, Simulation in healthcare : journal of the Society for Simulation in Healthcare.

[16]  Marianne Jackson,et al.  The challenge of maximizing safety in radiation oncology. , 2011, Practical radiation oncology.

[17]  R. Steadman,et al.  Simulation-based training is superior to problem-based learning for the acquisition of critical assessment and management skills* , 2006, Critical care medicine.

[18]  E. Ford,et al.  The effectiveness of pretreatment physics plan review for detecting errors in radiation therapy. , 2016, Medical physics.

[19]  David J Hoopes,et al.  RO-ILS: Radiation Oncology Incident Learning System: A report from the first year of experience. , 2015, Practical radiation oncology.

[20]  John A Vozenilek,et al.  Future directions: a simulation-based continuing medical education network in emergency medicine. , 2008, Academic emergency medicine : official journal of the Society for Academic Emergency Medicine.

[21]  Sasa Mutic,et al.  Quality control quantification (QCQ): a tool to measure the value of quality control checks in radiation oncology. , 2012, International journal of radiation oncology, biology, physics.

[22]  Eric C Ford,et al.  Evaluation of safety in a radiation oncology setting using failure mode and effects analysis. , 2009, International journal of radiation oncology, biology, physics.

[23]  Jing Xu,et al.  Quantitative assessment of workload and stressors in clinical radiation oncology. , 2012, International journal of radiation oncology, biology, physics.

[24]  T. Pawlicki,et al.  Enhancing the role of case-oriented peer review to improve quality and safety in radiation oncology: Executive summary , 2013, Practical radiation oncology.

[25]  S. Hart,et al.  Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research , 1988 .

[26]  P. Pronovost,et al.  Medical Physics Practice Guideline 4.a: Development, implementation, use and maintenance of safety checklists , 2015, Journal of applied clinical medical physics.

[27]  Glyn Elwyn,et al.  High workload and job stress are associated with lower practice performance in general practice: an observational study in 239 general practices in the Netherlands , 2009, BMC health services research.

[28]  Rebecca A. Grier How High is High? A Meta-Analysis of NASA-TLX Global Workload Scores , 2015 .

[29]  D. L. Simms,et al.  Normal Accidents: Living with High-Risk Technologies , 1986 .