How Did Crew Resource Management Take-Off Outside of the Cockpit? A Systematic Review of How Crew Resource Management Training Is Conceptualised and Evaluated for Non-Pilots

Crew resource management (CRM) training for flight crews is widespread and has been credited with improving aviation safety. As other industries have adopted CRM, they have interpreted CRM in different ways. We sought to understand how industries have adopted CRM, regarding its conceptualisation and evaluation. For this, we conducted a systematic review of CRM studies in the Maritime, Nuclear Power, Oil and Gas, and Air Traffic Control industries. We searched three electronic databases (Web of Science, Science Direct, Scopus) and CRM reviews for papers. We analysed these papers on their goals, scope, levers of change, and evaluation. To synthesise, we compared the analysis results across industries. We found that most CRM programs have the broad goals of improving safety and efficiency. However, there are differences in the scope and levers of change between programs, both within and between industries. Most evaluative studies suffer from methodological weaknesses, and the evaluation does not align with how studies conceptualise CRM. These results challenge the assumption that there is a clear link between CRM training and enhanced safety in the analysed industries. Future CRM research needs to provide a clear conceptualisation—how CRM is expected to improve safety—and select evaluation measures consistent with this.

[1]  Johan Bergström,et al.  One event, three investigations: The reproduction of a safety norm , 2017 .

[2]  Paul O'Connor,et al.  The U.S. Navy's Crew Resource Management program: the past, present, and recommendations for the future. , 2010 .

[3]  Rhona Flin,et al.  Crew resource management for teams in the offshore oil industry , 2013 .

[4]  Katherine A. Wilson,et al.  Crew Resource Management Training Research, Practice, and Lessons Learned: , 2006 .

[5]  Rhona Flin,et al.  Crew Resource Management training for offshore oil production teams , 2003 .

[6]  Kyeongtae Kim,et al.  Shared Perception of Risks in Emergency Situations between Pilots and Air Traffic Controllers , 2006 .

[7]  Jung-Sik Jeong,et al.  A Study on the Effective Teaching Method for Bridge Resource Management in Korea , 2012 .

[8]  Eduardo Salas,et al.  Does Crew Resource Management Training Work? An Update, an Extension, and Some Critical Needs , 2006, Hum. Factors.

[9]  Edward D. Henderson.  Air Traffic Controller Awareness and Resource Training , 1988 .

[10]  Takashi Miwa,et al.  Development of quantitative team performance evaluation method for ERM , 2015 .

[11]  Radu Hanzu-Pazara,et al.  Human response in navigation emergency situation , 2010 .

[12]  R. Houston.  RESOURCE MANAGEMENT IN THE COCKPIT. , 1990 .

[13]  Paul O'Connor.  Methods used to evaluate the effectiveness of CRM training: A literature review. , 2002 .

[14]  R L Helmreich,et al.  Cockpit resource management: exploring the attitude-performance linkage. , 1986, Aviation, space, and environmental medicine.

[15]  Sa Kil Kim,et al.  Effects of Crew Resource Management Training on the Team Performance of Operators in an Advanced Nuclear Power Plant , 2011 .

[16]  Margaret T. Crichton,et al.  Improving team effectiveness using tactical decision games , 2009 .

[17]  J. Davies.  Enhancing human performance in the control room. Sharing the experiences of British Energy , 2001 .

[18]  Kathryn Mearns,et al.  Crew Resource Management for Offshore Production and Maintenance , 1999 .

[19]  H. A. Dykhuizen,et al.  Instruction, training and expertise advancement of pilots : The key elements : In obtaining the highest possible quality of certified pilots , 1997 .

[20]  Jon Ivar Håvold,et al.  The Human Factor and Simulator Training for Offshore Anchor Handling Operators , 2015 .

[21]  Rhona Flin,et al.  Identifying and training non-technical skills of nuclear emergency response teams , 2004 .

[22]  Alan M. Wang,et al.  Virtual Simulation Program and Its Application for Challenging Floatover Installation of Liwan 3-1 Mega Topsides in South China Sea , 2014 .

[23]  Bennett E. Postlethwaite,et al.  Reaping the benefits of task conflict in teams: the critical role of team psychological safety climate. , 2012, The Journal of applied psychology.

[24]  Margaret Crichton,et al.  Investigating Non-technical Skills through Team Behavioral Markers in Oil and Gas Simulation-based Exercises , 2015 .

[25]  J Rasmussen,et al.  Human error and the problem of causality in analysis of accidents. , 1990, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[26]  E. Hollnagel,et al.  What-You-Look-For-Is-What-You-Find - The consequences of underlying accident models in eight accident investigation manuals , 2009 .

[27]  John Thorogood,et al.  Threat-and-Error Management: The Connection Between Process Safety and Practical Action at the Worksite , 2014 .

[28]  D.K. Harrington,et al.  Systematic evaluation of nuclear operator team skills training: a progress report , 1992, Conference Record for 1992 Fifth Conference on Human Factors and Power Plants.

[29]  P. O'Connor,et al.  A meta-analysis of the effectiveness of crew resource management training in acute care domains , 2014, Postgraduate Medical Journal.

[30]  Clint A. Bowers,et al.  A Methodology for Enhancing Crew Resource Management Training , 1999, Hum. Factors.

[31]  E Asyali,et al.  Cooperative Learning and Teamwork Effectiveness: Impacts of Education Period on Cadets , 2005 .

[32]  D. Moher,et al.  Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement , 2009, BMJ.

[33]  Sa Kil Kim,et al.  Crew resource management training for improving team performance of operators in Korean advanced nuclear power plant , 2009, 2009 IEEE International Conference on Industrial Engineering and Engineering Management.

[34]  Rhona Flin,et al.  Identifying the team skills required by nuclear power plant operations personnel , 2008 .

[35]  Sallie J. Weaver,et al.  The Anatomy of Health Care Team Training and the State of Practice: A Critical Review , 2010, Academic medicine : journal of the Association of American Medical Colleges.

[36]  T. A. Grinde,et al.  Emergency Resource Management Training , 1994 .

[37]  Lynne Martin,et al.  Development of the NOTECHS (non-technical skills) system for assessing pilots’ CRM skills , 2018, Human Factors and Aerospace Safety.

[38]  Kathryn Mearns,et al.  Factoring the Human into Safety: Translating Research into Practice: Crew Resource Management Training for Offshore Operations , 2002 .

[39]  Chang-Je Kim.  Maritime Education and Training(MET) by Ship Handling Simulator , 2002 .

[40]  M. Buljac-Samardžić,et al.  Interventions to improve team effectiveness: a systematic review. , 2010, Health policy.

[41]  Rhona Flin and Paul O’Connor,et al.  Applying Crew Resource Management on Offshore Oil Platforms , 2001 .

[42]  Patrick Stuart Murray,et al.  Crew Resource Management , 2010 .

[43]  D. Moher,et al.  Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement , 2009, BMJ : British Medical Journal.

[44]  Graham D. Edkins,et al.  A REVIEW OF THE BENEFITS OF AVIATION HUMAN FACTORS TRAINING , 2002 .

[45]  M. Barnett,et al.  A Research Agenda in Maritime Crew Resource Management. , 2003 .

[46]  Katherine A. Wilson,et al.  Crew Resource Management Training Effectiveness: A Meta-Analysis and Some Critical Needs , 2008 .

[47]  K Inoue,et al.  Quantitative Evaluation of Consciousness Improvement in BRM Training , 2005 .

[48]  Michiel Woldring.  Team resource management in European Air Traffic Control , 1999 .

[49]  Stefan Röttger,et al.  Ship Management Attitudes and Their Relation to Behavior and Performance , 2013, Hum. Factors.

[50]  Margareta Lützhöft,et al.  Interim results of a longitudinal study into the perceptions of bridge team management (BTM) in pilotage waters as experienced by deck officers studying at the Australian Maritime College , 2014 .

[51]  E. Salas,et al.  Military Team Research: 10 Years of Progress , 1995 .

[52]  Tae-Gweon Jeong,et al.  A Cyber-Training & Education Model for Tug-barge Operators , 2010 .