Full scale computer simulators in anesthesia training and evaluation

PurposeWith the advent of competency-based curriculum, technology such as full scale computer simulators have acquired an increasingly important role in anesthesia both in training and evaluation. This article reviews the current role of full scale computer simulators in teaching and evaluation in anesthesia.SourceThis review draws from existing anesthesia and medical education literature in order to examine and assess the current role of full scale computer simulators in anesthesia education today.Principal findingsThe last decade has witnessed a major increase in the use of full scale computer simulators in anesthesia. Many applications have been found for these simulators including teaching and training, evaluation and research. Despite the increasing use and application of full scale computers in anesthesia in the area of teaching and training, definitive studies evaluating its cost effectiveness, its efficacy compared to traditional training methods or its impact on patient outcome are still pending. Although there is some preliminary evidence of reliability and validity in using the simulator to evaluate clinical competence, development in this area has not progressed enough to justify its use in formal, summative evaluation of competence in anesthesia at this time.ConclusionsAs technology acquires an increasingly important role in medical education, full scale computer simulators represent an exciting potential in anesthesia. However, the full potential and role of simulators in anesthesia is still in development and will require a dovetailing of clinical theory and practice with current research in medical education.RésuméObjectifAvec l’avènement du programme d’enseignement axé sur les compétences, une technologie comme celle des simulateurs informatisés grandeur nature a acquis un rôle sans cesse plus important pour la formation et l’évaluation en anesthésie. Le présent article passe en revue le rôle actuel de ces simulateurs en anesthésie.SourceNous avons extrait des publications existantes sur la formation en anesthésie et en médecine les données qui nous ont permis de vérifier et d’évaluer le rôle actuel des simulateurs.Constatations principalesAu cours de la dernière décennie, l’usage des simulateurs informatisés grandeur nature s’est grandement développée en anesthésie. Ces simulateurs ont été trouvés utiles dans l’enseignement et la formation, l’évaluation et la recherche. Malgré leur usage croissant et la multiplicité de leurs applications dans l’enseignement et la formation en anesthésie, des études formelles qui évaluent la rentabilité des simulateurs, leur efficacité comparée aux méthodes de formation traditionnelles ou leur impact sur l’évolution des patients n’ont pas encore été réalisées. Une sorte de fiabilité et de validité préalables à leur usage ont été établies pour évaluer la compétence clinique, mais c’est un domaine qui n’a pas suffisamment évolué pour justifier l’usage actuel de cette technologie dans l’examen formel et le bilan de la compétence en anesthésie.ConclusionLa technologie joue un rôle croissant dans la formation médicale. Les simulateurs informatisés grandeur nature offrent donc de grandes possibilités en anesthésie. Leur développement constant va nécessiter une harmonisation de la théorie et de la pratique cliniques avec la recherche courante en formation médicale.

[1]  A. C. Lee Using simulators for medical students and anesthesia resident education , 1998 .

[2]  Jodi Herold,et al.  Validity and reliability of undergraduate performance assessments in an anesthesia simulator , 2001, Canadian journal of anaesthesia = Journal canadien d'anesthesie.

[3]  K V Iserson,et al.  Simulating our future: real changes in medical education. , 1999, Academic medicine : journal of the Association of American Medical Colleges.

[4]  R. Reznick,et al.  Objective structured assessment of technical skill (OSATS) for surgical residents , 1997, The British journal of surgery.

[5]  G. Miller The assessment of clinical skills/competence/performance , 1990, Academic medicine : journal of the Association of American Medical Colleges.

[6]  G R Norman,et al.  Exploring the etiology of content specificity: factors influencing analogic transfer and problem solving. , 1998, Academic medicine : journal of the Association of American Medical Colleges.

[7]  H. Schwid,et al.  Evaluation of Anesthesia Residents Using Mannequin-based Simulation: A Multiinstitutional Study , 2002, Anesthesiology.

[8]  G R Norman Striking the balance , 1994, Academic medicine : journal of the Association of American Medical Colleges.

[9]  J. Devitt,et al.  The cost for construction and operation of a simulation centre , 1997, Canadian journal of anaesthesia = Journal canadien d'anesthesie.

[10]  C. Carraccio,et al.  Shifting Paradigms: From Flexner to Competencies , 2002, Academic medicine : journal of the Association of American Medical Colleges.

[11]  D. Gaba,et al.  Assessment of Clinical Performance during Simulated Crises Using Both Technical and Behavioral Ratings , 1998, Anesthesiology.

[12]  R. Flin,et al.  The role of non-technical skills in anaesthesia: a review of current literature. , 2002, British journal of anaesthesia.

[13]  D. Gaba,et al.  Crisis Management in Anesthesiology , 1993 .

[14]  K. Fish,et al.  Testing Internal Consistency and Construct Validity During Evaluation of Performance in a Patient Simulator , 1998, Anesthesia and analgesia.

[15]  Vimal Chopra What can you do with a simulator?: quality assurance , 1998 .

[16]  M. Whitcomb Competency-based graduate medical education? Of course! But how should competency be assessed? , 2002, Academic medicine : journal of the Association of American Medical Colleges.

[17]  D. Cleave-Hogg,et al.  Experiential learning in an anaesthesia simulation centre: analysis of students' comments , 2002, Medical teacher.

[18]  Patricia M. Murphy,et al.  Testing the raters: inter-rater reliability of standardized anaesthesia simulator performance , 1997, Canadian journal of anaesthesia = Journal canadien d'anesthesie.

[19]  D. Gaba,et al.  Anesthesia crisis resource management training: teaching anesthesiologists to handle critical incidents. , 1992, Aviation, space, and environmental medicine.

[20]  Pamela J Morgan,et al.  Simulation Technology: A Comparison of Experiential and Visual Learning for Undergraduate Medical Students , 2002, Anesthesiology.

[21]  E. Holmboe,et al.  Methods for Evaluating the Clinical Competence of Residents in Internal Medicine: A Review , 1998, Annals of Internal Medicine.

[22]  Morgan,et al.  Evaluation of medical students’ performance using the anaesthesia simulator , 2000, Medical education.

[23]  Geoffrey R. Norman,et al.  Performance-Based Assessment: Lessons From the Health Professions , 1995 .

[24]  D. Gaba,et al.  A STRATEGY FOR PREVENTING ANESTHESIA ACCIDENTS , 1989, International anesthesiology clinics.

[25]  M. Maze,et al.  Evaluation of high fidelity patient simulator in assessment of performance of anaesthetists. , 2003, British journal of anaesthesia.

[26]  B. Flanagan,et al.  Incorporation of a realistic anesthesia simulator into an anesthesia clerkship , 1998 .

[27]  J. D. Greaves,et al.  Assessment instruments used during anaesthetic simulation: review of published studies. , 2001, British journal of anaesthesia.

[28]  Doreen Cleave-Hogg,et al.  A worldwide survey of the use of simulation in anesthesia , 2002, Canadian journal of anaesthesia = Journal canadien d'anesthesie.

[29]  Anesthesiology simulators: networking is the key , 2002, Canadian journal of anaesthesia = Journal canadien d'anesthesie.

[30]  Robert L. Helmreich,et al.  Turning Silk Purses into Sows’ Ears , 1998 .

[31]  V. Chopra 4 Anaesthesia simulators , 1996 .

[32]  J Spierdijk,et al.  Does training on an anaesthesia simulator lead to improvement in performance? , 1994, British journal of anaesthesia.

[33]  F C Forrest,et al.  Use of a high-fidelity simulator to develop testing of the technical performance of novice anaesthetists. , 2002, British journal of anaesthesia.

[34]  Anne-Sophie Nyssen,et al.  A Comparison of the Training Value of Two Types of Anesthesia Simulators: Computer Screen-Based and Mannequin-Based Simulators , 2002, Anesthesia and analgesia.

[35]  N. Charness,et al.  Expert Performance Its Structure and Acquisition , 2002 .

[36]  J. Shatzer,et al.  For Personal Use Only. Reproduce with Permission from the Lancet Publishing Group. Standard Setting Assessment of Clinical Competence Medical Education Quartet , 2022 .

[37]  W. McGaghie,et al.  Simulation technology for health care professional skills training and assessment. , 1999, JAMA.

[38]  Patricia A. Kapur,et al.  Patient Simulator Competency Testing: Ready for Takeoff? , 1998 .

[39]  M. Cohen,et al.  The Validity of Performance Assessments Using Simulation , 2001, Anesthesiology.

[40]  R L Helmreich,et al.  Anaesthetic simulation and lessons to be learned from aviation , 1997, Canadian journal of anaesthesia = Journal canadien d'anesthesie.