Augmented Reality Simulator for Training in Two-Dimensional Echocardiography

In two-dimensional echocardiography the sonographer must synthesize multiple tomographic slices into a mental three-dimensional (3D) model of the heart. Computer graphics and virtual reality environments are ideal to visualize complex 3D spatial relationships. In augmented reality (AR) applications, real and virtual image data are linked, to increase the information content. In the presented AR simulator a 3D surface model of the human heart is linked with echocardiographic volume data sets. The 3D echocardiographic data sets are registered with the heart model to establish spatial and temporal congruence. The heart model, together with an animated ultrasound sector represents a reference scenario, which displays the currently selected two-dimensional echocardiographic cutting plane calculated from the volume data set. Modifications of the cutting plane within the echocardiographic data are transferred and visualized simultaneously and in real time within the reference scenario. The trainee can interactively explore the 3D heart model and the registered 3D echocardiographic data sets by an animated ultrasound probe, whose position is controlled by an electromagnetic tracking system. The tracking system is attached to a dummy transducer and placed on a plastic puppet to give a realistic impression of a two-dimensional echocardiographic examination.

[1]  S. Umeyama,et al.  Least-Squares Estimation of Transformation Parameters Between Two Point Patterns , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  D L Schriger,et al.  Cranial computed tomography interpretation in acute stroke: physician accuracy in determining eligibility for thrombolytic therapy. , 1998, JAMA.

[3]  N L Jain,et al.  Identification of suspected tuberculosis patients based on natural language processing of chest radiograph reports. , 1996, Proceedings : a conference of the American Medical Informatics Association. AMIA Fall Symposium.

[4]  Jonathan P. Weiner,et al.  Agreement Between Physicians' Office Records and Medicare Part B Claims Data , 1995, Health care financing review.

[5]  David Blatner,et al.  Silicon Mirage: The Art and Science of Virtual Reality , 1992 .

[6]  William H. Press,et al.  The Art of Scientific Computing Second Edition , 1998 .

[7]  M.E. Legget,et al.  System for quantitative three-dimensional echocardiography of the left ventricle based on a magnetic-field position and orientation sensing system , 1998, IEEE Transactions on Biomedical Engineering.

[8]  F J Ten Cate,et al.  Accurate measurement of left ventricular ejection fraction by three-dimensional echocardiography. A comparison with radionuclide angiography. , 1996, Circulation.

[9]  G. Hripcsak,et al.  Extracting Findings from Narrative Reports: Software Transferability and Sources of Physician Disagreement , 1998, Methods of Information in Medicine.

[10]  J. Chao,et al.  Continuing medical education software: a comparative review. , 1992, The Journal of family practice.

[11]  D. Norman,et al.  A COMPARISON OF DATA OBTAINED WITH DIFFERENT FALSE-ALARM RATES. , 1964, Psychological review.

[12]  Thorsten Fox,et al.  TiDAS - Interaktive dreidimensionale Gestaltung von angeborenen und erworbenen Herzfehlern , 1996, GMDS.

[13]  Carol Friedman,et al.  Research Paper: A General Natural-language Text Processor for Clinical Radiology , 1994, J. Am. Medical Informatics Assoc..

[14]  Carol Friedman,et al.  Towards a comprehensive medical language processing system: methods and issues , 1997, AMIA.

[15]  T Yambe,et al.  Virtual percutaneous transluminal coronary angioplasty system for an educational support system. , 1998, Artificial organs.

[16]  J Spierdijk,et al.  Does training on an anaesthesia simulator lead to improvement in performance? , 1994, British journal of anaesthesia.

[17]  N L Jain,et al.  Respiratory Isolation of Tuberculosis Patients Using Clinical Guidelines and an Automated Clinical Decision Support System , 1998, Infection Control & Hospital Epidemiology.

[18]  M V Dresser,et al.  Clinical quality measurement. Comparing chart review and automated methodologies. , 1997, Medical care.

[19]  S. Zimmerman,et al.  Accuracy of Medical Records in Hip Fracture , 1998, Journal of the American Geriatrics Society.

[20]  Carol Friedman,et al.  Identification of findings suspicious for breast cancer based on natural language processing of mammogram reports , 1997, AMIA.

[21]  A M DiGioia,et al.  Augmented reality and its future in orthopaedics. , 1998, Clinical orthopaedics and related research.

[22]  W. DuMouchel,et al.  Unlocking Clinical Data from Narrative Reports: A Study of Natural Language Processing , 1995, Annals of Internal Medicine.

[23]  P. Duncan,et al.  Inaccuracy of the International Classification of Diseases (ICD-9-CM) in identifying the diagnosis of ischemic cerebrovascular disease , 1997, Neurology.

[24]  C. Bombardier,et al.  Lack of concordance between the ICD-9 classification of soft tissue disorders of the neck and upper limb and chart review diagnosis: one steel mill's experience. , 1996, American journal of industrial medicine.

[25]  G Fischer,et al.  Virtual reality arthroscopy training simulator. , 1995, Computers in biology and medicine.

[26]  G. Bashein,et al.  A miniature position and orientation locator for three dimensional echocardiography , 1993, Proceedings of Computers in Cardiology Conference.

[27]  M. Yacoub,et al.  Three-dimensional echocardiography can simulate intraoperative visualization of congenitally malformed hearts. , 1995, The Annals of thoracic surgery.

[28]  Jonathan M. Teich,et al.  Research Paper: Identifying Adverse Drug Events: Development of a Computer-based Monitor and Comparison with Chart Review and Stimulated Voluntary Report , 1998, J. Am. Medical Informatics Assoc..

[29]  George Hripcsak,et al.  Research Paper: Automated Tuberculosis Detection , 1997, J. Am. Medical Informatics Assoc..

[30]  Ng Wan Sing,et al.  Augmented reality systems for medical applications. , 1998, IEEE engineering in medicine and biology magazine : the quarterly magazine of the Engineering in Medicine & Biology Society.

[31]  N S Rawson,et al.  Validity of the recording of ischaemic heart disease and chronic obstructive pulmonary disease in the Saskatchewan health care datafiles. , 1995, Statistics in medicine.

[32]  Richard A. Robb.  Three-Dimensional Biomedical Imaging: Principles and Practice , 1995 .

[33]  J W Sundsten,et al.  The digital anatomist information system and its use in the generation and delivery of Web-based anatomy atlases. , 1997, Computers and biomedical research, an international journal.

[34]  R. Sacco,et al.  Leisure-time physical activity and ischemic stroke risk: the Northern Manhattan Stroke Study. , 1998, Stroke.

[35]  R. Tibshirani,et al.  An introduction to the bootstrap , 1993 .

[36]  Donald A. Norman,et al.  A non-parametric analysis of recognition experiments , 1964 .

[37]  A. Pennisi,et al.  Evaluating the accuracy of transcribed computer-stored immunization data. , 1994, Pediatrics.

[38]  F D Hobbs,et al.  Accuracy of routinely collected clinical data on acute medical admissions to one hospital. , 1997, The British journal of general practice : the journal of the Royal College of General Practitioners.

[39]  Hans-Jürgen Seelos.  Medizinische Informatik, Biometrie und Epidemiologie , 1997 .

[40]  N. Facione,et al.  Comparison of methods to determine the prevalence and nature of oral mucositis. , 1996, Cancer practice.

[41]  Don McNicol,et al.  A Primer of Signal Detection Theory , 1976 .