Magnified Real-Time Tomographic Reflection

Real Time Tomographic Reflection (RTTR) permits in situ visualization of ultrasound images so that direct hand-eye coordination can be employed during invasive procedures. The method merges the visual outer surface of a patient with a simultaneous ultrasound scan of the patient's interior. It combines a flat-panel monitor with a half-silvered mirror such that the image on the monitor is reflected precisely into the proper location within the patient. The ultrasound image is superimposed in real time on the patient merging with the operator's hands and any invasive tools in the field of view. We aim to extend this method to remote procedures at different scales, in particular to real-time in vivo tomographic microscopic imaging modalities such as optical coherence tomography (OCT) and ultrasound backscatter microscopy (USB). This paper reports our first working prototype using a mechanically linked system to magnify ultrasound-guided manipulation by a factor of four.

[1]  Ronald Azuma,et al.  A Survey of Augmented Reality , 1997, Presence: Teleoperators & Virtual Environments.

[2]  J. Thompson,et al.  High-resolution ultrasound to diagnose melanoma metastases in patients with clinically palpable lymph nodes. , 1999, Australasian radiology.

[3]  Wolfgang Birkfellner,et al.  The Varioscope AR - A Head-Monted Operating Microscope for Augmented Reality , 2000, MICCAI.

[4]  Mary C. Whitton,et al.  Technologies for augmented reality systems: realizing ultrasound-guided needle biopsies , 1996, SIGGRAPH.

[5]  A M DiGioia,et al.  Augmented reality and its future in orthopaedics. , 1998, Clinical orthopaedics and related research.

[6]  Mary C. Whitton,et al.  Towards Performing Ultrasound-Guided Needle Biopsies from within a Head-Mounted Display , 1996, VBC.

[7]  Ronald Azuma,et al.  A survey of augmented reality" Presence: Teleoperators and virtual environments , 1997 .

[8]  Abdominal Percutaneous Interventional Procedures: Comparison of CT and US Guidance , 1998 .

[9]  R C Nelson,et al.  Sonography: the undiscovered jewel of interventional radiology. , 1996, Radiographics : a review publication of the Radiological Society of North America, Inc.

[10]  William M. Wells,et al.  Medical Image Computing and Computer-Assisted Intervention — MICCAI’98 , 1998, Lecture Notes in Computer Science.

[11]  Ramesh Raskar,et al.  Augmented Reality Visualization for Laparoscopic Surgery , 1998, MICCAI.

[12]  George D. Stetten.  Real Time Tomographic Reflection with Ultrasound: Stationary and Hand-Held Implementations , 2000 .

[13]  Ken Masamune,et al.  Three-Dimensional Slice Image Overlay System with Accurate Depth Perception for Surgery , 2000, MICCAI.

[14]  G. Stetten,et al.  Overlaying ultrasonographic images on direct vision. , 2001, Journal of ultrasound in medicine : official journal of the American Institute of Ultrasound in Medicine.

[15]  H. Holm,et al.  Interventional ultrasound. , 1996, Ultrasound in medicine & biology.

[16]  D L Farkas,et al.  Noninvasive imaging of living human skin with dual-wavelength optical coherence tomography in two and three dimensions. , 1998, Journal of biomedical optics.

[17]  Anthony M. DiGioia,et al.  Augmented reality and its future in orthopaedics : Computer assisted orthopaedic surgery: Medical robotics and image guided surgery , 1998 .

[18]  George D. Stetten,et al.  Tomographic reflection to merge ultrasound images with direct vision , 2000, Proceedings 29th Applied Imagery Pattern Recognition Workshop.

[19]  D. Hill,et al.  Augmentation of reality using an operating microscope for otolaryngology and neurosurgical guidance. , 1995, Journal of image guided surgery.