Augmented Reality Visualization for Laparoscopic Surgery

We present the design and a prototype implementation of a three-dimensional visualization system to assist with laparoscopic surgical procedures. The system uses 3D visualization, depth extraction from laparoscopic images, and six degree-of-freedom head and laparoscope tracking to display a merged real and synthetic image in the surgeon’s video-see-through head-mounted display. We also introduce a custom design for this display. A digital light projector, a camera, and a conventional laparoscope create a prototype 3D laparoscope that can extract depth and video imagery.

[1]  Ryutarou Ohbuchi,et al.  Merging virtual objects with the real world: seeing ultrasound imagery within the patient , 1992, SIGGRAPH.

[2]  P. Kelly,et al.  Computer-assisted stereotaxic laser resection of intra-axial brain neoplasms. , 1986, Journal of neurosurgery.

[3]  Mary C. Whitton,et al.  Technologies for augmented reality systems: realizing ultrasound-guided needle biopsies , 1996, SIGGRAPH.

[4]  G M Preminger,et al.  Three-dimensional video imaging for endoscopic surgery. , 1995, Computers in biology and medicine.

[5]  Mary C. Whitton,et al.  Towards Performing Ultrasound-Guided Needle Biopsies from within a Head-Mounted Display , 1996, VBC.

[6]  W. Eric L. Grimson,et al.  Evaluating and Validating an Automated Registration System for Enhanced Reality Visualization in Surgery , 1995, CVRMed.

[7]  Hong Chen,et al.  Observing a volume rendered fetus within a pregnant patient , 1994, Proceedings Visualization '94.

[8]  S. P. Mudur,et al.  Three-dimensional computer vision: a geometric viewpoint , 1993 .

[9]  Marc Levoy,et al.  Zippered polygon meshes from range images , 1994, SIGGRAPH.

[10]  D. Hill,et al.  Augmentation of reality using an operating microscope for otolaryngology and neurosurgical guidance. , 1995, Journal of image guided surgery.

[11]  FuchsHenry,et al.  Merging virtual objects with the real world , 1992 .

[12]  Dan Ionescu,et al.  3-D object model recovery from 2-D images using structured light , 1996, Quality Measurement: The Indispensable Bridge between Theory and Reality (No Measurements? No Science! Joint Conference - 1996: IEEE Instrumentation and Measurement Technology Conference and IMEKO Tec.

[13]  William E. Lorensen,et al.  Enhancing reality in the operating room , 1993, Proceedings Visualization '93.

[14]  Laurence G. Hassebrook,et al.  Topographical analysis with time-modulated structured light , 1995, Defense, Security, and Sensing.