Computer-enhanced stereoscopic vision in a head-mounted operating binocular.

Based on the Varioscope, a commercially available head-mounted operating binocular, we have developed the Varioscope AR, a see through head-mounted display (HMD) for augmented reality visualization that seamlessly fits into the infrastructure of a surgical navigation system. We have assessed the extent to which stereoscopic visualization improves target localization in computer-aided surgery in a phantom study. In order to quantify the depth perception of a user aiming at a given target, we have designed a phantom simulating typical clinical situations in skull base surgery. Sixteen steel spheres were fixed at the base of a bony skull, and several typical craniotomies were applied. After having taken CT scans, the skull was filled with opaque jelly in order to simulate brain tissue. The positions of the spheres were registered using VISIT, a system for computer-aided surgical navigation. Then attempts were made to locate the steel spheres with a bayonet probe through the craniotomies using VISIT and the Varioscope AR as a stereoscopic display device. Localization of targets 4 mm in diameter using stereoscopic vision and additional visual cues indicating target proximity had a success rate (defined as a first-trial hit rate) of 87.5%. Using monoscopic vision and target proximity indication, the success rate was found to be 66.6%. Omission of visual hints on reaching a target yielded a success rate of 79.2% in the stereo case and 56.25% with monoscopic vision. Time requirements for localizing all 16 targets ranged from 7.5 min (stereo, with proximity cues) to 10 min (mono, without proximity cues). Navigation error is primarily governed by the accuracy of registration in the navigation system, whereas the HMD does not appear to influence localization significantly. We conclude that stereo vision is a valuable tool in augmented reality guided interventions.

[1]  Jay B. West,et al.  Predicting error in rigid-body point-based registration , 1998, IEEE Transactions on Medical Imaging.

[2]  Wolfgang Birkfellner,et al.  A head-mounted operating binocular for augmented reality visualization in medicine - design and initial evaluation , 2002, IEEE Transactions on Medical Imaging.

[3]  A M DiGioia,et al.  Augmented reality and its future in orthopaedics. , 1998, Clinical orthopaedics and related research.

[4]  Wolfgang Birkfellner,et al.  PC-Based Control Unit for a Head Mounted Operating Microscope for Augmented Reality Visualization in Surgical Navigation , 2002, MICCAI.

[5]  David J. Hawkes,et al.  Design and evaluation of a system for microscope-assisted guided interventions (MAGI) , 2000 .

[6]  Franz Kainberger,et al.  Evaluation of accuracy of computer-aided intraoperative positioning of endosseous oral implants in the edentulous mandible. , 2002, Clinical oral implants research.

[7]  H Bergmann,et al.  In-vitro assessment of a registration protocol for image guided implant dentistry. , 2001, Clinical oral implants research.

[8]  Roger Y. Tsai,et al.  A versatile camera calibration technique for high-accuracy 3D machine vision metrology using off-the-shelf TV cameras and lenses , 1987, IEEE J. Robotics Autom..

[9]  A Wagner,et al.  Virtual image guided navigation in tumor surgery--technical innovation. , 1995, Journal of cranio-maxillo-facial surgery : official publication of the European Association for Cranio-Maxillo-Facial Surgery.

[10]  Wolfgang Birkfellner,et al.  A modular software system for computer-aided surgery and its first application in oral implantology , 2000, IEEE Transactions on Medical Imaging.

[11]  J. Strohbehn,et al.  A frameless stereotaxic integration of computerized tomographic imaging and the operating microscope. , 1986, Journal of neurosurgery.

[12]  H Bergmann,et al.  Placement of Endosteal Implants in the Zygoma after Maxillectomy: A Cadaver Study Using Surgical Navigation , 2001, Plastic and reconstructive surgery.