A flexible tracking concept applied to medical scenarios using an AR window

This paper presents an approach to use a semitransparent display as a kind of window into a patient in the context of medical augmented reality (AR) applications. Besides the presentation of the non-off-the-shelf display, the tracking aspects of such an application are the focus of the work presented. In order to allow augmentations of real objects by virtual ones on the display, the user (i.e. physician), the display, the object (i.e. patient) and optional instruments have to be tracked. If required, a tracking system consisting of more than one subsystem, e.g. optical tracking combined with electromagnetic tracking, is used to satisfy all the needs of such a medical application.

[1]  Michael Gervautz,et al.  CCD‐Camera Based Optical Beacon Tracking for Virtual and Augmented Reality , 1996, Comput. Graph. Forum.

[2]  Takeyoshi Dohi.  Robotics for Computer Aided Surgery , 1996 .

[3]  Klaus Dorfmüller.  An Optical Tracking System for VR/AR-Applications , 1999, EGVE.

[4]  Takeo Kanade,et al.  An Image Overlay System for Medical Data Visualization , 1998, MICCAI.

[5]  David J. Hawkes,et al.  Stereo Augmented Reality in the Surgical Microscope , 2000, Presence: Teleoperators & Virtual Environments.

[6]  Erwin Keeve,et al.  Stereoscopic augmented reality system for computer-assisted surgery , 2001, CARS.

[7]  Thomas A. DeFanti,et al.  Varrier autostereographic display , 2001, IS&T/SPIE Electronic Imaging.

[8]  Axel Pinz,et al.  A new optical tracking system for virtual and augmented reality applications , 2001, IMTC 2001. Proceedings of the 18th IEEE Instrumentation and Measurement Technology Conference. Rediscovering Measurement in the Age of Informatics (Cat. No.01CH 37188).

[9]  T. DeFanti,et al.  The Varrier TM Auto-Stereographic Display , 2001 .

[10]  S Nakajima,et al.  Three-dimensional medical imaging display with computer-generated integral photography. , 2001, Computerized medical imaging and graphics : the official journal of the Computerized Medical Imaging Society.

[11]  George D. Stetten,et al.  Real time tomographic reflection: phantoms for calibration and biopsy , 2001, Proceedings IEEE and ACM International Symposium on Augmented Reality.