Optical Versus Video See-Through Head-Mounted Displays in Medical Visualization

We compare two technological approaches to augmented reality for 3-D medical visualization: optical and video see-through devices. We provide a context to discuss the technology by reviewing several medical applications of augmented-reality re search efforts driven by real needs in the medical field, both in the United States and in Europe. We then discuss the issues for each approach, optical versus video, from both a technology and human-factor point of view. Finally, we point to potentially promising future developments of such devices including eye tracking and multifocus planes capabilities, as well as hybrid optical/video technology.

[1]  Ivan E. Sutherland.  A head-mounted three dimensional display , 1998 .

[2]  B. Peuchot.  Camera virtual equivalent model 0.01 pixel detectors. , 1993, Computerized Medical Imaging and Graphics.

[3]  FuchsHenry,et al.  Merging virtual objects with the real world , 1992 .

[4]  J P Rolland,et al.  Modeling of a knee joint for the VRDA tool. , 1998, Studies in health technology and informatics.

[5]  S. Ellis.  Pictorial communication in virtual and real environments , 1991 .

[6]  B. Peuchot.  Utilisation de détecteurs subpixels dans la modélisation d'une caméra : Vérification de l'hypothèse Sténopé , 1997 .

[7]  Jannick P. Rolland,et al.  Depth judgments in a see-through head-mounted display , 1997, Defense, Security, and Sensing.

[8]  Hong Chen,et al.  Observing a volume rendered fetus within a pregnant patient , 1994, Proceedings Visualization '94.

[9]  J P Rolland,et al.  High-resolution inset head-mounted display. , 1998, Applied optics.

[10]  V. Rich.  Personal communication , 1989, Nature.

[11]  Henry Fuchs,et al.  Frameless rendering: double buffering considered harmful , 1994, SIGGRAPH.

[12]  Jannick P. Rolland,et al.  Towards Quantifying Depth and Size Perception in Virtual Environments , 1993, Presence: Teleoperators & Virtual Environments.

[13]  Ulrich Neumann,et al.  Dynamic registration correction in video-based augmented reality systems , 1995, IEEE Computer Graphics and Applications.

[14]  Yohan Baillot,et al.  First implementation of the virtual reality dynamic anatomy tool , 1999 .

[15]  Alain Tanguy,et al.  Dispositif optique pour la visualisation d'une image virtuelle tridimensionnelle en superposition avec un objet reel, notamment pour des applications chirurgicales , 1995 .

[16]  Thomas A. Furness.  The Super Cockpit and its Human Factors Challenges , 1986 .

[17]  Henry Fuchs,et al.  Comparison of optical and video see-through, head-mounted displays , 1995, Other Conferences.

[18]  Jannick P. Rolland,et al.  Conformal optics for 3D visualization , 1998, Other Conferences.

[19]  Ryutarou Ohbuchi,et al.  Merging virtual objects with the real world: seeing ultrasound imagery within the patient , 1992, SIGGRAPH.

[20]  Grigore C. Burdea,et al.  A Novel Virtual Reality Tool for Teaching Dynamic 3D Anatomy , 1995, CVRMed.

[21]  Ronald Azuma,et al.  Improving static and dynamic registration in an optical see-through HMD , 1994, SIGGRAPH.

[22]  J. Rolland,et al.  Using virtual reality to teach radiographic positioning. , 1995, Radiologic technology.

[23]  J P Rolland,et al.  Engineering of head-mounted projective displays. , 2000, Applied optics.

[24]  R A Buchroeder,et al.  Design of a Catadioptric VCASS Helmet-Mounted Display , 1981 .

[25]  Michael Bajura,et al.  Merging Virtual Objects with the Real World , 1992 .

[26]  James E. Cutting,et al.  Chapter 3 – Perceiving Layout and Knowing Distances: The Integration, Relative Potency, and Contextual Use of Different Information about Depth* , 1995 .

[27]  Greg Welch,et al.  SCAAT: incremental tracking with incomplete information , 1997, SIGGRAPH.

[28]  David W. Allen.  A 1" high resolution field sequential display for head mounted applications , 1993, Proceedings of IEEE Virtual Reality Annual International Symposium.

[29]  Alexei A. Goon,et al.  Multifocal planes head-mounted displays. , 2000, Applied optics.

[30]  Parravano Jg,et al.  Postprocessing conventional vs. fast spin echo MR images. , 1995 .

[31]  Ellen J. Scher Zagier.  A human's eye view: motion blur and frameless rendering , 1997, CROS.

[32]  I. Rock.  The nature of perceptual adaptation , 1969 .

[33]  Jannick P. Rolland,et al.  Video see-through design for merging of real and virtual environments , 1993, Proceedings of IEEE Virtual Reality Annual International Symposium.

[34]  James E. Cutting,et al.  Perceiving Layout and Knowing Distances , 1995 .

[35]  Benjamin Watson,et al.  Using texture maps to correct for optical distortion in head-mounted displays , 1995, Proceedings Virtual Reality Annual International Symposium '95.

[36]  Frank Biocca,et al.  Virtual Eyes Can Rearrange Your Body: Adaptation to Visual Displacement in See-Through, Head-Mounted Displays , 1998, Presence.

[37]  Mark A. Livingston,et al.  Managing latency in complex augmented reality systems , 1997, SI3D.

[38]  D. Hill,et al.  Augmentation of reality using an operating microscope for otolaryngology and neurosurgical guidance. , 1995, Journal of image guided surgery.

[39]  Stanley N. Roscoe,et al.  The eyes prefer real images , 1991 .

[40]  Ellen J. Scher Zagier,et al.  A human's eye view: motion blur and frameless rendering , 1997, CROS.

[41]  B. Welch,et al.  The Fiber-Optic Helmet-Mounted Display, , 1984 .

[42]  Ivan E. Sutherland,et al.  The Ultimate Display , 1965 .

[43]  B. Bridgeman,et al.  Alternating prism exposure causes dual adaptation and generalization to a novel displacement , 1993, Perception & psychophysics.

[44]  Justin G. Droessler,et al.  Tilted cat helmet-mounted display , 1990 .

[45]  J. Rolland,et al.  A non-intrusive display technique for providing real-time data within a surgeons critical area of interest. , 1998, Studies in health technology and informatics.

[46]  Michael Deering,et al.  High resolution virtual reality , 1992, SIGGRAPH.

[47]  Kuo-Chi Lin,et al.  Automatic Modeling of Knee-Joint Motion For The Virtual Reality Dynamic Anatomy (VRDA) Tool , 2000, Presence: Teleoperators & Virtual Environments.

[48]  J. H. , 1971, Bedside nurse.

[49]  Mel Slater,et al.  A Framework for Immersive Virtual Environments (FIVE): Speculations on the Role of Presence in Virtual Environments , 1997, Presence: Teleoperators & Virtual Environments.

[50]  Jannick P. Rolland,et al.  A Method of Computational Correction for Optical Distortioin in Head-Mounted Displays , 1993 .

[51]  A. Fernie.  Helmet‐mounted display with dual resolution , 1995 .

[52]  Paul Ewart.  Geometrical Optics , 1908, Nature.

[53]  Warren Robinett,et al.  A Computational Model for the Stereoscopic Optics of a Head-Mounted Display , 1991, Presence: Teleoperators & Virtual Environments.

[54]  Jannick P. Rolland.  Wide-angle, off-axis, see-through head-mounted display , 2000 .

[55]  Melvin L. Thomas,et al.  Fiber Optic Development For Use On The Fiber Optic Helmet Mounted Display , 1989, Defense, Security, and Sensing.

[56]  Mark A. Livingston,et al.  Superior augmented reality registration by integrating landmark tracking and magnetic tracking , 1996, SIGGRAPH.

[57]  C Tomasi,et al.  Shape and motion from image streams: a factorization method. , 1992, Proceedings of the National Academy of Sciences of the United States of America.

[58]  John T. Cacioppo,et al.  Techniques in Psychophysiology , 1980 .

[59]  Michel Dhome,et al.  Determination of the Attitude of 3D Objects from a Single Perspective View , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[60]  Nathaniel I. Durlach,et al.  Telepresence, time delay and adaptation , 1991 .

[61]  Kay M. Stanney,et al.  Aftereffects of Virtual Environment Exposure: Psychometric Issues , 1997, HCI.

[62]  S N Roscoe.  Judgments of Size and Distance with Imaging Displays , 1984, Human factors.

[63]  Ryugo Kijima,et al.  Transition between virtual environment and workstation environment with projective head mounted display , 1997, Proceedings of IEEE 1997 Annual International Symposium on Virtual Reality.

[64]  辻 三郎.  Measurement of eye movement utilizing T.V.technique , 1967 .

[65]  Paul K. Manhart,et al.  "Augeye" a compact, solid Schmidt optical relay for helmet mounted displays , 1993, Proceedings of IEEE Virtual Reality Annual International Symposium.

[66]  Campbell Fw.  A method for measuring the depth of field of the human eye. , 1954 .

[67]  Alain Tanguy,et al.  Virtual Reality as an Operative Tool During Scoliosis Surgery , 1995, CVRMed.

[68]  S. Ellis,et al.  Distance Perception of Stereoscopically Presented Virtual Objects Optically Superimposed on Physical Objects by a Head-Mounted See-Through Display , 1994 .