The Hedgehog: A Novel Optical Tracking Method for Spatially Immersive Displays

Existing commercial technologies do not adequately meet the requirements for tracking in fully enclosed Virtual Reality displays. We present a novel six degree of freedom tracking system, the Hedgehog; which overcomes several limitations inherent in existing sensors and tracking technology. The system reliably estimates the pose of the user's head with high resolution and low spatial distortion. Light emitted from an arrangement of lasers projects onto the display walls. An arrangement of cameras images the walls and the two-dimensional centroids of the projections are tracked to estimate the pose of the device. The system is able to handle ambiguous laser projection configurations, static and dynamic occlusions of the lasers, and incorporates an auto-calibration mechanism due to the use of the SCAAT (single constraint at a time) algorithm. A prototype system was evaluated relative to a state-of-the-art motion tracker and showed comparable positional accuracy (12 mm RMS) and significantly better absolute angular accuracy (0.1 RMS).

[1]  Andrew Hogue,et al.  An optical-inertial tracking system for fully-enclosed VR displays , 2004, First Canadian Conference on Computer and Robot Vision, 2004. Proceedings..

[2]  J. L. Roux.  An Introduction to the Kalman Filter , 2003 .

[3]  Joseph J. LaViola,et al.  Immersive VR for Scientific Visualization: A Progress Report , 2000, IEEE Computer Graphics and Applications.

[4]  Eric Foxlin,et al.  VIS-Tracker: a wearable vision-inertial self-tracker , 2003, IEEE Virtual Reality, 2003. Proceedings..

[5]  Andriy Pavlovych,et al.  LASER POINTERS AS INTERACTION DEVICES FOR COLLABORATIVE PERVASIVE COMPUTING , 2004 .

[6]  Carolina Cruz-Neira,et al.  The benefits of statistical visualization in an immersive environment , 1999, Proceedings IEEE Virtual Reality (Cat. No. 99CB36316).

[7]  Andrew Hogue,et al.  IVY: The Immersive Visual environment at York , 2001 .

[8]  Greg Welch,et al.  SCAAT: incremental tracking with incomplete information , 1997, SIGGRAPH.

[9]  F. W. Cathey,et al.  The iterated Kalman filter update as a Gauss-Newton method , 1993, IEEE Trans. Autom. Control..

[10]  Wolfgang Stuerzlinger,et al.  Laser Pointers as Collaborative Pointing Devices , 2002, Graphics Interface.

[11]  Volodymyr V. Kindratenko.  A Comparison of the Accuracy of an Electromagnetic and a Hybrid Ultrasound-Inertia Position Tracking System , 2001, Presence: Teleoperators & Virtual Environments.

[12]  Jeffrey K. Uhlmann,et al.  New extension of the Kalman filter to nonlinear systems , 1997, Defense, Security, and Sensing.

[13]  Marc Pollefeys,et al.  Multiple view geometry , 2005 .

[14]  Eric Foxlin,et al.  Motion Tracking Requirements and Technologies , 2002 .

[15]  Andreas Kunz,et al.  Construction of a three-sided immersive telecollaboration system , 2003 .

[16]  Andries van Dam.  Beyond WIMP , 2000, IEEE Computer Graphics and Applications.

[17]  Andrew Hogue.  MARVIN: a Mobile Automatic Realtime Visual and INertial tracking system , 2003 .

[18]  Axel Pinz,et al.  A new optical tracking system for virtual and augmented reality applications , 2001, IMTC 2001. Proceedings of the 18th IEEE Instrumentation and Measurement Technology Conference. Rediscovering Measurement in the Age of Informatics (Cat. No.01CH 37188).

[19]  Andrew W. Fitzgibbon,et al.  Quantitative analysis of accuracy of an inertial/acoustic 6DOF tracking system in motion , 2006, Journal of Neuroscience Methods.

[20]  Volodymyr V. Kindratenko,et al.  A survey of electromagnetic position tracker calibration techniques , 2005, Virtual Reality.

[21]  Ronald Azuma,et al.  Hybrid inertial and vision tracking for augmented reality registration , 1999, Proceedings IEEE Virtual Reality (Cat. No. 99CB36316).

[22]  Long Quan,et al.  Linear N-Point Camera Pose Determination , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[23]  George K. Francis,et al.  Alice on the Eightfold Way: Exploring Curved Spaces in an Enclosed Virtual Reality Theater , 2002, VisMath.

[24]  Greg Welch,et al.  High-Performance Wide-Area Optical Tracking: The HiBall Tracking System , 2001, Presence: Teleoperators & Virtual Environments.

[25]  Carolina Cruz-Neira,et al.  Surround-Screen Projection-Based Virtual Reality: The Design and Implementation of the CAVE , 2023 .

[26]  A.H. Haddad,et al.  Applied optimal estimation , 1976, Proceedings of the IEEE.

[27]  Michael Harrington,et al.  Constellation: a wide-range wireless motion-tracking system for augmented reality and virtual set applications , 1998, SIGGRAPH.

[28]  Frederick P. Brooks.  What's Real About Virtual Reality? , 1999, IEEE Computer Graphics and Applications.

[29]  Joseph J. LaViola,et al.  A discussion of cybersickness in virtual environments , 2000, SGCH.

[30]  Giuseppe Riva,et al.  Real Presence: How Different Ontologies Generate Different Criteria for Presence, Telepresence, and Virtual Presence , 1999, Presence.

[31]  Andrew Hogue,et al.  IVY: Basic Design and Construction Details , 2002 .

[32]  T. Başar,et al.  A New Approach to Linear Filtering and Prediction Problems , 2001 .

[33]  S. Gilson,et al.  Systematic distortions of perceptual stability investigated using immersive virtual reality , 2005, Vision Research.