Conformal tracking for virtual environments

Marker-based tracking is a technique which employs fiduciary marks to determine the pose of a tracked object. A collection of markers arranged in a rigid configuration is called a tracking probe. We present a pioneer framework for designing conformal tracking probes. Conformal in this work means to adapt to the shape of the tracked objects and to the environmental constraints. As part of the framework, the accuracy in position and orientation of a given probe may be predicted given the system noise. The framework is a methodology for designing tracking probes based upon performance goals and environmental constraints. After presenting the conformal tracking framework, the elements used for completing the steps of the framework are discussed. We start with the application of optimization methods for determining the probe geometry. Two overall methods for mapping markers on tracking probes are presented, the Intermediary Algorithm and the Viewpoints Algorithm. Next, we examine the method used for pose estimation and present a mathematical model of error propagation used for predicting probe performance in pose estimation. The model uses a first-order error propagation, perturbing the simulated marker locations with Gaussian noise. The marker locations with error are then traced through the pose estimation process and the effects of the noise are analyzed. Moreover, the effects of changing the probe size or the number of markers are discussed. Finally, the conformal tracking framework is validated experimentally. The assessment methods are divided into simulation and post-fabrication methods. Under simulation, we discuss testing of the performance of each probe design. Then, post-fabrication assessment is performed, including accuracy measurements in orientation and position. (Abstract shortened by UMI.)

[1]  Kari Karhunen,et al.  Über lineare Methoden in der Wahrscheinlichkeitsrechnung , 1947 .

[2]  Frank Biocca,et al.  A Survey of Position Trackers , 1992, Presence: Teleoperators & Virtual Environments.

[3]  Myron W. Krueger,et al.  Responsive environments , 1977, AFIPS '77.

[4]  Jannick P. Rolland,et al.  A Survey of Tracking Technologies for Virtual Environments , 2001 .

[5]  Philippe Coiffet,et al.  Virtual Reality Technology , 2003, Presence: Teleoperators & Virtual Environments.

[6]  Carolina Cruz-Neira,et al.  Surround-Screen Projection-Based Virtual Reality: The Design and Implementation of the CAVE , 2023 .

[7]  G. Blelloch Introduction to Data Compression * , 2022 .

[8]  Myron W. Krueger,et al.  VIDEOPLACE—an artificial reality , 1985, CHI '85.

[9]  Henry Fuchs,et al.  Optical Versus Video See-Through Head-Mounted Displays in Medical Visualization , 2000, Presence: Teleoperators & Virtual Environments.

[10]  Charles E. Hughes,et al.  Marker Mapping Techniques for Augmented Reality Visualisation , 2002 .

[11]  Roger Y. Tsai,et al.  A versatile camera calibration technique for high-accuracy 3D machine vision metrology using off-the-shelf TV cameras and lenses , 1987, IEEE J. Robotics Autom..

[12]  Warren Robinett,et al.  Virtual environment display system , 1987, I3D '86.

[13]  N. Navab,et al.  Tracking and pose estimation for computer assisted localization in industrial environments , 2000, Proceedings Fifth IEEE Workshop on Applications of Computer Vision.

[14]  K. S. Arun,et al.  Least-Squares Fitting of Two 3-D Point Sets , 1987, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Greg Welch,et al.  Motion Tracking: No Silver Bullet, but a Respectable Arsenal , 2002, IEEE Computer Graphics and Applications.

[16]  C. Reeves Modern heuristic techniques for combinatorial problems , 1993 .

[17]  Frank J. Ferrin Survey of helmet tracking technologies , 1991, Medical Imaging.

[18]  Richard L. Holloway,et al.  Registration errors in augmented reality systems , 1996 .

[19]  S. G. Rabinovich Measurement Errors: Theory and Practice , 1994 .

[20]  Ivan E. Sutherland,et al.  A head-mounted three dimensional display , 1968, AFIPS Fall Joint Computing Conference.

[21]  Michael Harrington,et al.  Constellation: a wide-range wireless motion-tracking system for augmented reality and virtual set applications , 1998, SIGGRAPH.

[22]  C. D. Gelatt,et al.  Optimization by Simulated Annealing , 1983, Science.

[23]  Hirokazu Kato,et al.  Marker tracking and HMD calibration for a video-based augmented reality conferencing system , 1999, Proceedings 2nd IEEE and ACM International Workshop on Augmented Reality (IWAR'99).

[24]  Gregory B. Newby,et al.  Virtual reality: Scientific and technological challenges , 1996 .

[25]  King-Sun Fu,et al.  IEEE Transactions on Pattern Analysis and Machine Intelligence Publication Information , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[26]  Ulrich Neumann,et al.  Vision-based pose computation: robust and accurate augmented reality tracking , 1999, Proceedings 2nd IEEE and ACM International Workshop on Augmented Reality (IWAR'99).

[27]  Mark A. Livingston,et al.  Superior augmented reality registration by integrating landmark tracking and magnetic tracking , 1996, SIGGRAPH.

[28]  P. Milgram,et al.  A Taxonomy of Mixed Reality Visual Displays , 1994 .

[29]  Henry Fuchs,et al.  A real-time optical 3D tracker for head-mounted display systems , 1990, I3D '90.

[30]  J. P. Mellor Realtime Camera Calibration for Enhanced Reality Visualization , 1995, CVRMed.

[31]  Karl Pearson F.R.S. LIII. On lines and planes of closest fit to systems of points in space , 1901 .

[32]  I. Jolliffe Principal Component Analysis , 2002 .

[33]  Ted Morris,et al.  Using a Maximum Error Statistic to Evaluate Measurement Errors in 3D Position and Orientation Tracking Systems , 1993, Presence: Teleoperators & Virtual Environments.

[34]  F. Veldpaus,et al.  Finite centroid and helical axis estimation from noisy landmark measurements in the study of human joint kinematics. , 1985, Journal of biomechanics.

[35]  Xinhua Zhuang,et al.  Pose estimation from corresponding point data , 1989, IEEE Trans. Syst. Man Cybern..

[36]  J. Farrell,et al.  The global positioning system and inertial navigation , 1999 .

[37]  David J. Hawkes,et al.  Design and evaluation of a system for microscope-assisted guided interventions (MAGI) , 2000 .

[38]  H. Hotelling Analysis of a complex of statistical variables into principal components. , 1933 .

[39]  Eric Foxlin,et al.  An inertial head-orientation tracker with automatic drift compensation for use with HMD's , 1994 .

[40]  Ronald Azuma,et al.  Space Resection by Collinearity: Mathematics Behind the Optical Ceiling Head-Tracker , 1991 .

[41]  Alexei A. Goon,et al.  A SURVEY OF TRACKING TECHNOLOGY FOR VIRTUAL ENVIRONMENTS , 1999 .

[42]  Steven K. Feiner,et al.  Knowledge-based augmented reality , 1993, CACM.

[43]  Tom G. Zimmerman,et al.  A hand gesture interface device , 1987, CHI '87.

[44]  Suya You,et al.  Augmented Reality Tracking in Natural Environments , 1998 .

[45]  N. Metropolis,et al.  Equation of State Calculations by Fast Computing Machines , 1953, Resonance.

[46]  Bruce A. Draper,et al.  Adaptive tracking and model registration across distinct aspects , 1995, Proceedings 1995 IEEE/RSJ International Conference on Intelligent Robots and Systems. Human Robot Interaction and Cooperative Robots.

[47]  David J. Hawkes,et al.  Design and evaluation of a system for microscope-assisted guided interventions (MAGI) , 1999, IEEE Transactions on Medical Imaging.

[48]  Berthold K. P. Horn,et al.  Closed-form solution of absolute orientation using unit quaternions , 1987 .

[49]  Larry S. Davis,et al.  Methods for Designing Head-Tracking Probes , 2002, JCIS.

[50]  Heinrich Niemann,et al.  Single camera tracking of marker clusters: multiparameter cluster optimization and experimental verification , 2002, Proceedings. International Symposium on Mixed and Augmented Reality.

[51]  Ryutarou Ohbuchi,et al.  Merging virtual objects with the real world: seeing ultrasound imagery within the patient , 1992, SIGGRAPH.

[52]  Greg Welch,et al.  SCAAT: incremental tracking with incomplete information , 1997, SIGGRAPH.

[53]  Takeo Kanade,et al.  Vision-Based Object Registration for Real-Time Image Overlay , 1995, CVRMed.

[54]  Maxine D. Brown,et al.  The ImmersaDesk and Infinity Wall projection-based virtual reality displays , 1997, COMG.

[55]  F. Raab,et al.  Magnetic Position and Orientation Tracking System , 1979, IEEE Transactions on Aerospace and Electronic Systems.

[56]  Ronald Azuma,et al.  A demonstrated optical tracker with scalable work area for head-mounted display systems , 1992, I3D '92.

[57]  Frederick P. Brooks,et al.  Project GROPEHaptic displays for scientific visualization , 1990, SIGGRAPH.

[58]  T. P. Caudell,et al.  Augmented reality: an application of heads-up display technology to manual manufacturing processes , 1992, Proceedings of the Twenty-Fifth Hawaii International Conference on System Sciences.