Analysis of Head Pose Accuracy in Augmented Reality

A method is developed to analyze the accuracy of the relative head-to-object position and orientation (pose) in augmented reality systems with head-mounted displays. From probabilistic estimates of the errors in optical tracking sensors, the uncertainty in head-to-object pose can be computed in the form of a covariance matrix. The positional uncertainty can be visualized as a 3D ellipsoid. One useful benefit of having an explicit representation of uncertainty is that we can fuse sensor data from a combination of fixed and head-mounted sensors in order to improve the overall registration accuracy. The method was applied to the analysis of an experimental augmented reality system, incorporating an optical see-through head-mounted display, a head-mounted CCD camera, and a fixed optical tracking sensor. The uncertainty of the pose of a movable object with respect to the head-mounted display was analyzed. By using both fixed and head mounted sensors, we produced a pose estimate that is significantly more accurate than that produced by either sensor acting alone.

[1]  P Munger,et al.  Comparison of relative accuracy between a mechanical and an optical position tracker for image-guided neurosurgery. , 1995, Journal of image guided surgery.

[2]  W. A. Ho,et al.  Fusion of data from head-mounted and fixed sensors , 1998 .

[3]  H. V. Trees.  Detection, Estimation, And Modulation Theory , 2001 .

[4]  Richard L. Holloway,et al.  Registration Error Analysis for Augmented Reality , 1997, Presence: Teleoperators & Virtual Environments.

[5]  Paul R. Cohen,et al.  Camera Calibration with Distortion Models and Accuracy Evaluation , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  Lance B. Gatrell,et al.  Accuracy of locating circular features using machine vision , 1992, Other Conferences.

[7]  Francis L. Merat,et al.  Introduction to robotics: Mechanics and control , 1987, IEEE J. Robotics Autom..

[8]  Ronald Azuma,et al.  A Survey of Augmented Reality , 1997, Presence: Teleoperators & Virtual Environments.

[9]  Ronald Azuma,et al.  Improving static and dynamic registration in an optical see-through HMD , 1994, SIGGRAPH.

[10]  David E. Breen,et al.  Calibration Requirements and Procedures for a Monitor-Based Augmented Reality System , 1995, IEEE Trans. Vis. Comput. Graph..

[11]  Warren Robinett,et al.  A Computational Model for the Stereoscopic Optics of a Head-Mounted Display , 1991, Presence: Teleoperators & Virtual Environments.

[12]  Frank Biocca,et al.  A Survey of Position Trackers , 1992, Presence: Teleoperators & Virtual Environments.

[13]  Richard A. Brown,et al.  Introduction to random signals and applied kalman filtering (3rd ed , 2012 .

[14]  Tomas Lozano-Perez,et al.  An automatic registration method for frameless stereotaxy, image guided surgery, and enhanced reality visualization , 1996 .

[15]  Guanrong Chen,et al.  Introduction to random signals and applied kalman filtering (second edition), Robert Grover Brown and Patrick Y. C. Hwang, John Wiley, New York, 1992, 512 p.p., ISBN 0–47152–573–1, $62.95 , 1992 .

[16]  Mary C. Whitton,et al.  Technologies for augmented reality systems: realizing ultrasound-guided needle biopsies , 1996, SIGGRAPH.

[17]  Takeo Kanade,et al.  Vision-Based Object Registration for Real-Time Image Overlay , 1995, CVRMed.

[18]  Israel Amir,et al.  Design of Fiducials for Accurate Registration Using Machine Vision , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[19]  William Hoff,et al.  Fusion of Data from Head-Mounted and Fixed Sensors1 , 1999 .

[20]  Eric Foxlin,et al.  Inertial head-tracker sensor fusion by a complementary separate-bias Kalman filter , 1996, Proceedings of the IEEE 1996 Virtual Reality Annual International Symposium.

[21]  J. P. Mellor,et al.  Enhanced Reality Visualization in a Surgical Environment , 1995 .

[22]  Ulrich Neumann,et al.  Dynamic registration correction in video-based augmented reality systems , 1995, IEEE Computer Graphics and Applications.

[23]  Harry L. Van Trees,et al.  Detection, Estimation, and Modulation Theory: Radar-Sonar Signal Processing and Gaussian Signals in Noise , 1992 .

[24]  Thomas P. Caudell,et al.  Calibration of head-mounted displays for augmented reality applications , 1993, Proceedings of IEEE Virtual Reality Annual International Symposium.

[25]  Jennifer Healey,et al.  Augmented Reality through Wearable Computing , 1997, Presence: Teleoperators & Virtual Environments.

[26]  O. Faugeras.  Three-dimensional computer vision: a geometric viewpoint , 1993 .

[27]  Ronald Azuma,et al.  Tracking a head-mounted display in a room-sized environment with head-mounted cameras , 1990, Defense, Security, and Sensing.

[28]  Rajeev Sharma,et al.  Computer Vision-Based Augmented Reality for Guiding Manual Assembly , 1997, Presence: Teleoperators & Virtual Environments.

[29]  Allen R. Hanson,et al.  Robust methods for estimating pose and a sensitivity analysis , 1994 .

[30]  A. Gualtierotti.  H. L. Van Trees, Detection, Estimation, and Modulation Theory, , 1976 .

[31]  Xinhua Zhuang,et al.  Pose estimation from corresponding point data , 1989, IEEE Trans. Syst. Man Cybern..

[32]  Karel Zikan,et al.  Videometric head tracker for augmented reality applications , 1995, Other Conferences.

[33]  Roger Y. Tsai,et al.  Techniques for calibration of the scale factor and image center for high accuracy 3D machine vision metrology , 1987, Proceedings. 1987 IEEE International Conference on Robotics and Automation.

[34]  S. P. Mudur,et al.  Three-dimensional computer vision: a geometric viewpoint , 1993 .

[35]  A.H. Haddad,et al.  Applied optimal estimation , 1976, Proceedings of the IEEE.

[36]  Roger Y. Tsai,et al.  Techniques for Calibration of the Scale Factor and Image Center for High Accuracy 3-D Machine Vision Metrology , 1988, IEEE Trans. Pattern Anal. Mach. Intell..

[37]  Warren Robinett,et al.  A Computational Model for the Stereoscopic Optics of a Head-Mounted Display , 1993, Virtual Reality Systems.

[38]  Berthold K. P. Horn,et al.  Closed-form solution of absolute orientation using unit quaternions , 1987 .

[39]  Linda G. Shapiro,et al.  Computer and Robot Vision , 1991 .

[40]  Fred C. Schweppe,et al.  Uncertain dynamic systems , 1973 .

[41]  T. Ronald,et al.  Azuma A Survey of Augmented Reality , 2022 .

[42]  Paul Milgram,et al.  Telerobotic control using augmented reality , 1995, Proceedings 4th IEEE International Workshop on Robot and Human Communication.

[43]  P. R. Bevington,et al.  Data Reduction and Error Analysis for the Physical Sciences , 1969 .

[44]  S. Ghosh.  Introduction to robotics: Mechanics and control (second edition): by J.J. Craig, Addison-Wesley, Wokingham, 1989. ISBN 0-201-09528-9, xiii + 450 pages, hardcover, £18.95 , 1991 .

[45]  Mark A. Livingston,et al.  Superior augmented reality registration by integrating landmark tracking and magnetic tracking , 1996, SIGGRAPH.

[46]  Dohyung Kim,et al.  An optical tracker for augmented reality and wearable computers , 1997, Proceedings of IEEE 1997 Annual International Symposium on Virtual Reality.

[47]  Kiriakos N. Kutulakos,et al.  Calibration-Free Augmented Reality , 1998, IEEE Trans. Vis. Comput. Graph..

[48]  Emanuele Trucco,et al.  Computer and Robot Vision , 1995 .

[49]  Khoi Nguyen,et al.  Computer-vision-based registration techniques for augmented reality , 1996, Other Conferences.

[50]  Xinhua Zhuang,et al.  Robust 3-D-3-D Pose Estimation , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[51]  Warren Robinett,et al.  Synthetic Experience:A Proposed Taxonomy , 1992, Presence: Teleoperators & Virtual Environments.

[52]  Steven K. Feiner,et al.  Knowledge-based augmented reality , 1993, CACM.

[53]  Takeo Kanade,et al.  Vision-Based Object Registration for Real-Time Image Overlay , 1995, CVRMed.