Measuring and improving the accuracy of ARDev using a square grid

Augmented reality (AR) systems superimpose 3D virtual objects on top of a real scene. Most applications require the AR system to maintain an accurate registration between the virtual objects and the real scene. Many AR systems use parameters obtained from the camera calibration to set up a virtual camera that models the real camera. Thus, inaccuracy in camera calibration can adversely affect the registration of an AR system. This paper proposes a calibration improvement algorithm which measures and improves accuracy of a robotics AR system that is currently used in our lab. The algorithm uses a square grid pattern as a calibration device. The vertices of the grid are defined as calibration points. The image coordinates of the calibration points are extracted using image processing technique. By comparing the difference between these image coordinates and those that are calculated using the camera parameters, the accuracy of the system can be measured. The registration error found can be used to adjust the camera parameters accordingly and thereby improves the accuracy of the system. Experiments have shown that the calibration improvement algorithm is feasible and it can be used to measure and minimise the registration error of the AR system.

[1]  Sing Bing Kang,et al.  Emerging Topics in Computer Vision , 2004 .

[2]  Bruce A. MacDonald,et al.  Augmented reality visualisation for player , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[3]  Jean Scholtz,et al.  Awareness in human-robot interactions , 2003, SMC'03 Conference Proceedings. 2003 IEEE International Conference on Systems, Man and Cybernetics. Conference Theme - System Security and Assurance (Cat. No.03CH37483).

[4]  D. B. Davis,et al.  Intel Corp. , 1993 .

[5]  Hirokazu Kato,et al.  Real World Teleconferencing , 2002, IEEE Computer Graphics and Applications.

[6]  Bruce A. MacDonald,et al.  Developer oriented visualisation of a robot program , 2006, HRI '06.

[7]  Narendra Ahuja,et al.  Easy calibration of a head-mounted projective display for augmented reality systems , 2003, IEEE Virtual Reality, 2003. Proceedings..

[8]  Ulrich Neumann,et al.  Dynamic registration correction in augmented-reality systems , 1995, Proceedings Virtual Reality Annual International Symposium '95.

[9]  David W. Payton,et al.  World embedded interfaces for human-robot interaction , 2003, 36th Annual Hawaii International Conference on System Sciences, 2003. Proceedings of the.

[10]  Ronald Azuma,et al.  A Survey of Augmented Reality , 1997, Presence: Teleoperators & Virtual Environments.

[11]  R. Sablatnig,et al.  Comparison of Methods for Geometric Camera Calibration using Planar Calibration Targets , 2004 .

[12]  Ronald Azuma,et al.  Recent Advances in Augmented Reality , 2001, IEEE Computer Graphics and Applications.

[13]  Mark Billinghurst,et al.  Face to face collaborative AR on mobile phones , 2005, Fourth IEEE and ACM International Symposium on Mixed and Augmented Reality (ISMAR'05).

[14]  Malik Mallem,et al.  Automatic camera calibration based on robot calibration , 1999, IMTC/99. Proceedings of the 16th IEEE Instrumentation and Measurement Technology Conference (Cat. No.99CH36309).

[15]  Roger Y. Tsai,et al.  A versatile camera calibration technique for high-accuracy 3D machine vision metrology using off-the-shelf TV cameras and lenses , 1987, IEEE J. Robotics Autom..

[16]  Hirokazu Kato,et al.  A registration method based on texture tracking using ARToolKit , 2003, 2003 IEEE International Augmented Reality Toolkit Workshop.

[17]  Toby Howard,et al.  Accurate camera calibration for off-line, video-based augmented reality , 2002, Proceedings. International Symposium on Mixed and Augmented Reality.

[18]  Kirk Martinez,et al.  Camera self-calibration for the ARToolKit , 2002, The First IEEE International Workshop Agumented Reality Toolkit,.

[19]  Boubakeur Boufama,et al.  A semi-automatic camera calibration method for augmented reality , 2002, IEEE International Conference on Systems, Man and Cybernetics.

[20]  Kiriakos N. Kutulakos,et al.  Calibration-Free Augmented Reality , 1998, IEEE Trans. Vis. Comput. Graph..

[21]  Hideyuki Tamura,et al.  AR/sup 2/Hockey: a case study of collaborative augmented reality , 1998, Proceedings. IEEE 1998 Virtual Reality Annual International Symposium (Cat. No.98CB36180).

[22]  Yongduek Seo,et al.  Calibration-Free Augmented Reality in Perspective , 2000, IEEE Trans. Vis. Comput. Graph..

[23]  N. Otsu A threshold selection method from gray level histograms , 1979 .