Development of a tracking method for augmented reality applied to NPP maintenance work and its experimental evaluation

Nuclear power plants (NPP) must be maintained periodically. The maintenance efficiency must be improved and human error must be reduced simultaneously to improve NPPs' competitive capability in electricity markets. Although Augmented Reality (AR) offers great possibilities to support NPP maintenance work, some difficulties exist for application of AR to actual work support because current AR systems cannot be implemented in NPP environments without technical improvement. Problems exist such as recognition distance, tracking accuracy, and a complex working environment when applying AR to NPP field work support. Considerable extension of tracking distance and improvement of accuracy are particularly desired because NPPs are large-scale indoor environments. This study designed a linecode marker, a new type of paper-based marker, along with recognition and tracking algorithms for it to resolve these problems. In contrast to conventional paper-based markers, such as square markers and circle markers, the linecode marker is not merely easier to set up in complex industrial environments: it also enables the use of AR in industrial plants because of its considerable tracking-performance improvement. To evaluate tracking accuracy, the trackable distance, and the tracking speed of the proposed tracking method, an evaluation experiment was conducted in a large room. The experiment results show that the tracking distance is extended extremely over that of the traditional marker-based tracking method: tracking accuracy improved to 20 cm in 10 m distance. The running speed can be as fast as 15 frames per second with a laptop.

[1]  Vincent Lepetit,et al.  Monocular Model-Based 3D Tracking of Rigid Objects: A Survey , 2005, Found. Trends Comput. Graph. Vis..

[2]  Hirokazu Kato,et al.  Marker tracking and HMD calibration for a video-based augmented reality conferencing system , 1999, Proceedings 2nd IEEE and ACM International Workshop on Augmented Reality (IWAR'99).

[3]  Mark A. Livingston,et al.  Superior augmented reality registration by integrating landmark tracking and magnetic tracking , 1996, SIGGRAPH.

[4]  Kevin E. Spaulding,et al.  Color processing in digital cameras , 1998, IEEE Micro.

[5]  Éric Marchand,et al.  A real-time tracker for markerless augmented reality , 2003, The Second IEEE and ACM International Symposium on Mixed and Augmented Reality, 2003. Proceedings..

[6]  Ronald Azuma,et al.  Recent Advances in Augmented Reality , 2001, IEEE Computer Graphics and Applications.

[7]  Hao Wang,et al.  A wireless LAN-based indoor positioning technology , 2004, IBM J. Res. Dev..

[8]  David Ingram,et al.  Augmented reality in a wide area sentient environment , 2001, Proceedings IEEE and ACM International Symposium on Augmented Reality.

[9]  Bruce H. Thomas,et al.  A wearable computer system with augmented reality to support terrestrial navigation , 1998, Digest of Papers. Second International Symposium on Wearable Computers (Cat. No.98EX215).

[10]  Nassir Navab Developing killer apps for industrial augmented reality , 2004, IEEE Computer Graphics and Applications.

[11]  Long Quan,et al.  Linear N-Point Camera Pose Determination , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Robert M. Haralick,et al.  Analysis and solutions of the three point perspective pose estimation problem , 1991, Proceedings. 1991 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[13]  Éric Marchand,et al.  Real-time markerless tracking for augmented reality: the virtual visual servoing framework , 2006, IEEE Transactions on Visualization and Computer Graphics.

[14]  Greg Welch,et al.  The HiBall Tracker: high-performance wide-area tracking for virtual and augmented environments , 1999, VRST '99.