Augmented reality: fundamentals and nuclear related applications

In recent years, Augmented Reality (AR) has attracted considerable interest from both academia and industry. Virtual Reality enables users to interact only with virtual objects in a virtual environment, but AR enables users to interact with both virtual objects and real objects in the real world. This feature supports application of AR to various fields such as education, driving, entertainment, and navigation. Especially, by application of AR to support workers in nuclear power plants, it is expected that working time and human error can be decreased. However, many problems remain unsolved to apply AR to real fields. In this lecture note, fundamental knowledge ofAR is presented first including the overview of elemental technologies to realizeAR. Then various AR applications to nuclear fields are described. Finally, future prospects are given. Keyword: augmented reality; tracking; display devices; maintenance support; decommissioning support

[1]  F. Raab,et al.  Magnetic Position and Orientation Tracking System , 1979, IEEE Transactions on Aerospace and Electronic Systems.

[2]  P. Milgram,et al.  A Taxonomy of Mixed Reality Visual Displays , 1994 .

[3]  Sudeep Sarkar,et al.  Comparison of edge detectors: a methodology and initial study , 1996, Proceedings CVPR IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[4]  Ronald Azuma,et al.  A survey of augmented reality" Presence: Teleoperators and virtual environments , 1997 .

[5]  A. D. King,et al.  Inertial Navigation - Forty Years of Evolution , 1998 .

[6]  Long Quan,et al.  Linear N-Point Camera Pose Determination , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Hirokazu Kato,et al.  Marker tracking and HMD calibration for a video-based augmented reality conferencing system , 1999, Proceedings 2nd IEEE and ACM International Workshop on Augmented Reality (IWAR'99).

[8]  Andrew W. Fitzgibbon,et al.  Markerless tracking using planar structures in the scene , 2000, Proceedings IEEE and ACM International Symposium on Augmented Reality (ISAR 2000).

[9]  Ronald Azuma,et al.  Recent Advances in Augmented Reality , 2001, IEEE Computer Graphics and Applications.

[10]  Yakup Genc,et al.  Marker-less tracking for AR: a learning-based approach , 2002, Proceedings. International Symposium on Mixed and Augmented Reality.

[11]  Eric Foxlin,et al.  Circular data matrix fiducial system and robust image processing for a wearable vision-inertial self-tracker , 2002, Proceedings. International Symposium on Mixed and Augmented Reality.

[12]  Nassir Navab,et al.  Registration of technical drawings and calibrated images for industrial augmented reality , 2002, Machine Vision and Applications.

[13]  Hao Wang,et al.  A wireless LAN-based indoor positioning technology , 2004, IBM J. Res. Dev..

[14]  H. Morikawa,et al.  DOLPHIN: A Practical Approach for Implementing a Fully Distributed Indoor Ultrasonic Positioning System , 2004, UbiComp.

[15]  Cordelia Schmid,et al.  Evaluation of Interest Point Detectors , 2000, International Journal of Computer Vision.

[16]  Wei Wu,et al.  A SUPPORT SYSTEM FOR WATER SYSTEM ISOLATION TASK IN NPP BY USING AUGMENTED REALITY AND RFID , 2004 .

[17]  Christian Sandor,et al.  Experimental evaluation of an augmented reality visualization for directing a car driver's attention , 2005, Fourth IEEE and ACM International Symposium on Mixed and Augmented Reality (ISMAR'05).

[18]  Bernhard Hofmann-Wellenhof,et al.  GNSS - Global Navigation Satellite Systems: GPS, GLONASS, Galileo, and more , 2007 .

[19]  Session details: Course 17: Spatial augmented reality: merging real and virtual worlds , 2007, SIGGRAPH '07.

[20]  Nassir Navab,et al.  An Industrial Augmented Reality Solution For Discrepancy Check , 2007, 2007 6th IEEE and ACM International Symposium on Mixed and Augmented Reality.

[21]  Olivier Stasse,et al.  MonoSLAM: Real-Time Single Camera SLAM , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  G. Klein,et al.  Parallel Tracking and Mapping for Small AR Workspaces , 2007, 2007 6th IEEE and ACM International Symposium on Mixed and Augmented Reality.

[23]  Fumihisa Shibata,et al.  A Two-by-Two Mixed Reality System That Merges Real and Virtual Worlds in Both Audio and Visual Senses , 2007, 2007 6th IEEE and ACM International Symposium on Mixed and Augmented Reality.

[24]  Hidekazu Yoshikawa,et al.  Development of a Tracking Method for Augmented Reality Applied to NPP Maintenance Work and Its Experimental Evaluation , 2007, IEICE Trans. Inf. Syst..

[25]  Mark Fiala,et al.  Augmented Reality: A Practical Guide , 2008 .

[26]  Hiroshi SHIMODA,et al.  Proposal and Evaluation of a Supporting Method for NPP Decommissioning Work by Augmented Reality , 2008 .

[27]  Henry Been-Lirn Duh,et al.  Trends in augmented reality tracking, interaction and display: A review of ten years of ISMAR , 2008, 2008 7th IEEE/ACM International Symposium on Mixed and Augmented Reality.

[28]  S. Botden,et al.  What is going on in augmented reality simulation in laparoscopic surgery? , 2008, Surgical Endoscopy.

[29]  Fabio Bruno,et al.  Augmented touch without visual obtrusion , 2009, 2009 8th IEEE International Symposium on Mixed and Augmented Reality.

[30]  Shimoda Hiroshi,et al.  Development and experimental evaluation of an automatic marker registration system for tracking of augmented reality , 2010 .

[31]  Ishii Hirotake,et al.  Virtual Reality: Fundamentals and nuclear related applications , 2010 .