Augmented reality technologies, systems and applications

This paper surveys the current state-of-the-art of technology, systems and applications in Augmented Reality. It describes work performed by many different research groups, the purpose behind each new Augmented Reality system, and the difficulties and problems encountered when building some Augmented Reality applications. It surveys mobile augmented reality systems challenges and requirements for successful mobile systems. This paper summarizes the current applications of Augmented Reality and speculates on future applications and where current research will lead Augmented Reality’s development. Challenges augmented reality is facing in each of these applications to go from the laboratories to the industry, as well as the future challenges we can forecast are also discussed in this paper. Section 1 gives an introduction to what Augmented Reality is and the motivations for developing this technology. Section 2 discusses Augmented Reality Technologies with computer vision methods, AR devices, interfaces and systems, and visualization tools. The mobile and wireless systems for Augmented Reality are discussed in Section 3. Four classes of current applications that have been explored are described in Section 4. These applications were chosen as they are the most famous type of applications encountered when researching AR apps. The future of augmented reality and the challenges they will be facing are discussed in Section 5.

[1]  Giuseppe De Pietro,et al.  A user interface for VR-ready 3D medical imaging by off-the-shelf input devices , 2010, Comput. Biol. Medicine.

[2]  Pranav Mistry,et al.  TaPuMa: tangible public map for information acquirement through the things we carry , 2008, Ambi-Sys '08.

[3]  Ross T. Smith,et al.  Augmented Reality Chinese Checkers , 2004, ACE '04.

[4]  Nassir Navab,et al.  Contextual Anatomic Mimesis Hybrid In-Situ Visualization Method for Improving Multi-Sensory Depth Perception in Medical Augmented Reality , 2007, 2007 6th IEEE and ACM International Symposium on Mixed and Augmented Reality.

[5]  Henry Been-Lirn Duh,et al.  Trends in augmented reality tracking, interaction and display: A review of ten years of ISMAR , 2008, 2008 7th IEEE/ACM International Symposium on Mixed and Augmented Reality.

[6]  D. Yuh,et al.  Application of haptic feedback to robotic surgery. , 2004, Journal of laparoendoscopic & advanced surgical techniques. Part A.

[7]  Yongtian Wang,et al.  AR-View: An augmented reality device for digital reconstruction of Yuangmingyuan , 2009, 2009 IEEE International Symposium on Mixed and Augmented Reality - Arts, Media and Humanities.

[8]  Sean White,et al.  Visual Hints for Tangible Gestures in Augmented Reality , 2007, 2007 6th IEEE and ACM International Symposium on Mixed and Augmented Reality.

[9]  Oliver Bimber,et al.  Enabling Mobile Phones To Support Large-Scale Museum Guidance , 2007, IEEE MultiMedia.

[10]  Hidetomo Takahashi,et al.  Augmented Reality System for Development of Handy Information Device with Tangible Interface , 2007, HCI.

[11]  Junchul Chun,et al.  Interactive Manipulation of Augmented Objects in Marker-Less AR Using Vision-Based Hand Interaction , 2010, 2010 Seventh International Conference on Information Technology: New Generations.

[12]  Dieter Schmalstieg,et al.  Handheld Augmented Reality Displays , 2006, IEEE Virtual Reality Conference (VR 2006).

[13]  George Papagiannakis,et al.  A survey of mobile and wireless technologies for augmented reality systems , 2008, Comput. Animat. Virtual Worlds.

[14]  Ursula Kretschmer,et al.  Stage-Based Augmented Edutainment , 2004, Smart Graphics.

[15]  Brandon Stutzman,et al.  MARTI: Mobile Augmented Reality Tool for Industry , 2009, 2009 WRI World Congress on Computer Science and Information Engineering.

[16]  Giandomenico Caruso,et al.  AR-Mote: A wireless device for Augmented Reality environment , 2010, 2010 IEEE Symposium on 3D User Interfaces (3DUI).

[17]  Theodoros N. Arvanitis,et al.  Human factors and qualitative pedagogical evaluation of a mobile augmented reality system for science education used by learners with physical disabilities , 2009, Personal and Ubiquitous Computing.

[18]  John N. Karigiannis,et al.  Archeoguide: system architecture of a mobile outdoor augmented reality system , 2002, Proceedings. International Symposium on Mixed and Augmented Reality.

[19]  Dieter Schmalstieg,et al.  Location based Applications for Mobile Augmented Reality , 2003, AUIC.

[20]  Pattie Maes,et al.  ReachMedia: on-the-move interaction with everyday objects , 2005, Ninth IEEE International Symposium on Wearable Computers (ISWC'05).

[21]  Zhu Qiong,et al.  Development Actuality and Application of Registration Technology in Augmented Reality , 2008, 2008 International Symposium on Computational Intelligence and Design.

[22]  Dieter Schmalstieg,et al.  Bridging multiple user interface dimensions with augmented reality , 2000, Proceedings IEEE and ACM International Symposium on Augmented Reality (ISAR 2000).

[23]  Steven K. Feiner,et al.  Immersive mixed-reality configuration of hybrid user interfaces , 2005, Fourth IEEE and ACM International Symposium on Mixed and Augmented Reality (ISMAR'05).

[24]  Burkhard Wünsche,et al.  Markerless Augmented Reality for Robotic Helicoptor Applications , 2008, RobVis.

[25]  Ramesh Raskar,et al.  Modern approaches to augmented reality Video files associated with this course are available from the citation page , 2007, SIGGRAPH Courses.

[26]  Stephen DiVerdi,et al.  GroundCam: A Tracking Modality for Mobile Mixed Reality , 2007, 2007 IEEE Virtual Reality Conference.

[27]  Pattie Maes,et al.  WUW - wear Ur world: a wearable gestural interface , 2009, CHI Extended Abstracts.

[28]  D. Burschka,et al.  Dynamic Augmented Reality for Sensory Substitution in Robot-Assisted Surgical Systems , 2006, 2006 International Conference of the IEEE Engineering in Medicine and Biology Society.

[29]  Volker Scholz,et al.  An Augmented Reality museum guide , 2008, 2008 7th IEEE/ACM International Symposium on Mixed and Augmented Reality.

[30]  Pattie Maes,et al.  eye-q: eyeglass peripheral display for subtle intimate notifications , 2006, Mobile HCI.

[31]  P. Milgram,et al.  A Taxonomy of Mixed Reality Visual Displays , 1994 .

[32]  M. Mallem,et al.  Robust camera pose estimation combining 2D/3D points and lines tracking , 2008, 2008 IEEE International Symposium on Industrial Electronics.

[33]  Dieter Schmalstieg,et al.  Remote Collaboration Using Augmented Reality Videoconferencing , 2004, Graphics Interface.

[34]  V. Lepetit.  On Computer Vision for Augmented Reality , 2008, 2008 International Symposium on Ubiquitous Virtual Reality.

[35]  Ronald Azuma,et al.  Recent Advances in Augmented Reality , 2001, IEEE Computer Graphics and Applications.

[36]  Jong-Soo Choi,et al.  Design and implementation of a wearable AR annotation system using gaze interaction , 2010, 2010 Digest of Technical Papers International Conference on Consumer Electronics (ICCE).

[37]  Pattie Maes,et al.  Augmenting Looking, Pointing and Reaching Gestures to Enhance the Searching and Browsing of Physical Objects , 2007, Pervasive.

[38]  Ivan Poupyrev,et al.  Virtual object manipulation on a table-top AR environment , 2000, Proceedings IEEE and ACM International Symposium on Augmented Reality (ISAR 2000).

[39]  Wenyuan Bi,et al.  Mirror world navigation for mobile users based on augmented reality , 2009, MM '09.

[40]  Dieter Schmalstieg,et al.  The Studierstube Augmented Reality Project , 2002, Presence: Teleoperators & Virtual Environments.

[41]  Sharon Oviatt,et al.  Multimodal Interfaces , 2008, Encyclopedia of Multimedia.

[42]  Rosa María Baños,et al.  An augmented reality system for treating psychological disorders: application to phobia to cockroaches , 2004, Third IEEE and ACM International Symposium on Mixed and Augmented Reality.

[43]  Fahim Ahmed,et al.  Performance evaluation method for mobile computer vision systems using augmented reality , 2010, 2010 IEEE Virtual Reality Conference (VR).

[44]  Simon J. Julier,et al.  An event-based data distribution mechanism for collaborative mobile augmented reality and virtual environments , 2003, IEEE Virtual Reality, 2003. Proceedings..

[45]  Xun Luo,et al.  Integration of Augmented Reality and Assistive Devices for Post-Stroke Hand Opening Rehabilitation , 2005, 2005 IEEE Engineering in Medicine and Biology 27th Annual Conference.