Next-Generation Augmented Reality Browsers: Rich, Seamless, and Adaptive

As low-level hardware will soon allow us to visualize virtual content anywhere in the real world, managing it in a more structured manner still needs to be addressed. Augmented reality (AR) browser technology is the gateway to such structured software platform and an anywhere AR user experience. AR browsers are the substitute of Web browsers in the real world, permitting overlay of interactive multimedia content on the physical world or objects they refer to. As the current generation allows us to barely see floating virtual items in the physical world, a tighter coupling with our reality has not yet been explored. This paper presents our recent effort to create rich, seamless, and adaptive AR browsers. We discuss major challenges in the area and present an agenda on future research directions for an everyday augmented world.

[1]  Bjorn Ekengren,et al.  Mobile Augmented Reality , 2010 .

[2]  Filip De Turck,et al.  A component-based approach towards mobile distributed and collaborative PTAM , 2012, 2012 IEEE International Symposium on Mixed and Augmented Reality (ISMAR).

[3]  P. Palange,et al.  From the authors , 2007, European Respiratory Journal.

[4]  David W. Murray,et al.  Parallel Tracking and Mapping on a camera phone , 2009, 2009 8th IEEE International Symposium on Mixed and Augmented Reality.

[5]  Dieter Schmalstieg,et al.  Color harmonization for Augmented Reality , 2010, 2010 IEEE International Symposium on Mixed and Augmented Reality.

[6]  Jens Grubert,et al.  Augmented Reality Browser Survey , 2012 .

[7]  Blair MacIntyre,et al.  The Argon AR Web Browser and standards-based AR application environment , 2011, 2011 10th IEEE International Symposium on Mixed and Augmented Reality.

[8]  Suya You,et al.  Real-Time Object Tracking for Augmented Reality Combining Graph Cuts and Optical Flow , 2007, 2007 6th IEEE and ACM International Symposium on Mixed and Augmented Reality.

[9]  Steven K. Feiner,et al.  A touring machine: Prototyping 3D mobile augmented reality systems for exploring the urban environment , 1997, Digest of Papers. First International Symposium on Wearable Computers.

[10]  Dieter Schmalstieg,et al.  Exploiting sensors on mobile phones to improve wide-area localization , 2012, Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012).

[11]  Dieter Schmalstieg,et al.  Image-driven view management for augmented reality browsers , 2012, 2012 IEEE International Symposium on Mixed and Augmented Reality (ISMAR).

[12]  Ian D. Reid,et al.  Dense Reconstruction Using 3D Object Shape Priors , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[13]  Jens Grubert,et al.  Augmented reality browsers: essential products or only gadgets? , 2013, CACM.

[14]  Andrew Blake,et al.  "GrabCut" , 2004, ACM Trans. Graph..

[15]  Hannes Kaufmann,et al.  AR Record&Replay: situated compositing of video content in mobile augmented reality , 2012, OZCHI.

[16]  Ronald Azuma,et al.  Tracking requirements for augmented reality , 1993, CACM.

[17]  Joseph Michael Rozier.  Here&There : an augmented reality system of linked audio , 2000 .

[18]  Dieter Schmalstieg,et al.  Online Creation of Panoramic Augmented Reality Annotations on Mobile Phones , 2012, IEEE Pervasive Computing.

[19]  Silvio Savarese,et al.  Dense Object Reconstruction with Semantic Priors , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[20]  Deborah Hix,et al.  The Effects of Text Drawing Styles, Background Textures, and Natural Lighting on Text Legibility in Outdoor Augmented Reality , 2006, Presence: Teleoperators & Virtual Environments.

[21]  James C. Spohrer,et al.  Information in Places , 1999, IBM Syst. J..

[22]  Gerhard Reitmayr,et al.  North-centred orientation tracking on mobile phones , 2010, 2010 IEEE International Symposium on Mixed and Augmented Reality.

[23]  Dieter Schmalstieg,et al.  Global pose estimation using multi-sensor fusion for outdoor Augmented Reality , 2009, 2009 8th IEEE International Symposium on Mixed and Augmented Reality.

[24]  Sabine Süsstrunk,et al.  Frequency-tuned salient region detection , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[25]  Ken Perlin,et al.  ClayVision: the (elastic) image of the city , 2012, CHI.

[26]  Blair MacIntyre,et al.  Walled Gardens: Apps and Data as Barriers to Augmenting Reality , 2013, IEEE Computer Graphics and Applications.

[27]  Sean J. Barbeau,et al.  Positional Accuracy of Assisted GPS Data from High-Sensitivity GPS-enabled Mobile Phones , 2011, Journal of Navigation.

[28]  Paul H. J. Kelly,et al.  SLAM++: Simultaneous Localisation and Mapping at the Level of Objects , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[29]  Dieter Schmalstieg,et al.  Robust detection and tracking of annotations for outdoor augmented reality browsing , 2011, Comput. Graph..

[30]  J. Edward Swan,et al.  Adaptive User Interfaces in Augmented Reality , 2003 .

[31]  Alan B. Craig.  Mobile Augmented Reality , 2013 .

[32]  Dieter Schmalstieg,et al.  Robust and unobtrusive marker tracking on mobile phones , 2008, 2008 7th IEEE/ACM International Symposium on Mixed and Augmented Reality.

[33]  Woontack Woo,et al.  IMAF: in situ indoor modeling and annotation framework on mobile phones , 2012, Personal and Ubiquitous Computing.

[34]  Tom Drummond,et al.  Distributed visual processing for augmented reality , 2012, 2012 IEEE International Symposium on Mixed and Augmented Reality (ISMAR).

[35]  Blair MacIntyre,et al.  Ghosts in the Machine: Integrating 2D Video Actors into a 3D AR System , 2001 .

[36]  Dieter Schmalstieg,et al.  Real-time panoramic mapping and tracking on mobile phones , 2010, 2010 IEEE Virtual Reality Conference (VR).

[37]  Deborah Hix,et al.  Active Text Drawing Styles for Outdoor Augmented Reality: A User-Based Study and Design Implications , 2007, 2007 IEEE Virtual Reality Conference.

[38]  Yolanda Vazquez-Alvarez.  Designing spatial audio interfaces for mobile devices: supporting multitasking and context information , 2010, Mobile HCI.

[39]  Blair MacIntyre,et al.  Integrating 2-D Video Actors into 3-D Augmented-Reality Systems , 2002, Presence: Teleoperators & Virtual Environments.

[40]  Blair MacIntyre,et al.  Browsing the Real-World Wide Web: Maintaining Awareness of Virtual Information in an AR Information Space , 2003, Int. J. Hum. Comput. Interact..

[41]  Dieter Schmalstieg,et al.  Real-time self-localization from panoramic images on mobile devices , 2011, 2011 10th IEEE International Symposium on Mixed and Augmented Reality.

[42]  Dieter Schmalstieg,et al.  Pose tracking from natural features on mobile phones , 2008, 2008 7th IEEE/ACM International Symposium on Mixed and Augmented Reality.

[43]  Dieter Schmalstieg,et al.  Sketching up the world: in situ authoring for mobile Augmented Reality , 2012, Personal and Ubiquitous Computing.

[44]  Ronald Azuma,et al.  Orientation Tracking for Outdoor Augmented Reality Registration , 1999, IEEE Computer Graphics and Applications.