KHARMA : A KML / HTML Architecture for Mobile Augmented Reality Applications

Widespread future adoption of augmented reality technology will rely on a broadly accessible standard for authoring and distributing content with, at a minimum, the flexibility and interactivity provided by current web authoring technologies. The growing number of augmented reality platforms for mobile devices suggests that a single browser for viewing this content may be just over the horizon. The ideal solution for fostering broader adoption is an open architecture that empowers millions of web authors by leveraging the tools and content already available to them. We introduce KHARMA, an open architecture based on KML for geospatial, marker and relative referencing combined with standard browser supported HTML5 and JavaScript technologies for content development and delivery. Our main contribution is a re-conceptualization of KML that turns HTML content formerly confined to balloons into first-class elements in the scene. We introduce a namespace extension, KARML that gives authors extensive control over the presentation of HTML content and its spatial relationship to other content. This combination lets users rapidly develop and host rich interactive mobile augmented reality content using existing HTML authoring tools, client-side JavaScript scripting, AJAX-style database communications and multi-user session-controlled HTTP webhosting. This architecture also introduces a bridging strategy for content delivery on commodity mobile devices based on the use of surveyed geographic locations and synthetic backgrounds. A reference browser implemented for the iPhone platform is described along with a number of ongoing projects that are using the technology.

[1]  Dieter Schmalstieg,et al.  First steps towards handheld augmented reality , 2003, Seventh IEEE International Symposium on Wearable Computers, 2003. Proceedings..

[2]  Bruce H. Thomas,et al.  Outdoor Augmented Reality Gaming on Five Dollars a Day , 2005, AUIC.

[3]  Dieter Schmalstieg,et al.  Real-Time Detection and Tracking for Augmented Reality on Mobile Phones , 2010, IEEE Transactions on Visualization and Computer Graphics.

[4]  Russell M. Taylor,et al.  VRPN: a device-independent, network-transparent VR peripheral system , 2001, VRST '01.

[5]  Blair MacIntyre,et al.  DART: the Designer's Augmented Reality Toolkit , 2003, The Second IEEE and ACM International Symposium on Mixed and Augmented Reality, 2003. Proceedings..

[6]  Steven K. Feiner,et al.  Windows on the world: 2D windows for 3D augmented reality , 1993, UIST '93.

[7]  James C. Spohrer,et al.  Information in Places , 1999, IBM Syst. J..

[8]  Vannevar Bush,et al.  As we may think , 1945, INTR.

[9]  APRIL: a high-level framework for creating augmented reality presentations , 2005 .

[10]  Ann Morrison,et al.  Like bees around the hive: a comparative study of a mobile augmented reality map , 2009, CHI.

[11]  Blair MacIntyre,et al.  Browsing the Real-World Wide Web: Maintaining Awareness of Virtual Information in an AR Information Space , 2003, Int. J. Hum. Comput. Interact..

[12]  Dieter Schmalstieg,et al.  A Handheld Augmented Reality Museum Guide , 2005 .

[13]  Ryutarou Ohbuchi,et al.  Merging virtual objects with the real world: seeing ultrasound imagery within the patient , 1992, SIGGRAPH.

[14]  Steven K. Feiner,et al.  Knowledge-based augmented reality , 1993, CACM.

[15]  Blair MacIntyre,et al.  Wizard of Oz support throughout an iterative design process , 2005, IEEE Pervasive Computing.

[16]  Steven K. Feiner,et al.  Exploring MARS: developing indoor and outdoor user interfaces to a mobile augmented reality system , 1999, Comput. Graph..

[17]  Steven M. Seitz,et al.  Photo tourism: exploring photo collections in 3D , 2006, ACM Trans. Graph..

[18]  Sarantos Kapidakis,et al.  ACM International Conference Proceeding Series , 2012, PETRA 2012.

[19]  Dieter Schmalstieg,et al.  Real-time panoramic mapping and tracking on mobile phones , 2010, 2010 IEEE Virtual Reality Conference (VR).

[20]  Dieter Schmalstieg,et al.  APRIL: a high-level framework for creating augmented reality presentations , 2005, IEEE Proceedings. VR 2005. Virtual Reality, 2005..

[21]  G. Klein,et al.  Parallel Tracking and Mapping for Small AR Workspaces , 2007, 2007 6th IEEE and ACM International Symposium on Mixed and Augmented Reality.

[22]  Holger Regenbrecht,et al.  A pragmatic approach to augmented reality authoring , 2002, Proceedings. International Symposium on Mixed and Augmented Reality.

[23]  Dieter Schmalstieg,et al.  The Studierstube Augmented Reality Project , 2002, Presence: Teleoperators & Virtual Environments.

[24]  Ivan Poupyrev,et al.  The MagicBook: a transitional AR interface , 2001, Comput. Graph..

[25]  Blair MacIntyre,et al.  BragFish: exploring physical and social interaction in co-located handheld augmented reality games , 2008, ACE '08.

[26]  Werner Hartmann,et al.  Authoring of a mixed reality assembly instructor for hierarchical structures , 2003, The Second IEEE and ACM International Symposium on Mixed and Augmented Reality, 2003. Proceedings..

[27]  Dieter Schmalstieg,et al.  Towards Massively Multi-user Augmented Reality on Handheld Devices , 2005, Pervasive.

[28]  Steven K. Feiner,et al.  Rolling and shooting: two augmented reality games , 2010, CHI Extended Abstracts.

[29]  Steven K. Feiner,et al.  A touring machine: Prototyping 3D mobile augmented reality systems for exploring the urban environment , 1997, Digest of Papers. First International Symposium on Wearable Computers.

[30]  Jay David Bolter,et al.  Presence and the Aura of Meaningful Places , 2004 .