A 3D GIS-based interactive registration mechanism for outdoor augmented reality system

An interactive method is proposed for registration between virtual and real objects.We propose an outdoor augmented reality (AR) system, named ARGIS.The proposed ARGIS combines 3DGIS, HMD, GPS, IMU and interactive devices.ARGIS overcomes the drawback of traditional vision tracking method for registration.We developed a prototype and tested it on the campus of Peking University, China. Registering virtual objects with reference to their corresponding real-world objects plays a key role in augmented reality (AR) system. Although there have been a lot of work on using vision-based method to perform registration for indoor AR system, it is very difficult to apply such registration method for outdoor AR system due to the inability to modify the objects in outdoor environment and the huge range of working area. 3D Geographic Information System (GIS) is capable of providing an outdoor virtual geographic environment where users are located at, which may provide users with a corresponding virtual object for the one in the physical world. In this study, a 3D GIS-based registration mechanism is proposed for outdoor AR system. Specifically, an easy-use interactive method for precise registration was developed to improve the performance of the registration. To implement the registration mechanism, an outdoor AR system built upon 3D GIS was developed, named Augmented Reality Geographical Information System (ARGIS). ARGIS has the capability of performing precise registration in outdoor environment without using traditional vision tracking method, which thus enables users to arbitrarily manipulate the system. A prototype was developed to conduct experiment on the campus of Peking University, Beijing, China to test the proposed registration mechanism. The experiment shows that the developed registration mechanism is feasible and efficient in the outdoor environment. The ARGIS is expected to enrich the applications of outdoor AR system, including but not limited to underground facility mapping, emergency rescue and urban planning.

[1]  Mark Billinghurst,et al.  AntarcticAR: An outdoor AR experience of a virtual tour to Antarctica , 2013, 2013 IEEE International Symposium on Mixed and Augmented Reality - Arts, Media, and Humanities (ISMAR-AMH).

[2]  Gyk Shea,et al.  Peer-review paper, geolocation positioning with wireless cellular network in Hong Kong , 2004 .

[3]  Ronald Azuma,et al.  Performance analysis of an outdoor augmented reality tracking system that relies upon a few mobile beacons , 2006, 2006 IEEE/ACM International Symposium on Mixed and Augmented Reality.

[4]  Jae Yeol Lee,et al.  Direct hand touchable interactions in augmented reality environments for natural and intuitive user experiences , 2013, Expert Syst. Appl..

[5]  A. Dunser,et al.  CityViewAR: A mobile outdoor AR application for city visualization , 2012, 2012 IEEE International Symposium on Mixed and Augmented Reality - Arts, Media, and Humanities (ISMAR-AMH).

[6]  Laurence Nigay,et al.  Handheld Augmented Reality: Effect of registration jitter on cursor-based pointing techniques , 2013, IHM.

[7]  Dimitrios Buhalis,et al.  Overview of smartphone augmented reality applications for tourism. , 2012, ICIT 2012.

[8]  Tom Drummond,et al.  Localisation and interaction for augmented maps , 2005, Fourth IEEE and ACM International Symposium on Mixed and Augmented Reality (ISMAR'05).

[9]  Jiann-Der Lee,et al.  Medical augment reality using a markerless registration framework , 2012, Expert Syst. Appl..

[10]  Ronald Azuma,et al.  A motion-stabilized outdoor augmented reality system , 1999, Proceedings IEEE Virtual Reality (Cat. No. 99CB36316).

[11]  Fotis Liarokapis,et al.  Mobile augmented reality techniques for GeoVisualisation , 2005, Ninth International Conference on Information Visualisation (IV'05).

[12]  Hideyuki Tamura,et al.  A hybrid registration method for outdoor augmented reality , 2001, Proceedings IEEE and ACM International Symposium on Augmented Reality.

[13]  Soh-Khim Ong,et al.  Computer vision centric hybrid tracking for augmented reality in outdoor urban environments , 2009, VRCAI '09.

[14]  Wai Yeung Yan,et al.  Urban land cover classification using airborne LiDAR data: A review , 2015 .

[15]  Said M. Easa,et al.  Potential Accuracy of Traffic Signs' Positions Extracted From Google Street View , 2013, IEEE Transactions on Intelligent Transportation Systems.

[16]  Lu Zhao,et al.  Kaidan: An outdoor AR puzzle adventure game , 2013, 2013 IEEE International Symposium on Mixed and Augmented Reality - Arts, Media, and Humanities (ISMAR-AMH).

[17]  Ross T. Smith,et al.  Robust gloves for 3D interaction in mobile outdoor AR environments , 2006, 2006 IEEE/ACM International Symposium on Mixed and Augmented Reality.

[18]  Dieter Schmalstieg,et al.  Handheld Augmented Reality for underground infrastructure visualization , 2008, Personal and Ubiquitous Computing.

[19]  Said M. Easa,et al.  Using Stereo Satellite Imagery for Topographic and Transportation Applications: An Accuracy Assessment , 2010 .

[20]  Said M. Easa,et al.  Construction of digital 3D highway model using stereo IKONOS satellite imagery , 2011 .

[21]  Vineet R. Kamat,et al.  Georeferenced Registration of Construction Graphics in Mobile Outdoor Augmented Reality , 2007 .

[22]  Hideo Saito,et al.  AR City Representation System Based on Map Recognition Using Topological Information , 2009, HCI.

[23]  Dimitrios Buhalis,et al.  Smartphone Augmented Reality Applications for Tourism , 2012 .

[24]  Chun-Ting Chang,et al.  Three-dimensional positioning from Google street view panoramas , 2013, IET Image Process..

[25]  Suya You,et al.  A robust hybrid tracking system for outdoor augmented reality , 2004, IEEE Virtual Reality 2004.

[26]  Ronald Azuma,et al.  A Survey of Augmented Reality , 1997, Presence: Teleoperators & Virtual Environments.

[27]  Bruce H. Thomas,et al.  ARQuake: an outdoor/indoor augmented reality first person application , 2000, Digest of Papers. Fourth International Symposium on Wearable Computers.

[28]  Ronald Azuma,et al.  Recent Advances in Augmented Reality , 2001, IEEE Computer Graphics and Applications.

[29]  Steven K. Feiner,et al.  A touring machine: Prototyping 3D mobile augmented reality systems for exploring the urban environment , 1997, Digest of Papers. First International Symposium on Wearable Computers.

[30]  Bruce H. Thomas,et al.  ARVino - outdoor augmented reality visualisation of viticulture GIS data , 2005, Fourth IEEE and ACM International Symposium on Mixed and Augmented Reality (ISMAR'05).

[31]  Geoffrey Yu-Kai Shea,et al.  EASYGO - A public transport query and guiding LBS , 2007, Location Based Services and TeleCartography.

[32]  Dieter Schmalstieg,et al.  Global pose estimation using multi-sensor fusion for outdoor Augmented Reality , 2009, 2009 8th IEEE International Symposium on Mixed and Augmented Reality.

[33]  Soh-Khim Ong,et al.  Registration using natural features for augmented reality systems , 2006, IEEE Transactions on Visualization and Computer Graphics.

[34]  Ernesto Damiani,et al.  Augmented reality technologies, systems and applications , 2010, Multimedia Tools and Applications.

[35]  Venkataraman Sundareswaran,et al.  Model-based visual tracking for outdoor augmented reality applications , 2002, Proceedings. International Symposium on Mixed and Augmented Reality.

[36]  S. Zlatanova,et al.  Knowledge-based automatic 3D line extraction from close range images , 2002 .