Improvement of registration accuracy of a handheld augmented reality system for urban landscape simulation

Abstract The need for visual landscape assessment in large-scale projects for the evaluation of the effects of a particular project on the surrounding landscape has grown in recent years. Augmented reality (AR) has been considered for use as a landscape simulation system in which a landscape assessment object created by 3D models is included in the present surroundings. With the use of this system, the time and the cost needed to perform a 3DCG modeling of present surroundings, which is a major issue in virtual reality, are drastically reduced. This research presents the development of a 3D map-oriented handheld AR system that achieves geometric consistency using a 3D map to obtain position data instead of GPS, which has low position information accuracy, particularly in urban areas. The new system also features a gyroscope sensor to obtain posture data and a video camera to capture live video of the present surroundings. All these components are mounted in a smartphone and can be used for urban landscape assessment. Registration accuracy is evaluated to simulate an urban landscape from a short- to a long-range scale. The latter involves a distance of approximately 2000 m. The developed AR system enables users to simulate a landscape from multiple and long-distance viewpoints simultaneously and to walk around the viewpoint fields using only a smartphone. This result is the tolerance level of landscape assessment. In conclusion, the proposed method is evaluated as feasible and effective.

[2]  Eunjoo Lee,et al.  The evaluation system for design alternatives in collaborative design , 2001 .

[3]  Steven K. Feiner,et al.  A touring machine: Prototyping 3D mobile augmented reality systems for exploring the urban environment , 1997, Digest of Papers. First International Symposium on Wearable Computers.

[4]  Shun Watanabe.  Simulating 3d architecture and urban landscapes in real space , 2011 .

[5]  Suya You,et al.  Natural Feature Tracking for Augmented Reality , 1999, IEEE Trans. Multim..

[6]  Tobias Höllerer,et al.  Wide-area scene mapping for mobile visual tracking , 2012, 2012 IEEE International Symposium on Mixed and Augmented Reality (ISMAR).

[7]  Stephen DiVerdi,et al.  Annotation in outdoor augmented reality , 2009, Comput. Graph..

[8]  Georg Gartner,et al.  A survey on augmented maps and environments: Approaches, interactions and applications , 2011 .

[9]  松嶋 正道,et al.  宇宙航空研究開発機構(Japan Aerospace Exploration Agency)先進複合材評価技術開発センター , 2004 .

[10]  Bruce H. Thomas,et al.  A wearable computer system with augmented reality to support terrestrial navigation , 1998, Digest of Papers. Second International Symposium on Wearable Computers (Cat. No.98EX215).

[11]  Eckart Lange.  Integration of computerized visual simulation and visual assessment in environmental planning , 1994 .

[12]  Ronald Azuma,et al.  A Survey of Augmented Reality , 1997, Presence: Teleoperators & Virtual Environments.

[13]  Hiroshi Ishii,et al.  Augmented urban planning workbench: overlaying drawings, physical models and digital simulation , 2002, Proceedings. International Symposium on Mixed and Augmented Reality.

[14]  Vineet R. Kamat,et al.  General-purpose modular hardware and software framework for mobile outdoor augmented reality applications in engineering , 2008, Adv. Eng. Informatics.

[15]  Areti Damala,et al.  Bridging the gap between the digital and the physical: design and evaluation of a mobile augmented reality guide for the museum visit , 2008, DIMEA.

[16]  Hirokazu Kato,et al.  Marker tracking and HMD calibration for a video-based augmented reality conferencing system , 1999, Proceedings 2nd IEEE and ACM International Workshop on Augmented Reality (IWAR'99).

[17]  Dieter Schmalstieg,et al.  First steps towards handheld augmented reality , 2003, Seventh IEEE International Symposium on Wearable Computers, 2003. Proceedings..

[18]  Yvonne Koch.  Visual Simulation A Users Guide For Architects Engineers And Planners , 2016 .

[19]  Przemyslaw Rokita.  Compositing computer graphics and real world video sequences , 1998, Comput. Networks.

[20]  Dieter Schmalstieg,et al.  Handheld Augmented Reality for underground infrastructure visualization , 2008, Personal and Ubiquitous Computing.

[21]  G. Klein,et al.  Parallel Tracking and Mapping for Small AR Workspaces , 2007, 2007 6th IEEE and ACM International Symposium on Mixed and Augmented Reality.

[22]  Tomohiro Fukuda,et al.  An invisible height evaluation system for building height regulation to preserve good landscapes using augmented reality , 2011 .

[23]  Dieter Schmalstieg,et al.  Handheld augmented reality indoor navigation with activity-based instructions , 2011, Mobile HCI.

[24]  Ian D. Bishop,et al.  Integration of augmented reality and GIS: A new approach to realistic landscape visualisation , 2008 .

[25]  Dieter Schmalstieg,et al.  Global pose estimation using multi-sensor fusion for outdoor Augmented Reality , 2009, 2009 8th IEEE International Symposium on Mixed and Augmented Reality.

[26]  P. Milgram,et al.  A Taxonomy of Mixed Reality Visual Displays , 1994 .

[27]  Tom Drummond,et al.  Going out: robust model-based tracking for outdoor augmented reality , 2006, 2006 IEEE/ACM International Symposium on Mixed and Augmented Reality.

[28]  Tobias Höllerer,et al.  Wide-area visual modeling and tracking for mobile augmented reality , 2012 .

[29]  L. van Berlo,et al.  C2B: AUGMENTED REALITY ON THE CONSTRUCTION SITE , 2009 .

[30]  Charles Woodward,et al.  MIXED REALITY FOR MOBILE CONSTRUCTION SITE VISUALIZATION AND COMMUNICATION , 2010 .