Research trends and opportunities of augmented reality applications in architecture, engineering, and construction

Abstract Augmented reality (AR), a state-of-the-art technology for superimposing information onto the real world, has recently started to affect our daily lives. AR applications are becoming mature and versatile. This paper discusses trends in AR applications for architecture, engineering, construction, and facility management (AEC/FM). This paper specifically focuses on four technologies—localization, natural user interface (NUI), cloud computing, and mobile devices—which have the potential to influence the development of AR applications. Advances in localization technology will enable the deployment of AR in a complex environment. An NUI provides more convenient and intuitive user experiences, which can increase the usability of AR. Cloud computing environments allow users with internet access to ubiquitously retrieve information from almost anywhere. Hence, cloud computing increases the freedom of using AR in AEC/FM applications. Another factor that will lead to the wider usage of AR is that mobile devices are becoming smaller, more powerful, and less expensive. This paper summarizes the results of 101 research efforts, and outlines the research trends and opportunities for applying AR in the fields of AEC/FM.

[1]  Fabian Doil,et al.  Augmented Reality-based factory planning - an application tailored to industrial needs , 2007, 2007 6th IEEE and ACM International Symposium on Mixed and Augmented Reality.

[2]  Ronald Azuma,et al.  A Survey of Augmented Reality , 1997, Presence: Teleoperators & Virtual Environments.

[3]  Liang-Gee Chen,et al.  Smart display: A mobile self-adaptive projector-camera system , 2011, 2011 IEEE International Conference on Multimedia and Expo.

[4]  Arash Shahi,et al.  Deterioration of UWB positioning during construction , 2012 .

[5]  Éric Marchand,et al.  Real-time markerless tracking for augmented reality: the virtual visual servoing framework , 2006, IEEE Transactions on Visualization and Computer Graphics.

[6]  Hung-Lin Chi,et al.  Development of user interface for tele-operated cranes , 2012, Adv. Eng. Informatics.

[7]  Vishal Singh,et al.  Applying augmented reality for data interaction and collaboration in BIM , 2010, CAADRIA proceedings.

[8]  Jenna Burrell,et al.  Collectively defining context in a mobile, networked computing environment , 2001, CHI Extended Abstracts.

[9]  Xiangyu Wang,et al.  Mixed Reality-Based Visualization Interfaces for Architecture, Engineering, and Construction Industry , 2005 .

[10]  George Papagiannakis,et al.  Mobile Augmented Heritage: Enabling Human Life in Ancient Pompeii , 2007 .

[11]  IRENE RUI CHEN,et al.  Retrieving Lost Space With Tangible Augmented Reality , 2009 .

[12]  Ali M. Malkawi,et al.  Integrating Robot Mapping and Augmented Building Simulation , 2009 .

[13]  Michael I. Schwartzbach,et al.  An introduction to XML and web technologies , 2005 .

[14]  Xiangyu Wang,et al.  User perspectives on mixed reality tabletop visualization for face-to-face collaborative design review , 2008 .

[15]  Hannes Kaufmann,et al.  Collaborative Augmented Reality in Education , 2002 .

[16]  Andreas Dünser,et al.  Virtual and augmented reality as spatial ability training tools , 2006, CHINZ '06.

[17]  Mani Golparvar-Fard,et al.  Evaluation of image-based modeling and laser scanning accuracy for emerging automated performance monitoring techniques , 2011 .

[18]  Soh-Khim Ong,et al.  Robot Programming Using Augmented Reality , 2009, 2009 International Conference on CyberWorlds.

[19]  Marcus Wan,et al.  Wearable mobile augmented reality: evaluating outdoor user experience , 2011, VRCAI '11.

[20]  Mani Golparvar-Fard,et al.  Supporting Civil Engineers during Disaster Response and Recovery Using a Segway Mobile Workstation Chariot , 2012 .

[21]  Randy H. Katz,et al.  A view of cloud computing , 2010, CACM.

[22]  Hirokazu Kato,et al.  Marker tracking and HMD calibration for a video-based augmented reality conferencing system , 1999, Proceedings 2nd IEEE and ACM International Workshop on Augmented Reality (IWAR'99).

[23]  Cheng Zhang,et al.  Improving lifting motion planning and re-planning of cranes with consideration for safety and efficiency , 2012, Adv. Eng. Informatics.

[24]  Vincent Lepetit,et al.  Fully automated and stable registration for augmented reality applications , 2003, The Second IEEE and ACM International Symposium on Mixed and Augmented Reality, 2003. Proceedings..

[25]  Arash Shahi,et al.  Activity-based Data Fusion for Automated Progress Tracking of Construction Projects , 2012 .

[26]  Frédéric Bosché,et al.  Automated recognition of 3D CAD model objects in laser scans and calculation of as-built dimensions for dimensional compliance control in construction , 2010, Adv. Eng. Informatics.

[27]  Dieter Schmalstieg,et al.  Real-Time Detection and Tracking for Augmented Reality on Mobile Phones , 2010, IEEE Transactions on Visualization and Computer Graphics.

[28]  Patricio A. Vela,et al.  Automated Trajectory and Path Planning Analysis Based on Ultra Wideband Data , 2012, J. Comput. Civ. Eng..

[29]  Vineet R. Kamat,et al.  Integration of infrastructure based positioning systems and inertial navigation for ubiquitous context-aware engineering applications , 2011, Adv. Eng. Informatics.

[30]  Hugh Durrant-Whyte,et al.  Simultaneous localization and mapping (SLAM): part II , 2006 .

[31]  Byungil Kim,et al.  Interactive Modeler for Construction Equipment Operation Using Augmented Reality , 2012, J. Comput. Civ. Eng..

[32]  John M. Kamara,et al.  A framework for using mobile computing for information management on construction sites , 2011 .

[33]  Zeeshan Aziz.  Supporting Site-Based Processes Using Context-Aware Virtual Prototyping , 2012 .

[34]  David W. Murray,et al.  Video-rate localization in multiple maps for wearable augmented reality , 2008, 2008 12th IEEE International Symposium on Wearable Computers.

[35]  Andrew Y. C. Nee,et al.  Augmented reality applications in manufacturing: a survey , 2008 .

[36]  Sean White,et al.  Visual Hints for Tangible Gestures in Augmented Reality , 2007, 2007 6th IEEE and ACM International Symposium on Mixed and Augmented Reality.

[37]  Chimay J. Anumba,et al.  Ubiquitous location tracking for context-specific information delivery on construction sites , 2008 .

[38]  Pattie Maes,et al.  SixthSense: a wearable gestural interface , 2009, SIGGRAPH ASIA Art Gallery & Emerging Technologies.

[39]  Xiangyu Wang,et al.  A theoretical framework of a BIM-based multi-disciplinary collaboration platform , 2011 .

[40]  Mani Golparvar-Fard,et al.  Visualization of construction progress monitoring with 4D simulation model overlaid on time-lapsed photographs , 2009 .

[41]  Vineet R. Kamat,et al.  High-precision identification of contextual information in location-aware engineering applications , 2009, Adv. Eng. Informatics.

[42]  Dieter Schmalstieg,et al.  Handheld Augmented Reality for underground infrastructure visualization , 2008, Personal and Ubiquitous Computing.

[43]  Phillip S. Dunston,et al.  An iterative methodology for mapping mixed reality technologies to AEC operations , 2011, J. Inf. Technol. Constr..

[44]  Seung Yeon Choo,et al.  Augmented Reality-Based Education and Fire Protection for Traditional Korean Buildings , 2010 .

[45]  Xiangyu Wang,et al.  Comparative Effectiveness of Mixed Reality-Based Virtual Environments in Collaborative Design , 2011, IEEE Trans. Syst. Man Cybern. Part C.

[46]  Hui Wang,et al.  Distributed Augmented Reality for Visualizing Collaborative Construction Tasks , 2009 .

[47]  Ghang Lee,et al.  What Information Can or Cannot Be Exchanged? , 2011, J. Comput. Civ. Eng..

[48]  Ricardo Jardim-Goncalves,et al.  Challenging electronic procurement in the AEC sector: A BIM-based integrated perspective , 2011 .

[49]  Carl T. Haas,et al.  Reliability-Based Hybrid Data Fusion Method for Adaptive Location Estimation in Construction , 2012 .

[50]  Martin White,et al.  Web3D and Augmented Reality to support engineering education , 2004 .

[51]  Murphy Stein.  ARCADE: a system for augmenting gesture-based computer graphic presentations , 2012, SIGGRAPH '12.

[52]  G. Klein,et al.  Parallel Tracking and Mapping for Small AR Workspaces , 2007, 2007 6th IEEE and ACM International Symposium on Mixed and Augmented Reality.

[53]  Moonseo Park,et al.  RFID-Based Real-Time Locating System for Construction Safety Management , 2012, J. Comput. Civ. Eng..

[54]  Vineet R. Kamat,et al.  Interactive Augmented Reality Visualization for Improved Damage Prevention and Maintenance of Underground Infrastructure , 2009 .

[55]  Ricardo Jardim-Goncalves,et al.  SOA4BIM: Putting the building and construction industry in the Single European Information Space , 2010 .

[56]  Silvio Savarese,et al.  Application of D4AR - A 4-Dimensional augmented reality model for automating construction progress monitoring data collection, processing and communication , 2009, J. Inf. Technol. Constr..

[57]  Phillip S. Dunston,et al.  Potential of augmented reality as an assistant viewer for computer-aided drawing , 2006 .

[58]  Andrew W. Fitzgibbon,et al.  KinÊtre: animating the world with the human body , 2012, SIGGRAPH Talks.

[59]  Andrew W. Fitzgibbon,et al.  KinectFusion: Real-time dense surface mapping and tracking , 2011, 2011 10th IEEE International Symposium on Mixed and Augmented Reality.

[60]  Ömer Akin,et al.  Augmented reality-based computational fieldwork support for equipment operations and maintenance , 2011 .

[61]  Ali M. Malkawi,et al.  A new paradigm for Human-Building Interaction: the use of CFD and Augmented Reality , 2005 .

[62]  Xiangyu Wang,et al.  Using Augmented Reality to Plan Virtual Construction Worksite , 2007 .

[63]  Xiangyu Wang,et al.  Design, strategies, and issues towards an augmented reality-based construction training platform , 2007, J. Inf. Technol. Constr..

[64]  Shih-Chung Kang,et al.  Use of Tangible and Augmented Reality Models in Engineering Graphics Courses , 2011 .

[65]  Mani Golparvar-Fard,et al.  Research in Visualization Techniques for Field Construction , 2011 .

[66]  Phillip S. Dunston,et al.  A hierarchical taxonomy of aec operations for mixed reality applications , 2011, J. Inf. Technol. Constr..

[67]  Phillip S. Dunston,et al.  Identification of application areas for Augmented Reality in industrial construction based on technology suitability , 2008 .

[68]  Carl T. Haas,et al.  Using reference RFID tags for calibrating the estimated locations of construction materials , 2011 .

[69]  Chi En Yang,et al.  A Lightweight Imaged Based Bridge Inspection System Using Fishing Pole, Fishing Line and Fisheye Camera , 2011 .

[70]  Do Hyoung Shin,et al.  Utilization of ubiquitous computing for construction AR technology , 2009 .

[71]  Vineet R. Kamat,et al.  General-purpose modular hardware and software framework for mobile outdoor augmented reality applications in engineering , 2008, Adv. Eng. Informatics.

[72]  Meng-Han Tsai,et al.  On-Site Building Information Retrieval by Using Projection-Based Augmented Reality , 2012, J. Comput. Civ. Eng..

[73]  Charles Woodward,et al.  MIXED REALITY FOR MOBILE CONSTRUCTION SITE VISUALIZATION AND COMMUNICATION , 2010 .

[74]  Xiangyu Wang.  Improving Human-Machine Interfaces for Construction Equipment Operations with Mixed and Augmented Reality , 2008 .

[75]  Nobuyoshi Yabuki,et al.  Cooperative Reinforcing Bar Arrangement and Checking by Using Augmented Reality , 2007, CDVE.

[76]  Vineet R. Kamat,et al.  Georeferenced Registration of Construction Graphics in Mobile Outdoor Augmented Reality , 2007 .

[77]  Xiangyu Wang,et al.  Mixed Reality Technology Applications in Construction Equipment Operator Training , 2004 .

[78]  Tomohiro Fukuda,et al.  An invisible height evaluation system for building height regulation to preserve good landscapes using augmented reality , 2011 .

[79]  Vineet R. Kamat,et al.  Geospatial Databases and Augmented Reality Visualization for Improving Safety in Urban Excavation Operations , 2010 .

[80]  Xiangyu Wang,et al.  Compatibility issues in Augmented Reality systems for AEC: An experimental prototype study , 2006 .

[81]  Xiangyu Wang.  Augmented Reality in Architecture and Design: Potentials and Challenges for Application , 2009 .

[82]  Xiangyu Wang,et al.  A user-centered taxonomy for specifying mixed reality systems for aec industry , 2011, J. Inf. Technol. Constr..

[83]  Mustafa Alshawi,et al.  Exploring how information exchanges can be enhanced through cloud BIM , 2012 .

[84]  Holger Regenbrecht,et al.  Augmented reality projects in the automotive and aerospace industries , 2005, IEEE Computer Graphics and Applications.