Mobile augmented reality for teaching structural analysis

Abstract Structural analysis is an introductory core course that is taught in every civil engineering program as well as in most architectural and construction engineering programs. Previous research unveils students' deficits in understanding the behavior of structural elements in a three-dimensional (3D) context due to the shortcomings of traditional lecturing approaches, which put too much emphasis on the analysis of individual structural members, thereby falling short in providing a solid, easy-to-follow, and holistic approach to analyzing complex structures with a large number of interconnected elements. In this paper, the authors introduce a new pedagogy for teaching structural analysis that incorporates mobile augmented reality (AR) and interactive 3D visualization technology. The goal of this study is to enhance the contents used in structural analysis textbooks and on worksheets by visualizing discrete structural members employing AR along with interactive 3D models in order to illustrate how the structures behave under different loading conditions. Students can interactively change the load and observe the reaction resulting from this change with the instant feedback provided by the AR interface. The feasibility of AR concepts and interaction metaphors, as well as the potential of using AR for teaching structural analysis are investigated, specifically by focusing on challenges regarding content integration and interaction. An AR application is designed and developed, and a pilot study is conducted in a junior level structural analysis class to assess the pedagogical impact and the design concepts employed by the AR tool. Control and test groups are deployed, and students’ performance is measured using pre- and post-tests. The results of the pilot study indicate that the utilized AR design concepts have potential to contribute to students’ learning by providing interactive and 3D visualization features, which support constructive engagement and retention of information in students.

[1]  Ivan Poupyrev,et al.  The MagicBook: a transitional AR interface , 2001, Comput. Graph..

[2]  Jakob Nielsen,et al.  Improving a human-computer dialogue , 1990, CACM.

[3]  Pierre Dillenbourg,et al.  Designing augmented reality for the classroom , 2013, Comput. Educ..

[4]  Chris Dede,et al.  Augmented Reality Teaching and Learning , 2014 .

[5]  Ralph Johnson,et al.  design patterns elements of reusable object oriented software , 2019 .

[6]  Charles M. Eastman,et al.  BIM Handbook: A Guide to Building Information Modeling for Owners, Managers, Designers, Engineers and Contractors , 2008 .

[7]  Cy Y. Song,et al.  Fostering Creativity in Students in the Teaching of Structural Analysis , 2004 .

[8]  Wojciech Cellary,et al.  Evaluation of learners' attitude toward learning in ARIES augmented reality environments , 2013, Comput. Educ..

[9]  Jyh-Chong Liang,et al.  Current status, opportunities and challenges of augmented reality in education , 2013, Comput. Educ..

[10]  S. Kitipornchai,et al.  A New Approach to Teaching and Learning Structural Analysis , 2009, CSEDU.

[11]  Julio Davalos.  Neoclassical Active Learning Approach For Structural Analysis , 2003 .

[12]  Jakob Nielsen,et al.  Heuristic evaluation of user interfaces , 1990, CHI '90.

[13]  Burcu Akinci,et al.  IDENTIFICATION OF DATA ITEMS NEEDED FOR AUTOMATIC CLASH DETECTION IN MEP DESIGN COORDINATION , 2009 .

[14]  Andreas Donaubauer,et al.  Multi‐Scale Geometric‐Semantic Modeling of Shield Tunnels for GIS and BIM Applications , 2015, Comput. Aided Civ. Infrastructure Eng..

[15]  Marc Aurel Schnabel,et al.  Mixed Reality In Architecture, Design, And Construction , 2008 .

[16]  Andrew Selby,et al.  Co-design of augmented reality book for collaborative learning experience in primary education , 2015, 2015 SAI Intelligent Systems Conference (IntelliSys).

[17]  Oh-Seong Kwon,et al.  A framework for proactive construction defect management using BIM, augmented reality and ontology-based data collection template , 2013 .

[18]  Charles Woodward,et al.  MIXED REALITY FOR MOBILE CONSTRUCTION SITE VISUALIZATION AND COMMUNICATION , 2010 .

[19]  Vineet R. Kamat,et al.  Real-Time Hybrid Virtuality for Prevention of Excavation Related Utility Strikes , 2014, J. Comput. Civ. Eng..

[20]  Frédéric Bosché,et al.  The value of integrating Scan-to-BIM and Scan-vs-BIM techniques for construction monitoring using laser scanning and BIM: The case of cylindrical MEP components , 2015 .

[21]  B. J. Winer.  Statistical Principles in Experimental Design , 1992 .

[22]  Ronald Azuma,et al.  A Survey of Augmented Reality , 1997, Presence: Teleoperators & Virtual Environments.

[23]  Vineet R. Kamat,et al.  Interactive Augmented Reality Visualization for Improved Damage Prevention and Maintenance of Underground Infrastructure , 2009 .

[24]  Jason W. P. Ng,et al.  iARBook: An Immersive Augmented Reality system for education , 2014, 2014 IEEE International Conference on Teaching, Assessment and Learning for Engineering (TALE).

[25]  Simon Laflamme,et al.  BrIM implementation for documentation of bridge condition for inspection , 2015 .

[26]  Edward J. Jaselskis,et al.  Improving transportation projects using laser scanning , 2005 .

[27]  Mani Golparvar-Fard,et al.  Research in Visualization Techniques for Field Construction , 2011 .

[28]  Mohamad Bilal Ali,et al.  Collaborative Augmented Reality in Education: A Review , 2014, 2014 International Conference on Teaching and Learning in Computing and Engineering.

[29]  Vincent Lepetit,et al.  Monocular Model-based 3d Tracking of Rigid Objects (Foundations and Trends in Computer Graphics and Vision(R)) , 2005 .

[30]  André Borrmann,et al.  Infrastructural BIM standards – Development of an Information Delivery Manual for the geotechnical infrastructural design and analysis process , 2012 .

[31]  C. Jordi Girona.  TRADITION AND INNOVATION IN TEACHING STRUCTURAL DESIGN IN CIVIL ENGINEERING , 2007 .

[32]  Rama Chellappa,et al.  Visual tracking and recognition using appearance-adaptive models in particle filters , 2004, IEEE Transactions on Image Processing.

[33]  J. Amann,et al.  Creating a 3D-BIM-compliant road design based on IFC alignment originating from an OKSTRA-accordant 2D road design using the TUM Open Infra Platform and the OKSTRA class library , 2015 .

[34]  Dayang Rohaya Awang Rambli,et al.  Preliminary Investigation on the Use of Augmented Reality in Collaborative Learning , 2011 .

[35]  Poonsri Vate-U-Lan,et al.  An Augmented Reality 3D Pop-Up Book: The Development of a Multimedia Project for English Language Teaching , 2012, 2012 IEEE International Conference on Multimedia and Expo.

[36]  Mark Billinghurst,et al.  Augmented Reality in the Classroom , 2012, Computer.

[37]  Mohamed Jamal Zemerly,et al.  AIR-EDUTECH: Augmented immersive reality (AIR) technology for high school Chemistry education , 2016, 2016 IEEE Global Engineering Education Conference (EDUCON).

[38]  Frédéric Bosché,et al.  Tracking the Built Status of MEP Works: Assessing the Value of a Scan-vs-BIM System , 2014, J. Comput. Civ. Eng..

[39]  W. Eric L. Grimson,et al.  Learning Patterns of Activity Using Real-Time Tracking , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[40]  Nicolas Pena,et al.  Development of structural analysis virtual modules for iPad application , 2018, Comput. Appl. Eng. Educ..

[41]  Xiangyu Wang,et al.  Research trends and opportunities of augmented reality applications in architecture, engineering, and construction , 2013 .

[42]  Xiao Song,et al.  Construction of Simulation Environment Based on Augmented Reality Technique , 2013, AsiaSim.

[43]  Marc Alexa,et al.  Recent Advances in Mesh Morphing , 2002, Comput. Graph. Forum.

[44]  Vineet R. Kamat,et al.  Visualization of construction graphics in outdoor augmented reality , 2005, Proceedings of the Winter Simulation Conference, 2005..

[45]  Shogo Nishida,et al.  Virtual Pop-Up Book Based on Augmented Reality , 2007, HCI.

[46]  G. G. Stokes.  "J." , 1890, The New Yale Book of Quotations.

[47]  Burcu Akinci,et al.  Formalization of workflows for extracting bridge surveying goals from laser-scanned data , 2012 .

[48]  Bojan Kraut,et al.  Improving education experience with augmented reality (AR) , 2015, 2015 38th International Convention on Information and Communication Technology, Electronics and Microelectronics (MIPRO).

[49]  Poonsri Vate-U-Lan.  Augmented Reality 3D pop-up children book: Instructional design for hybrid learning , 2011, 2011 5th IEEE International Conference on E-Learning in Industrial Electronics (ICELIE).

[50]  Michael Cook,et al.  Augmented Reality Comes to Physics , 2013 .

[51]  Manuel Contero,et al.  Desktop vs. mobile: A comparative study of augmented reality systems for engineering visualizations in education , 2014, 2014 IEEE Frontiers in Education Conference (FIE) Proceedings.

[52]  Timothy Gifford,et al.  Virtual training for welding , 2004, Third IEEE and ACM International Symposium on Mixed and Augmented Reality.

[53]  James H. Oliver,et al.  A Hybrid Tracking Solution to Enhance Natural Interaction in Marker-based Augmented Reality Applications , 2013, ACHI 2013.

[54]  M. Uslenghi,et al.  The World Space Observatory (WSO-UV) - Current status , 2008, 0801.2080.

[55]  Halimah Badioze Zaman,et al.  A Participatory Design in Developing Prototype an Augmented Reality Book for Deaf Students , 2010, 2010 Second International Conference on Computer Research and Development.

[56]  Xing-Fei Yuan,et al.  Interactive Web‐based package for computer‐aided learning of structural behavior , 2002, Comput. Appl. Eng. Educ..

[57]  Noel Enyedy,et al.  Learning physics through play in an augmented reality environment , 2012, Int. J. Comput. Support. Collab. Learn..

[58]  Henry Been-Lirn Duh,et al.  Influences of AR-Supported Simulation on Learning Effectiveness in Face-to-face Collaborative Learning for Physics , 2011, 2011 IEEE 11th International Conference on Advanced Learning Technologies.

[59]  Amir H. Behzadan,et al.  Content Delivery Using Augmented Reality to Enhance Students' Performance in a Building Design and Assembly Project. , 2015 .

[60]  Xianglei Chen.  STEM Attrition: College Students' Paths into and out of STEM Fields. Statistical Analysis Report. NCES 2014-001. , 2013 .

[61]  Fred D. Davis.  Perceived Usefulness, Perceived Ease of Use, and User Acceptance of Information Technology , 1989, MIS Q..

[62]  Steven K. Feiner,et al.  Evaluating the benefits of augmented reality for task localization in maintenance of an armored personnel carrier turret , 2009, 2009 8th IEEE International Symposium on Mixed and Augmented Reality.

[63]  Mehdi Setareh,et al.  Virtual-SAP: an immersive tool for visualizing the response of building structures to environmental conditions , 2003, IEEE Virtual Reality, 2003. Proceedings..

[64]  Guido Staub,et al.  Applications for mixed reality , 2004 .

[65]  이훈,et al.  지각된 유용성(Perceived Usefulness)의 영향분석 , 2004 .

[66]  Sara Rankohi,et al.  Review and analysis of augmented reality literature for construction industry , 2013 .

[67]  Martin Fischer,et al.  Knowledge and Reasoning for MEP Coordination , 2003 .

[68]  André Borrmann,et al.  Exchange of parametric bridge models using a neutral data format , 2013 .

[69]  Vikas Saxena,et al.  Augmented Chemistry: Interactive Education System , 2012 .

[70]  Suya You,et al.  Natural Feature Tracking for Augmented Reality , 1999, IEEE Trans. Multim..

[71]  Tomas Akenine-Möller,et al.  Real-time rendering , 1997 .

[72]  Vincent Lepetit,et al.  Monocular Model-Based 3D Tracking of Rigid Objects: A Survey , 2005, Found. Trends Comput. Graph. Vis..

[73]  Phillip S. Dunston,et al.  Key Areas And Issues For Augmented Reality Applications On Construction Sites , 2009 .

[74]  Mari Ainasoja,et al.  User-centered design of augmented reality interior design service , 2013 .

[75]  Vineet R. Kamat,et al.  Augmented reality visualization: A review of civil infrastructure system applications , 2015, Adv. Eng. Informatics.

[76]  Vineet R. Kamat,et al.  Geometric modeling of geospatial data for visualization-assisted excavation , 2013, Adv. Eng. Informatics.

[77]  Hirokazu Kato,et al.  Marker tracking and HMD calibration for a video-based augmented reality conferencing system , 1999, Proceedings 2nd IEEE and ACM International Workshop on Augmented Reality (IWAR'99).

[78]  Benjamin Lok,et al.  Collocated AAR: Augmenting After Action Review with Mixed Reality , 2008, 2008 7th IEEE/ACM International Symposium on Mixed and Augmented Reality.

[79]  Dayang Rohaya Awang Rambli,et al.  Design consideration for Augmented Reality book-based application for collaborative learning environment , 2012, 2012 International Conference on Computer & Information Science (ICCIS).

[80]  Ronald Azuma,et al.  Recent Advances in Augmented Reality , 2001, IEEE Computer Graphics and Applications.

[81]  José M.F. Ferreira,et al.  MARVEL: A Mixed Reality Learning Environment for Vocational Training in Mechatronics , 2003 .

[82]  Charles E. Hughes,et al.  Mixed reality in education, entertainment, and training , 2005, IEEE Computer Graphics and Applications.

[83]  Greg Welch,et al.  Motion Tracking: No Silver Bullet, but a Respectable Arsenal , 2002, IEEE Computer Graphics and Applications.

[84]  Ulrich Neumann,et al.  Cognitive, performance, and systems issues for augmented reality applications in manufacturing and maintenance , 1998, Proceedings. IEEE 1998 Virtual Reality Annual International Symposium (Cat. No.98CB36180).

[85]  James H. Oliver,et al.  Comparison of Natural Feature Descriptors for Rigid-Object Tracking for Real-Time Augmented Reality , 2014 .

[86]  Steven K. Feiner,et al.  Augmented Reality in Architectural Construction, Inspection, and Renovation , 1996 .

[87]  Ruth A. Streveler,et al.  Why Do Students Choose Engineering? A Qualitative, Longitudinal Investigation of Students' Motivational Values , 2010 .

[88]  M. Haller.  Mixed Reality @ Education , 2005 .

[89]  Rebecca Brent,et al.  The Intellectual Development of Science and Engineering Students. Part 1: Models and Challenges , 2004 .