An interactive augmented reality tool for constructing free-form modular surfaces

Abstract Although modern software has paved the way for architects to design complex forms, such as free-forms, construction remains challenging, costly, and time-consuming which requires skilled workers. Advanced digital fabrication technologies can offer new ways to fill the gap between design and construction. Augmented Reality (AR) technology is one such technology that has many potentials in various fields, however, its capabilities are not sufficiently explored yet, especially in the field of digital fabrication. This study presents a new affordable interactive multi-marker augmented reality tool for constructing free-form modular surfaces implemented by integrating common accessible devices. The proposed tool consists of two digital cameras, a head-mounted display, a processor, and two markers that enable the user to virtually see the accurate location of any proposed object in the real world. A controlling subsystem was also designed to enhance the accuracy of construction. Method efficiency was studied in five full-scale prototypes. The results showed that the majority of errors (91%) were less than 6 mm, and 2° for lateral placements and orientation errors.

[1]  Markus König,et al.  Natural markers for augmented reality-based indoor navigation and facility maintenance , 2014 .

[2]  Franco Tecchia.  Fundamentals of Wearable Computers and Augmented Reality, Second Edition , 2016, PRESENCE: Teleoperators and Virtual Environments.

[3]  Pierre Dillenbourg,et al.  Designing augmented reality for the classroom , 2013, Comput. Educ..

[4]  Sergei Lupashin,et al.  The Flight Assembled Architecture installation: Cooperative construction with flying machines , 2014, IEEE Control Systems.

[5]  Thomas Modeen.  CADCAMing: The use of rapid prototyping for the conceptualization and fabrication of architecture , 2003 .

[6]  Wes McGee,et al.  Robotic Fabrication in Architecture, Art and Design 2014 , 2014 .

[7]  Jozef Novák Marcincin,et al.  Augmented Reality Aided Manufacturing , 2013, VARE.

[8]  Hirokazu Kato,et al.  Marker tracking and HMD calibration for a video-based augmented reality conferencing system , 1999, Proceedings 2nd IEEE and ACM International Workshop on Augmented Reality (IWAR'99).

[9]  Yasin Ozarslan,et al.  Augmented Reality in Education: Current Technologies and the Potential for Education , 2012 .

[10]  Ranita Biswas,et al.  An Improved Canny Edge Detection Algorithm Based on Type-2 Fuzzy Sets , 2012 .

[11]  Philip F. Yuan,et al.  Low-Tech Digital Fabrication: Traditional Brick as Material in Digital Practice , 2013 .

[12]  Yi-Ping Chen,et al.  Image-based 3D scene reconstruction and exploration in augmented reality , 2013 .

[13]  Shaohua Zhang,et al.  Towards cloud Augmented Reality for construction application by BIM and SNS integration , 2013 .

[14]  Ying Wang,et al.  Integrating Augmented Reality with Building Information Modeling: Onsite construction process controlling for liquefied natural gas industry , 2014 .

[15]  Ernesto Redondo Domínguez,et al.  Hand-Held augmented reality: usability and academic performance assessment in educational environments : case study of an Engineering Degree Course , 2013 .

[16]  Woodrow Barfield,et al.  Location-Based Mixed and Augmented Reality Storytelling , 2015 .

[17]  P. Milgram,et al.  A Taxonomy of Mixed Reality Visual Displays , 1994 .

[18]  Vineet R. Kamat,et al.  Georeferenced Registration of Construction Graphics in Mobile Outdoor Augmented Reality , 2007 .

[19]  Rajesh Kumar Rai,et al.  Implementation and Comparision of Various Edge Detection Methods , 2015 .

[20]  Maria Grazia Gnoni,et al.  Evaluating the application of augmented reality devices in manufacturing from a process point of view: An AHP based model , 2016, Expert Syst. Appl..

[21]  David Malah,et al.  A study of edge detection algorithms , 1982, Comput. Graph. Image Process..

[22]  Andrew Y. C. Nee,et al.  An authorable context-aware augmented reality system to assist the maintenance technicians , 2012 .

[23]  Branko Kolravic.  ARCHITECTURE IN THE DIGITAL AGE: DESIGN AND MANUFACTURING , 2003 .

[24]  EliaValerio,et al.  Evaluating the application of augmented reality devices in manufacturing from a process point of view , 2016 .

[25]  Lawrence Sass.  Synthesis of design production with integrated digital fabrication , 2007 .

[26]  Horst Bischof,et al.  Augmented Reality for Construction Site Monitoring and Documentation , 2014, Proceedings of the IEEE.

[27]  Maarten Moesen,et al.  Robust beam compensation for laser-based additive manufacturing , 2011, Comput. Aided Des..

[28]  Timo Engelke,et al.  An augmented reality training platform for assembly and maintenance skills , 2013, Robotics Auton. Syst..

[29]  R. Abboud,et al.  Architecture in an Age of Augmented Reality: Opportunities and Obstacles for Mobile AR in Design, Construction, and Post-Completion. , 2014 .

[30]  Neri Oxman,et al.  A Compound Arm Approach to Digital Construction , 2014 .

[31]  K. S. Hareesh,et al.  Study and comparison of various image edge detection techniques used in quality inspection and evaluation of agricultural and food products by computer vision , 2011 .

[32]  Isidro Navarro Delgado,et al.  Mobile learning in the field of Architecture and Building Construction. A case study analysis , 2014, International Journal of Educational Technology in Higher Education.

[33]  Peter E.D. Love,et al.  Augmented Reality in built environment: Classification and implications for future research , 2013 .

[34]  G. T. Shrivakshan,et al.  A Comparison of various Edge Detection Techniques used in Image Processing , 2012 .

[35]  Dieter Schmalstieg,et al.  Handheld Augmented Reality for underground infrastructure visualization , 2008, Personal and Ubiquitous Computing.

[36]  Rashmi,et al.  Algorithm and Technique on Various Edge Detection : A Survey , 2013 .

[37]  Chris Dede,et al.  EcoMOBILE: Integrating augmented reality and probeware with environmental education field trips , 2013, Comput. Educ..

[38]  Fabio Gramazio,et al.  Digital Materiality in Architecture , 2008 .

[39]  Günter Pritschow,et al.  Technological aspects in the development of a mobile bricklaying robot , 1995 .

[40]  Neri Oxman,et al.  Compound fabrication: A multi-functional robotic platform for digital design and fabrication , 2013 .

[41]  Yao-Ting Sung,et al.  Development and behavioral pattern analysis of a mobile guide system with augmented reality for painting appreciation instruction in an art museum , 2014, Comput. Educ..

[42]  Tsuyoshi Murata,et al.  {m , 1934, ACML.

[43]  Tomohiro Fukuda,et al.  An invisible height evaluation system for building height regulation to preserve good landscapes using augmented reality , 2011 .

[44]  Andrew Y. C. Nee,et al.  Augmented reality applications in manufacturing: a survey , 2008 .

[45]  Sanni Siltanen,et al.  Diminished reality for augmented reality interior design , 2017, The Visual Computer.

[46]  Branko Kolarevic.  Digital Fabrication: Manufacturing Architecture in the Information Age , 2001 .

[47]  S. Lakshmi,et al.  IJCA Special Issue on “Computer Aided Soft Computing Techniques for Imaging and Biomedical Applications” CASCT, 2010. A study of Edge Detection Techniques for Segmentation Computing Approaches , 2022 .

[48]  Jason D. Moss,et al.  Characteristics of Head-Mounted Displays and Their Effects on Simulator Sickness , 2011, Hum. Factors.

[49]  C. Chandrasekar,et al.  A Comparison of various Edge Detection Techniques used in Image Processing , 2012 .

[50]  Ziga Turk,et al.  Measuring the potential of augmented reality in civil engineering , 2015, Adv. Eng. Softw..

[51]  Julia Treleaven,et al.  Simulator sickness incidence and susceptibility during neck motion-controlled virtual reality tasks , 2015, Virtual Reality.

[52]  Wayne Piekarski,et al.  ARQuake: the outdoor augmented reality gaming system , 2002, CACM.

[53]  Fabio Gramazio,et al.  Mobile Robotic Brickwork , 2016 .

[54]  Joseph M. Gattas,et al.  Design and digital fabrication of folded sandwich structures , 2016 .

[55]  Levent Burak Kara,et al.  Conceptual design and modification of freeform surfaces using dual shape representations in augmented reality environments , 2012, Comput. Aided Des..

[56]  Žiga Turk,et al.  Component based engineering of a mobile BIM-based Augmented Reality system , 2014 .

[57]  Lawrence Sass,et al.  Materializing a Design with Plywood , 2007 .

[58]  Ireyuwa E. Igbinosa,et al.  Comparison of Edge Detection Technique in Image Processing Techniques , 2013 .

[59]  Andrew Y. C. Nee,et al.  Augmented reality applications in design and manufacturing , 2012 .

[60]  Xiangyu Wang,et al.  Research trends and opportunities of augmented reality applications in architecture, engineering, and construction , 2013 .

[61]  Xiangyu Wang.  Augmented Reality in Architecture and Design: Potentials and Challenges for Application , 2009 .

[62]  Holger Regenbrecht,et al.  Augmented reality projects in the automotive and aerospace industries , 2005, IEEE Computer Graphics and Applications.

[63]  G. Padmavathi,et al.  Performance evaluation of the various edge detectors and filters for the noisy IR images , 2009 .

[64]  Carlos Delgado Kloos,et al.  Impact of an augmented reality system on students' motivation for a visual art course , 2013, Comput. Educ..

[65]  Woodrow Barfield,et al.  Haptic Augmented Reality: Taxonomy, Research Status, and Challenges , 2015 .

[66]  Charles E. Hughes,et al.  Applying Mixed Reality to Entertainment , 2002, Computer.

[67]  Areti Damala,et al.  Bridging the gap between the digital and the physical: design and evaluation of a mobile augmented reality guide for the museum visit , 2008, DIMEA.

[68]  Mark Billinghurst,et al.  A Survey of Augmented Reality , 2015, Found. Trends Hum. Comput. Interact..