Computer vision for real-time extrusion quality monitoring and control in robotic construction

Abstract In this paper, a vision-based real-time extrusion quality monitoring system is developed for robotic construction. Initially, the details related to the extrusion system, data acquisition and processing unit, and the proposed algorithm are discussed. The reliability and responsiveness of the developed system is then evaluated on six determined levels of material variation. To demonstrate its application, the vision algorithm is used to develop an innovative closed-loop extrusion system. This system is able to automatically adjust the extrusion rate based on the vision system feedback. Such self-regulating extrusion system would be able to continuously print layers of acceptable dimensions using any printable mixture, without the need for prior calibration and despite some mixture rheology variations. All in all, the high precision and responsiveness of the developed system demonstrates the great potential for computer vision as a real-time quality monitoring and control tool for robotic construction.

[1]  Behrokh Khoshnevis,et al.  Perspectives on a BIM-integrated software platform for robotic construction through Contour Crafting , 2018 .

[2]  SangHyun Lee,et al.  Computer vision techniques for construction safety and health monitoring , 2015, Adv. Eng. Informatics.

[3]  Philip David,et al.  Object recognition in high clutter images using line features , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[4]  Sara Mantellato,et al.  Hydration and rheology control of concrete for digital fabrication: Potential admixtures and cement chemistry , 2018, Cement and Concrete Research.

[5]  Markus König,et al.  Interior construction state recognition with 4D BIM registered image sequences , 2018 .

[6]  Nuria Aleixos,et al.  Erratum to: Advances in Machine Vision Applications for Automatic Inspection and Quality Evaluation of Fruits and Vegetables , 2011 .

[7]  Behrokh Khoshnevis,et al.  A Framework for Performance-Based Testing of Fresh Mixtures for Construction-Scale 3D Printing , 2018, RILEM Bookseries.

[8]  Behrokh Khoshnevis,et al.  Construction-Scale 3D Printing: Shape Stability of Fresh Printing Concrete , 2017 .

[9]  Ioannis K. Brilakis,et al.  Automated computation of the fundamental matrix for vision based construction site applications , 2011, Adv. Eng. Informatics.

[10]  Brenda McCabe,et al.  Automated computer vision-based detection of components of under-construction indoor partitions , 2017 .

[11]  Mizi Fan,et al.  Additive manufacturing technology and its implementation in construction as an eco-innovative solution , 2018, Automation in Construction.

[12]  Saeid Minaei,et al.  Potential Applications of Computer Vision in Quality Inspection of Rice: A Review , 2015, Food Engineering Reviews.

[13]  Xiangyu Wang,et al.  A critical review of the use of 3-D printing in the construction industry , 2016 .

[14]  Yousef Al Ohali,et al.  Original Article: Computer vision based date fruit grading system: Design and implementation , 2011 .

[15]  Clément Gosselin,et al.  Large-scale 3D printing of ultra-high performance concrete – a new processing route for architects and builders , 2016 .

[16]  Damien Rangeard,et al.  Structural built-up of cement-based materials used for 3D-printing extrusion techniques , 2016 .

[17]  Naoshi Kondo,et al.  Automation on fruit and vegetable grading system and food traceability. , 2010 .

[18]  Jing Zhang,et al.  Optimal machine operation planning for construction by Contour Crafting , 2013 .

[19]  Markus König,et al.  BIM for 3D Printing in Construction , 2018 .

[20]  Asj Akke Suiker,et al.  Mechanical performance of wall structures in 3D printing processes: Theory, design tools and experiments , 2018 .

[21]  Andrey Dimitrov,et al.  Vision-based material recognition for automated monitoring of construction progress and generating building information modeling from unordered site image collections , 2014, Adv. Eng. Informatics.

[22]  Da-Wen Sun,et al.  Recent developments in the applications of image processing techniques for food quality evaluation , 2004 .

[23]  Freek Bos,et al.  Early age mechanical behaviour of 3D printed concrete: Numerical modelling and experimental testing , 2018 .

[24]  Behrokh Khoshnevis,et al.  Cementitious materials for construction-scale 3D printing: Laboratory testing of fresh printing mixture , 2017 .

[25]  Jing Zhang,et al.  Deformation Analysis of Sulfur Concrete Structures Made by Contour Crafting , 2015 .

[26]  Da-Wen Sun,et al.  Improving quality inspection of food products by computer vision: a review , 2004 .

[27]  Kari Pulli,et al.  Realtime Computer Vision with OpenCV , 2012, ACM Queue.

[28]  Nicolas Roussel,et al.  Digital Concrete: Opportunities and Challenges , 2016 .

[29]  Lieyun Ding,et al.  Development of a BIM-based Automated Construction System☆ , 2014 .

[30]  Ming Xia,et al.  Effect of surface moisture on inter-layer strength of 3D printed concrete , 2018 .

[31]  Ali Akbar Ramezanianpour,et al.  Studying effects of low-reactivity GGBFS on chloride resistance of conventional and high strength concretes , 2016 .

[32]  José Blasco,et al.  In-line sorting of irregular potatoes by using automated computer-based machine vision system , 2012 .

[33]  P. K. Mehta,et al.  Concrete: Microstructure, Properties, and Materials , 2005 .

[34]  Behrokh Khoshnevis,et al.  Construction by Contour Crafting using sulfur concrete with planetary applications , 2016 .

[35]  Mohammad Shekarchi,et al.  Repeatability, responsiveness and relative cost analysis of SCC workability test methods , 2012 .