Evaluation of Classical Operators and Fuzzy Logic Algorithms for Edge Detection of Panels at Exterior Cladding of Buildings

The automated process of construction defect detection using non-contact methods provides vital information for quality control and updating building information modelling. The external cladding in modular construction should be regularly controlled in terms of the quality of panels and proper installation because its appearance is very important for clients. However, there are limited computational methods for examining the installation issues of external cladding remotely in an automated manner. These issues could be the incorrect sitting of a panel, unequal joints in an elevation, scratches or cracks on the face of a panel or dimensions of different elements of external cladding. This paper aims to present seven algorithms to detect panel edges and statistically compare their performance through application on two scenarios of buildings in construction sites. Two different scenarios are selected, where the building facades are available to the public, and a sample of 100 images is taken using a state-of-the-art 3D camera for edge detection analysis. The experimentation results are validated by using a series of computational error and accuracy analyses and statistical methods including Mean Square Error, Peak Signal to Noise Ratio and Structural Similarity Index. The performance of an image processing algorithm depends on the quality of images and the algorithm utilised. The results show better performance of the fuzzy logic algorithm because it detects clear edges for installed panels. The applications of classical operators including Sobel, Canny, LoG, Prewitt and Roberts algorithms give similar results and show similarities in terms of the average of errors and accuracy. In addition, the results show that the minor difference of the average of the error and accuracy indices for Sobel, Canny, LoG, Prewitt and Roberts methods between both scenarios are not statistically significant, while the difference in the average of the error and accuracy indices for RGB-Sobel and Fuzzy methods between both scenarios are statistically significant. The accuracy of the algorithms can be improved by removing unwanted items such as vegetation and clouds in the sky. The evaluated algorithms assist practitioners to analyse their images collected day to day from construction sites, and to update building information modelling and the project digital drawings. Future work may need to focus on the combination of the evaluated algorithms using new data sets including colour edge detection for automatic defect identification using RGB and 360-degree images.

[1]  Cao Vu Dung,et al.  Autonomous concrete crack detection using deep fully convolutional neural network , 2019, Automation in Construction.

[2]  Steven Davis,et al.  Conceptualising information and equipment technology adoption in construction , 2016 .

[3]  Samad M. E. Sepasgozar,et al.  The role of customers and vendors in modern construction equipment technology diffusion , 2017 .

[4]  R. D. Daruwala,et al.  Comparisions of Robert, Prewitt, Sobel operator based edge detection methods for real time uses on FPGA , 2015, 2015 International Conference on Technologies for Sustainable Development (ICTSD).

[5]  Tanishq Gupta,et al.  Indoor mapping for smart cities — An affordable approach: Using Kinect Sensor and ZED stereo camera , 2017, 2017 International Conference on Indoor Positioning and Indoor Navigation (IPIN).

[6]  Samsung Lim,et al.  Implementation of As-Built Information Modelling UsingMobile and Terrestrial Lidar Systems , 2014 .

[7]  Oral Büyüköztürk,et al.  Deep Learning‐Based Crack Damage Detection Using Convolutional Neural Networks , 2017, Comput. Aided Civ. Infrastructure Eng..

[8]  Lei Peng,et al.  Review on the Fire Safety of Exterior Wall Claddings in High-rise Buildings in China☆ , 2013 .

[9]  Alessandro Palermo,et al.  Facade damage assessment of multi-storey buildings in the 2011 Christchurch earthquake , 2011 .

[10]  Eklas Hossain,et al.  Density based smart traffic control system using canny edge detection algorithm for congregating traffic information , 2017, 2017 3rd International Conference on Electrical Information and Communication Technology (EICT).

[11]  Paul W. Fieguth,et al.  A review on computer vision based defect detection and condition assessment of concrete and asphalt civil infrastructure , 2015, Adv. Eng. Informatics.

[12]  Mahmood Fathy,et al.  A classified and comparative study of edge detection algorithms , 2002, Proceedings. International Conference on Information Technology: Coding and Computing.

[13]  Jian Li,et al.  Non-contact fatigue crack detection in civil infrastructure through image overlapping and crack breathing sensing , 2019, Automation in Construction.

[14]  Perry Forsythe,et al.  Evaluation of Terrestrial and Mobile Scanner Technologies for Part-Built Information Modeling , 2018, Journal of Construction Engineering and Management.

[15]  Sara Shirowzhan,et al.  Building Classification from Lidar Data for Spatio-temporal Assessment of 3D Urban Developments , 2017 .

[16]  Ming-Yu Liu,et al.  Deep Active Learning for Civil Infrastructure Defect Detection and Classification , 2017 .

[17]  Xiaoming Sun,et al.  A Pavement Crack Detection Method Combining 2D with 3D Information Based on Dempster‐Shafer Theory , 2014, Comput. Aided Civ. Infrastructure Eng..

[18]  Mita Nasipuri,et al.  Handwritten Devanagari numerals recognition using grid based Hausdroff distance , 2017 .

[19]  Samad M. E. Sepasgozar,et al.  Challenges of Migrating from Desktop-Based BIM in Construction , 2016 .

[20]  Ying Bai,et al.  Advanced Fuzzy Logic Technologies in Industrial Applications , 2010 .

[21]  Mehmet Akif Günen,et al.  A novel edge detection approach based on backtracking search optimization algorithm (BSA) clustering , 2017, 2017 8th International Conference on Information Technology (ICIT).

[22]  Robert J. Thomas,et al.  Comparison of deep convolutional neural networks and edge detectors for image-based crack detection in concrete , 2018, Construction and Building Materials.

[23]  Steven Davis,et al.  Modelling the Construction Technology Implementation Framework: An Empirical Study , 2015 .

[24]  Jianhua Wang,et al.  Detecting damaged buildings caused by earthquake using local gradient orientation entropy statistics method , 2015, 2015 IEEE International Geoscience and Remote Sensing Symposium (IGARSS).

[25]  Chunlu Liu,et al.  Applications of multirotor drone technologies in construction management , 2019 .

[26]  Burcu Akinci,et al.  3D Imaging in Construction and Infrastructure Management: Technological Assessment and Future Research Directions , 2018, EG-ICE.

[27]  Steven Davis,et al.  Dissemination Practices of Construction Sites’ Technology Vendors in Technology Exhibitions , 2018, Journal of Management in Engineering.

[28]  Hiam Khoury,et al.  Vision-Based Framework for Intelligent Monitoring of Hardhat Wearing on Construction Sites , 2019, J. Comput. Civ. Eng..

[29]  Ali Akbarnezhad,et al.  BIM adoption model for small and medium construction organisations in Australia , 2018, Engineering, Construction and Architectural Management.

[30]  Ning Wang,et al.  New Crack Detection Method for Bridge Inspection Using UAV Incorporating Image Processing , 2018, Journal of Aerospace Engineering.

[31]  Fereidoon Moghadas Nejad,et al.  Evaluation of pavement surface drainage using an automated image acquisition and processing system , 2018 .

[32]  R. Maini Study and Comparison of Various Image Edge Detection Techniques , 2004 .

[33]  Samad M. E. Sepasgozar,et al.  An Investigation on Virtual Information Modeling Acceptance Based on Project Management Knowledge Areas , 2018, Buildings.

[34]  Bo Jiang,et al.  Real-time multi-resolution edge detection with pattern analysis on graphics processing unit , 2018, Journal of Real-Time Image Processing.

[35]  D Marr,et al.  Theory of edge detection , 1979, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[36]  Nhat-Duc Hoang,et al.  Metaheuristic Optimized Edge Detection for Recognition of Concrete Wall Cracks: A Comparative Study on the Performances of Roberts, Prewitt, Canny, and Sobel Algorithms , 2018, Advances in Civil Engineering.

[37]  Pinaki Pratim Acharjya,et al.  Study and Comparison of Different Edge Detectors for Image Segmentation , 2012 .

[38]  K. Karibasappa,et al.  Morphological change detection system for real time traffic analysis , 2015, 2015 IEEE International Conference on Computer Graphics, Vision and Information Security (CGVIS).

[39]  Sara Shirowzhan,et al.  Challenges and Opportunities for Implementation of Laser Scanners in Building Construction , 2016 .

[40]  Gholamreza Anbarjafari,et al.  Optimal image compression via block-based adaptive colour reduction with minimal contour effect , 2018, Multimedia Tools and Applications.

[41]  Rih-Teng Wu,et al.  A texture‐Based Video Processing Methodology Using Bayesian Data Fusion for Autonomous Crack Detection on Metallic Surfaces , 2017, Comput. Aided Civ. Infrastructure Eng..

[42]  Sara Shirowzhan,et al.  A Scanner Technology Acceptance Model for Construction Projects , 2017 .

[43]  Jack Chin Pang Cheng,et al.  Automated detection of sewer pipe defects in closed-circuit television images using deep learning techniques , 2018, Automation in Construction.

[44]  Milan Tuba,et al.  Edge detection in medical ultrasound images using adjusted Canny edge detection algorithm , 2016, 2016 24th Telecommunications Forum (TELFOR).

[45]  Mu-Chun Su,et al.  A self organizing map optimization based image recognition and processing model for bridge crack inspection , 2017 .

[46]  Sara Shirowzhan,et al.  Spatial compactness metrics and Constrained Voxel Automata development for analyzing 3D densification and applying to point clouds: A synthetic review , 2018, Automation in Construction.

[47]  E. Rogers,et al.  Diffusion of innovations , 1964, Encyclopedia of Sport Management.

[48]  Artur Janowski,et al.  Artificial model in the assessment of the algorithm of objects recorded by laser scanning shape detection (ALS/TLS) , 2011 .

[49]  Rosepreet Kaur Bhogal,et al.  Edge Detection Using Fuzzy Logic (Fuzzy Sobel, Fuzzy Template, and Fuzzy Inference System) , 2018 .

[50]  Steven Davis,et al.  Construction Technology Adoption Cube: An Investigation on Process, Factors, Barriers, Drivers, and Decision Makers using NVivo and AHP Analysis , 2018 .

[51]  Juha Hyyppä,et al.  Depth camera indoor mapping for 3D virtual radio play , 2018 .

[52]  Sudeep Sarkar,et al.  Comparison of Edge Detectors: A Methodology and Initial Study , 1998, Comput. Vis. Image Underst..

[53]  Leonhard E. Bernold,et al.  An investigation of modern building equipment technology adoption in the Australian construction industry , 2018, Engineering, Construction and Architectural Management.

[54]  Samad M. E. Sepasgozar,et al.  Modeling the Implementation Process for New Construction Technologies: Thematic Analysis Based on Australian and U.S. Practices , 2018 .

[55]  Sudeep Sarkar,et al.  Comparison of edge detectors: a methodology and initial study , 1996, Proceedings CVPR IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[56]  E. L. Lehmann,et al.  Theory of point estimation , 1950 .

[57]  Leonhard E. Bernold,et al.  Factors Influencing the Decision of Technology Adoption in Construction , 2012 .

[58]  Hong Shan Neoh,et al.  Adaptive Edge Detection for Real-Time Video Processing using FPGAs , 2005 .

[59]  Umesh Ghanekar,et al.  Image steganography based on Canny edge detection, dilation operator and hybrid coding , 2018, J. Inf. Secur. Appl..

[60]  Xu Liu,et al.  Geo-Informatics in Resource Management and Sustainable Ecosystem , 2015, Communications in Computer and Information Science.

[61]  G. T. Shrivakshan,et al.  A Comparison of various Edge Detection Techniques used in Image Processing , 2012 .

[62]  Quoc-Lam Nguyen,et al.  Automatic recognition of asphalt pavement cracks using metaheuristic optimized edge detection algorithms and convolution neural network , 2018, Automation in Construction.

[63]  Soumyadip Dhar,et al.  A novel method for edge detection in a gray image based on human psychovisual phenomenon and Bat algorithm , 2017 .

[64]  Leonhard E. Bernold,et al.  Discussion of “Barriers of Implementing Modern Methods of Construction” by M. Motiar Rahman , 2016 .

[65]  Markus König,et al.  Planning and executing construction inspections with unmanned aerial vehicles , 2018 .

[66]  Mohamed Elhoseny,et al.  An approach for de-noising and contrast enhancement of retinal fundus image using CLAHE , 2019, Optics & Laser Technology.

[67]  Aous Thabit Naman,et al.  COGL: Coefficient Graph Laplacians for Optimized JPEG Image Decoding , 2019, IEEE Transactions on Image Processing.

[68]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[69]  Lawrence G. Roberts,et al.  Machine Perception of Three-Dimensional Solids , 1963, Outstanding Dissertations in the Computer Sciences.

[70]  Sara Shirowzhan,et al.  Implementation of Rapid As-built Building Information Modeling Using Mobile LiDAR , 2014 .

[71]  Juha Hyyppä,et al.  Visualization of building models and sensor data using open 3D platforms , 2016 .

[72]  Thomas S. Huang,et al.  Human face detection in a complex background , 1994, Pattern Recognit..

[73]  Youngjib Ham,et al.  Analyzing context and productivity of tunnel earthmoving processes using imaging and simulation , 2018, Automation in Construction.

[74]  Changyoon Kim,et al.  4D CAD model updating using image processing-based construction progress monitoring , 2013 .

[75]  Brenda McCabe,et al.  Automated computer vision-based detection of components of under-construction indoor partitions , 2017 .

[76]  Chang Liu,et al.  Monitoring Physical Progress of Indoor Buildings Using Mobile and Terrestrial Point Clouds , 2018 .

[77]  Peter Kim,et al.  Utilisation of a New Terrestrial Scanner for Reconstruction of As-Built Models: A Comparative Study , 2015 .