Vision-based detection of loosened bolts using the Hough transform and support vector machines

Abstract Many contact-sensor-based methods for structural damage detection have been developed. However, these methods have difficulty compensating for environmental effects, such as variation or changes in temperature and humidity, which may lead to false alarms. In order to partially overcome these disadvantages, vision-based approaches have been developed to detect corrosions, cracks, delamination, and voids. However, there are few such approaches for loosened bolts. Therefore, we propose a novel vision-based detection method. Target images of loosened bolts were taken by a smartphone camera. From the images, simple damage-sensitive features, such as the horizontal and vertical lengths of the bolt head, were calculated automatically using the Hough transform and other image processing techniques. A linear support vector machine was trained with the aforementioned features, thereby building a robust classifier capable of automatically differentiating tight bolts from loose bolts. Leave-one-out cross-validation was adapted to analyze the performance of the proposed algorithm. The results highlight the excellent performance of the proposed approach to detecting loosened bolts, and that it can operate in quasi-real-time.

[1]  Guo Nan,et al.  A real-time visual inspection method of fastening bolts in freight car operation , 2015, Applied Optics and Photonics China.

[2]  Yi-Qing Ni,et al.  Correlating modal properties with temperature using long-term monitoring data and support vector machine technique , 2005 .

[3]  Charles R. Farrar,et al.  Structural Health Monitoring: A Machine Learning Perspective , 2012 .

[4]  Noah Snavely,et al.  Scene Reconstruction and Visualization from Internet Photo Collections: A Survey , 2011, IPSJ Trans. Comput. Vis. Appl..

[5]  Mohammad R. Jahanshahi,et al.  An innovative methodology for detection and quantification of cracks through incorporation of depth perception , 2011, Machine Vision and Applications.

[6]  R. Fisher THE USE OF MULTIPLE MEASUREMENTS IN TAXONOMIC PROBLEMS , 1936 .

[7]  Benjamin A. Graybeal,et al.  RELIABILITY OF VISUAL BRIDGE INSPECTION , 2001 .

[8]  Shuji Hashimoto,et al.  Image Processing Based on Percolation Model , 2006, IEICE Trans. Inf. Syst..

[9]  Bugao Xu,et al.  Automatic inspection of pavement cracking distress , 2006, J. Electronic Imaging.

[10]  Gaurav S. Sukhatme,et al.  Multi-image stitching and scene reconstruction for evaluating defect evolution in structures , 2011 .

[11]  Dimitrios G. Aggelis,et al.  Fracture mode identification in cementitious materials using supervised pattern recognition of acoustic emission features , 2014 .

[12]  Liang-Chien Chen,et al.  Measuring System for Cracks in Concrete Using Multitemporal Images , 2006 .

[13]  J. Kittler,et al.  Comparative study of Hough Transform methods for circle finding , 1990, Image Vis. Comput..

[14]  Frédo Durand,et al.  Structural Modal Identification Through High Speed Camera Video: Motion Magnification , 2014 .

[15]  Gangbing Song,et al.  Review of Bolted Connection Monitoring , 2013, Int. J. Distributed Sens. Networks.

[16]  Charles R Farrar,et al.  Damage prognosis: the future of structural health monitoring , 2007, Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[17]  Satoshi Izumi,et al.  Investigation into the self-loosening behavior of bolted joint subjected to rotational loading , 2012 .

[18]  Hoon Sohn,et al.  Effects of environmental and operational variability on structural health monitoring , 2007, Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[19]  Qiang Ji,et al.  A new efficient ellipse detection method , 2002, Object recognition supported by user interaction for service robots.

[20]  Young-Jin Cha,et al.  Motion Magnification Based Damage Detection Using High Speed Video , 2015 .

[21]  L. Rudin,et al.  Nonlinear total variation based noise removal algorithms , 1992 .

[22]  Frédo Durand,et al.  Modal identification of simple structures with high-speed video using motion magnification , 2015 .

[23]  Trevor Hastie,et al.  The Elements of Statistical Learning , 2001 .

[24]  You-Lin Xu,et al.  Temperature effect on vibration properties of civil structures: a literature review and case studies , 2012 .

[25]  Shuji Hashimoto,et al.  Fast crack detection method for large-size concrete surface images using percolation-based image processing , 2010, Machine Vision and Applications.

[26]  Ji Yeong Lee,et al.  Intelligent Bridge Inspection Using Remote Controlled Robot and Image Processing Technique , 2011 .

[27]  Chang-Soo Han,et al.  Auto inspection system using a mobile robot for detecting concrete cracks in a tunnel , 2007 .

[28]  Simon Rogers,et al.  A First Course in Machine Learning , 2011, Chapman and Hall / CRC machine learning and pattern recognition series.

[29]  C.A. Basca,et al.  Randomized Hough Transform for Ellipse Detection with Result Clustering , 2005, EUROCON 2005 - The International Conference on "Computer as a Tool".

[30]  Charles R. Farrar,et al.  Structural health monitoring for bolt loosening via a non-invasive vibro-haptics human–machine cooperative interface , 2015 .

[31]  Nohyu Kim,et al.  Measurement of axial stress using mode-converted ultrasound , 2009 .