Virtual visual sensors and their application in structural health monitoring

Wireless sensor networks are being increasingly accepted as an effective tool for structural health monitoring. The ability to deploy a wireless array of sensors efficiently and effectively is a key factor in structural health monitoring. Sensor installation and management can be difficult in practice for a variety of reasons: a hostile environment, high labour costs and bandwidth limitations. We present and evaluate a proof-of-concept application of virtual visual sensors to the well-known engineering problem of the cantilever beam, as a convenient physical sensor substitute for certain problems and environments. We demonstrate the effectiveness of virtual visual sensors as a means to achieve non-destructive evaluation. Major benefits of virtual visual sensors are its non-invasive nature, ease of installation and cost-effectiveness. The novelty of virtual visual sensors lies in the combination of marker extraction with visual tracking realised by modern computer vision algorithms. We demonstrate that by deploying a collection of virtual visual sensors on an oscillating structure, its modal shapes and frequencies can be readily extracted from a sequence of video images. Subsequently, we perform damage detection and localisation by means of a wavelet-based analysis. The contributions of this article are as follows: (1) use of a sub-pixel accuracy marker extraction algorithm to construct virtual sensors in the spatial domain, (2) embedding dynamic marker linking within a tracking-by-correspondence paradigm that offers benefits in computational efficiency and registration accuracy over traditional tracking-by-searching systems and (3) validation of virtual visual sensors in the context of a structural health monitoring application.

[1]  C.C. Enz,et al.  A low-power low-voltage transceiver architecture suitable for wireless distributed sensors network , 2000, 2000 IEEE International Symposium on Circuits and Systems. Emerging Technologies for the 21st Century. Proceedings (IEEE Cat No.00CH36353).

[2]  M. Rucka,et al.  Crack identification using wavelets on experimental static deflection profiles , 2006 .

[3]  Ian F. Akyildiz,et al.  A survey on wireless multimedia sensor networks , 2007, Comput. Networks.

[4]  Krzysztof Wilde,et al.  Application of continuous wavelet transform in vibration based damage detection method for beams and plates , 2006 .

[5]  Natasha Gelfand,et al.  SURFTrac: Efficient tracking and continuous object recognition using local feature descriptors , 2009, CVPR.

[6]  Matthijs C. Dorst.  Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[7]  Marek Krawczuk,et al.  Experimental Verification and Comparison of Mode Shape-Based Damage Detection Methods , 2009 .

[8]  Sridha Sridharan,et al.  Camera calibration in wireless multimedia sensor networks , 2009, 2009 International Conference on Intelligent Sensors, Sensor Networks and Information Processing (ISSNIP).

[9]  S. Patsias,et al.  Damage Detection Using Optical Measurements and Wavelets , 2002 .

[10]  Lihi Zelnik-Manor,et al.  Context-Aware Saliency Detection , 2012, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  Andriy Myronenko,et al.  Point Set Registration: Coherent Point Drift , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Jing Shi,et al.  Beam damage detection using computer vision technology , 2010 .

[13]  Pablo Andrés Arbeláez,et al.  Finding Semantic Structures in Image Hierarchies Using Laplacian Graph Energy , 2010, ECCV.

[14]  Vincent Lepetit,et al.  Combining edge and texture information for real-time accurate 3D camera tracking , 2004, Third IEEE and ACM International Symposium on Mixed and Augmented Reality.

[15]  Mani B. Srivastava,et al.  ViridiScope: design and implementation of a fine grained power monitoring system for homes , 2009, UbiComp.

[16]  Julian Padget,et al.  Non-invasive damage detection in composite beams using marker extraction and wavelets , 2011, Smart Structures and Materials + Nondestructive Evaluation and Health Monitoring.

[17]  Mario Di Francesco,et al.  Energy conservation in wireless sensor networks: A survey , 2009, Ad Hoc Networks.

[18]  S. Mallat.  A wavelet tour of signal processing , 1998 .

[19]  Ramesh Govindan,et al.  Monitoring civil structures with a wireless sensor network , 2006, IEEE Internet Computing.

[20]  Lihi Zelnik-Manor,et al.  Context-aware saliency detection , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[21]  Gilbert-Rainer Gillich,et al.  RELIABLE METHOD TO DETECT AND ASSESS DAMAGES IN BEAMS BASED ON FREQUENCY CHANGES , 2012 .

[22]  Manuel Menezes de Oliveira Neto,et al.  Real-time line detection through an improved Hough transform voting scheme , 2008, Pattern Recognit..

[23]  Gregory J. Pottie,et al.  Protocols for self-organization of a wireless sensor network , 2000, IEEE Wirel. Commun..

[24]  A. Chukwujekwu Okafor,et al.  Structural Damage Detection in Beams by Wavelet Transforms , 2000 .

[25]  François Ingelrest,et al.  SensorScope: Application-specific sensor network for environmental monitoring , 2010, TOSN.

[26]  David E. Culler,et al.  Experiences with a high-fidelity wireless building energy auditing network , 2009, SenSys '09.

[27]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[28]  Nicholas R. Jennings,et al.  An Agent-Based Distributed Coordination Mechanism for Wireless Visual Sensor Nodes Using Dynamic Programming , 2010, Comput. J..

[29]  Matt Welsh,et al.  Deploying a wireless sensor network on an active volcano , 2006, IEEE Internet Computing.

[30]  Aleksandar Milenkovic,et al.  Wireless sensor networks for personal health monitoring: Issues and an implementation , 2006, Comput. Commun..

[31]  Pizhong Qiao,et al.  Vibration-based Damage Identification Methods: A Review and Comparative Study , 2011 .

[32]  Stphane Mallat,et al.  A Wavelet Tour of Signal Processing, Third Edition: The Sparse Way , 2008 .

[33]  Ser Tong Quek,et al.  Practical issues in the detection of damage in beams using wavelets , 2001 .

[34]  Ian F. Akyildiz,et al.  Wireless sensor networks: a survey , 2002, Comput. Networks.

[35]  Konstantinos P. Ferentinos,et al.  Adaptive design optimization of wireless sensor networks using genetic algorithms , 2007, Comput. Networks.

[36]  E. Peter Carden,et al.  Vibration Based Condition Monitoring: A Review , 2004 .

[37]  Charles R. Farrar,et al.  Damage identification and health monitoring of structural and mechanical systems from changes in their vibration characteristics: A literature review , 1996 .

[38]  Richard O. Duda,et al.  Use of the Hough transformation to detect lines and curves in pictures , 1972, CACM.

[39]  Sukun Kim,et al.  Health Monitoring of Civil Infrastructures Using Wireless Sensor Networks , 2007, 2007 6th International Symposium on Information Processing in Sensor Networks.

[40]  Eric B. Flynn,et al.  A Bayesian approach to optimal sensor placement for structural health monitoring with application to active sensing , 2010 .

[41]  Shinae Jang,et al.  Full-Scale Experimental Validation of High-Fidelity Wireless Measurement on a Historic Truss Bridge , 2011 .

[42]  Yaobin Mao,et al.  A real-time and robust multi-circle detection method based on randomized Hough transform , 2012, 2012 International Conference on Computer Science and Information Processing (CSIP).