Development of Tactile Imaging for Underwater Structural Damage Detection

Underwater structural damage inspection has mainly relied on diver-based visual inspection, and emerging technologies include the use of remotely operated vehicles (ROVs) for improved efficiency. With the goal of performing an autonomous and robotic underwater inspection, a novel Tactile Imaging System for Underwater Inspection (TISUE) is designed, prototyped, and tested in this paper. The system has two major components, including the imaging subsystem and the manipulation subsystem. The novelty lies in the imaging subsystem, which consists of an elastomer-enabled contact-based optical sensor with specifically designed artificial lighting. The completed TISUE system, including optical imaging, data storage, display analytics, and a mechanical support subsystem, is further tested in a laboratory experiment. The experiment demonstrates that high-resolution and high-quality images of structural surface damage can be obtained using tactile ‘touch-and-sense’ imaging, even in a turbid water environment. A deep learning-based damage detection framework is developed and trained. The detection results demonstrate the similar detectability of five damage types in the obtained tactile images to images obtained from regular (land-based) structural inspection.

[1]  Vikram Pakrashi,et al.  An underwater lighting and turbidity image repository for analysing the performance of image-based non-destructive techniques , 2018 .

[2]  S. Katayama,et al.  Characterization and Mechanical Properties of Flexible Dimethylsiloxane‐Based Inorganic/Organic Hybrid Sheets , 2004 .

[3]  Thiru Aravinthan,et al.  Effectiveness of using fibre-reinforced polymer composites for underwater steel pipeline repairs , 2013 .

[4]  William J. Peine,et al.  Tactile Imaging System for Localizing Lung Nodules during Video Assisted Thoracoscopic Surgery , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[5]  J. Mackerle Finite element analysis and simulation of polymers?an addendum: a bibliography (1996?2002) , 2002 .

[6]  G. Cossu,et al.  1-Gb/s Transmission Over a Phosphorescent White LED by Using Rate-Adaptive Discrete Multitone Modulation , 2012, IEEE Photonics Journal.

[7]  S. Degraer,et al.  Differentiating between Underwater Construction Noise of Monopile and Jacket Foundations for Offshore Windmills: A Case Study from the Belgian Part of the North Sea , 2013, TheScientificWorldJournal.

[8]  Edward H. Adelson,et al.  Sensing and Recognizing Surface Textures Using a GelSight Sensor , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[9]  H. Harry Asada,et al.  A dual-use visible light approach to integrated communication and localization of underwater robots with application to non-destructive nuclear reactor inspection , 2012, 2012 IEEE International Conference on Robotics and Automation.

[10]  Naomi Kato,et al.  Autonomous underwater vehicle AQUA EXPLORER 1000 for inspection of underwater cables , 1996, Proceedings of Symposium on Autonomous Underwater Vehicle Technology.

[11]  Thomas Strock,et al.  Overview and Comparison of Nationwide Underwater Bridge Inspection Practices , 2009 .

[12]  Ingvar Claesson,et al.  The successive mean quantization transform , 2005, Proceedings. (ICASSP '05). IEEE International Conference on Acoustics, Speech, and Signal Processing, 2005..

[13]  Rajan Sen,et al.  Application of FRP composites for underwater piles repair , 2007 .

[14]  Hsin-Hung Chen,et al.  Vision-based line detection for underwater inspection of breakwater construction using an ROV , 2015 .

[15]  Vikram Pakrashi,et al.  A Stereo-Matching Technique for Recovering 3D Information from Underwater Inspection Imagery , 2018, Comput. Aided Civ. Infrastructure Eng..

[16]  R. Howe,et al.  Tactile imaging of breast masses: first clinical report. , 2001, Archives of surgery.

[17]  Kaspar Althoefer,et al.  An Ultrasonic Profiling Method for the Inspection of Tubular Structures , 2007, Comput. Aided Civ. Infrastructure Eng..

[18]  Jose Dolz,et al.  3D fully convolutional networks for subcortical segmentation in MRI: A large-scale study , 2016, NeuroImage.

[19]  A Sarvazyan,et al.  Mechanical Imaging - a Technology for 3-D Visualization and Characterization of Soft Tissue Abnormalities. A Review. , 2012, Current medical imaging reviews.

[20]  D. Beebe,et al.  Biological implications of polydimethylsiloxane-based microfluidic cell culture. , 2009, Lab on a chip.

[21]  Analysis of elastic micro optical components under large deformation , 2003 .

[22]  Eduard Vidal,et al.  Sparus II AUV—A Hovering Vehicle for Seabed Inspection , 2018, IEEE Journal of Oceanic Engineering.

[23]  Ting Wang,et al.  Underwater image enhancement via extended multi-scale Retinex , 2017, Neurocomputing.

[24]  S. Quake,et al.  From micro- to nanofabrication with soft materials. , 2000, Science.

[25]  Mohammad A. Qasaimeh,et al.  PVDF-Based Microfabricated Tactile Sensor for Minimally Invasive Surgery , 2009, Journal of Microelectromechanical Systems.

[26]  Sen Wang,et al.  Adaptive low-level control of autonomous underwater vehicles using deep reinforcement learning , 2018, Robotics Auton. Syst..

[27]  Z. Jane Wang,et al.  Novel Tactile Sensor Technology and Smart Tactile Sensing Systems: A Review , 2017, Sensors.

[28]  Huimin Lu,et al.  Non-uniform de-Scattering and de-Blurring of Underwater Images , 2018, Mob. Networks Appl..

[29]  Mohd Shahrieel Mohd Aras,et al.  Problem Identification for Underwater Remotely Operated Vehicle (ROV): A Case Study , 2012 .

[30]  Vikram Pakrashi,et al.  Protocols for Image Processing based Underwater Inspection of Infrastructure Elements , 2015 .

[31]  H. Moon,et al.  Evaluation on steel bar corrosion embedded in antiwashout underwater concrete containing mineral admixtures , 2006 .

[32]  P. Firoozfam,et al.  An ROV Stereovision System for Ship-Hull Inspection , 2006, IEEE Journal of Oceanic Engineering.

[33]  Edward H. Adelson,et al.  Improved GelSight tactile sensor for measuring geometry and slip , 2017, 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[34]  Trevor Darrell,et al.  Caffe: Convolutional Architecture for Fast Feature Embedding , 2014, ACM Multimedia.

[35]  Jan Wikander,et al.  Tactile sensing in intelligent robotic manipulation - a review , 2005, Ind. Robot.

[36]  A. Davis,et al.  High speed underwater inspection for port and harbour security using Coda Echoscope 3D sonar , 2005, Proceedings of OCEANS 2005 MTS/IEEE.

[37]  Louis L. Whitcomb,et al.  Underwater robotics: out of the research laboratory and into the field , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[38]  F. Schneider,et al.  Process and material properties of polydimethylsiloxane (PDMS) for Optical MEMS , 2009 .

[39]  R. van Noort,et al.  Mechanical properties of antibacterial silicone rubber for hydrocephalus shunts. , 1979, Journal of biomedical materials research.

[40]  Itsuro Kajiwara,et al.  Dynamic characterizations of underwater structures using noncontact vibration tests based on nanosecond laser ablation in water: evaluation of passive vibration suppression with damping materials , 2018 .

[41]  Khashayar Khorasani,et al.  Model predictive and non-cooperative dynamic game fault recovery control strategies for a network of unmanned underwater vehicles , 2019, Int. J. Control.

[42]  Codruta O. Ancuti,et al.  Color Balance and Fusion for Underwater Image Enhancement , 2018, IEEE Transactions on Image Processing.

[43]  J. E. DeVault,et al.  Robotic system for underwater inspection of bridge piers , 2000 .

[44]  Rafael E. Vásquez,et al.  Development of an Underwater Remotely Operated Vehicle (ROV) for Surveillance and Inspection of Port Facilities , 2010 .

[45]  Edward H. Adelson,et al.  Measurement of shear and slip with a GelSight tactile sensor , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[46]  Zhixing Wang,et al.  Crosslinking Effect on Polydimethylsiloxane Elastic Modulus Measured by Custom-Built Compression Instrument , 2014 .

[47]  G. Whitesides The origins and the future of microfluidics , 2006, Nature.

[48]  P. Joubert,et al.  Experimental study of PDMS mechanical properties for the optimization of polymer based flexible pressure micro-sensors , 2016 .

[49]  Zhong Lin Wang,et al.  Triboelectric active sensor array for self-powered static and dynamic pressure detection and tactile imaging. , 2013, ACS nano.

[50]  Salimzhan A. Gafurov,et al.  Autonomous Unmanned Underwater Vehicles Development Tendencies , 2015 .

[51]  J. R. Hewit,et al.  Tactile sensing technology for minimal access surgery––a review , 2003 .

[52]  Hossein Mousazadeh,et al.  Developing a navigation, guidance and obstacle avoidance algorithm for an Unmanned Surface Vehicle (USV) by algorithms fusion , 2018, Ocean Engineering.

[53]  Edward H. Adelson,et al.  GelSight: High-Resolution Robot Tactile Sensors for Estimating Geometry and Force , 2017, Sensors.

[54]  Gabriel Oliver,et al.  Optical Sensors and Methods for Underwater 3D Reconstruction , 2015, Sensors.

[55]  S. Quake,et al.  Monolithic microfabricated valves and pumps by multilayer soft lithography. , 2000, Science.

[56]  Yafei Wang,et al.  Fusion-based underwater image enhancement by wavelet decomposition , 2017, 2017 IEEE International Conference on Industrial Technology (ICIT).

[57]  Vikram Pakrashi,et al.  Image-Based Damage Assessment for Underwater Inspections , 2020 .

[58]  Trevor Darrell,et al.  Fully Convolutional Networks for Semantic Segmentation , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[59]  M. Haider,et al.  Flexible capacitive sensors for high resolution pressure measurement , 2008, 2008 IEEE Sensors.

[60]  J Fukui,et al.  DEVELOPMENT OF THE NEW INSPECTION METHOD ON SCOUR CONDITION AROUND EXISTING BRIDGE FOUNDATIONS , 2002 .

[61]  Na Li,et al.  Multi-scale adversarial network for underwater image restoration , 2019, Optics & Laser Technology.

[62]  Edward H. Adelson,et al.  Estimating object hardness with a GelSight touch sensor , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[63]  Benjamin C. K. Tee,et al.  An electrically and mechanically self-healing composite with pressure- and flexion-sensitive properties for electronic skin applications. , 2012, Nature nanotechnology.

[64]  L. Repetto,et al.  Permeability thickness dependence of polydimethylsiloxane (PDMS) membranes , 2015 .

[65]  Pere Ridao,et al.  Visual inspection of hydroelectric dams using an autonomous underwater vehicle , 2010, J. Field Robotics.

[66]  M. C. Tracey,et al.  Mechanical characterization of bulk Sylgard 184 for microfluidics and microengineering , 2014 .