Super-resolution visualization of subwavelength defects via deep learning-enhanced ultrasonic beamforming: A proof-of-principle study

Abstract Detecting small, subwavelength defect has known to be a challenging task mainly due to the diffraction limit, according to which the minimum resolvable size is in the order of the wavelength of a propagating wave. In this proof-of-concept study, we present a deep learning-enhanced super-resolution ultrasonic beamforming approach that computationally exceeds the diffraction limit and visualizes subwavelength defects. The proposed super-resolution approach is a novel subwavelength beamforming methodology enabled by a hierarchical deep neural network architecture. The first network (the detection network) globally detects defective regions from an ultrasonic beamforming image. Subsequently, the second network (the super-resolution network) locally resolves subwavelength-scale fine details of the detected defects. We validate the proposed approach using two independent datasets: a bulk wave array dataset generated by numerical simulations and guided wave array dataset generated by laboratory experiments. The results demonstrate that our deep learning super-resolution ultrasonic beamforming approach not only enables visualization of fine structural features of subwavelength defects, but also outperforms the existing widely-accepted super-resolution algorithm (time-reversal MUSIC). We also study key factors of the performance of our approach and discuss its applicability and limitations.

[1]  Hajin Choi,et al.  NDE application of ultrasonic tomography to a full-scale concrete structure , 2015, IEEE Transactions on Ultrasonics, Ferroelectrics, and Frequency Control.

[2]  Lingyu Yu,et al.  Pulsed laser-scanning laser Doppler vibrometer (PL-SLDV) phased arrays for damage detection in aluminum plates , 2019, Mechanical Systems and Signal Processing.

[3]  Nobuyuki Toyama,et al.  Computerized Ultrasonic Imaging Inspection: From Shallow to Deep Learning , 2018, Sensors.

[4]  Cordelia Schmid,et al.  Combining efficient object localization and image classification , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[5]  Massimo Ruzzene,et al.  Frequency-wavenumber domain methods for analysis of incident and scattered guided wave fields , 2009, Smart Structures and Materials + Nondestructive Evaluation and Health Monitoring.

[6]  Yonina C. Eldar,et al.  Super-Resolution Ultrasound Localization Microscopy Through Deep Learning , 2018, IEEE Transactions on Medical Imaging.

[7]  Mengchun Pan,et al.  A comparison between ultrasonic array beamforming and super resolution imaging algorithms for non-destructive evaluation. , 2014, Ultrasonics.

[8]  Jung-Ryul Lee,et al.  Structural imaging through local wavenumber estimation of guided waves , 2013 .

[9]  Michael Unser,et al.  Deep Convolutional Neural Network for Inverse Problems in Imaging , 2016, IEEE Transactions on Image Processing.

[10]  Juan Carlos Fernández,et al.  Multiobjective evolutionary algorithms to identify highly autocorrelated areas: the case of spatial distribution in financially compromised farms , 2014, Ann. Oper. Res..

[11]  Joel B. Harley,et al.  Transfer learning of ultrasonic guided waves using autoencoders: A preliminary study , 2019 .

[12]  Zhaowei Liu,et al.  Superlenses to overcome the diffraction limit. , 2008, Nature materials.

[13]  Bogdan Piwakowski,et al.  Noncontact Ultrasonic Nondestructive Techniques: State of the Art and Their Use in Civil Engineering , 2017 .

[14]  Paul D. Wilcox,et al.  Ultrasonic arrays for non-destructive evaluation: A review , 2006 .

[15]  Luca De Marchi,et al.  Deep learning for enhancing wavefield image quality in fast non-contact inspections , 2019, Structural Health Monitoring.

[16]  Krishnan Balasubramaniam,et al.  Holey-structured metamaterial lens for subwavelength resolution in ultrasonic characterization of metallic components , 2016 .

[17]  Francesco Simonetti,et al.  Localization of pointlike scatterers in solids with subwavelength resolution , 2006 .

[18]  Stephan Antholzer,et al.  Deep learning for photoacoustic tomography from sparse data , 2017, Inverse problems in science and engineering.

[19]  Paul D. Wilcox,et al.  ULTRASONIC ARRAYS: A COMPARISON BETWEEN MEDICAL AND NDE REQUIREMENTS , 2008 .

[20]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[21]  A Velichko,et al.  Ultrasonic defect characterization using parametric-manifold mapping , 2017, Proceedings of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[22]  Salvatore Salamone,et al.  A generalizable deep learning framework for localizing and characterizing acoustic emission sources in riveted metallic panels , 2019, Mechanical Systems and Signal Processing.

[23]  Dylan Lu,et al.  Hyperlenses and metalenses for far-field super-resolution imaging , 2012, Nature Communications.

[24]  Xiaobo Yin,et al.  Experimental demonstration of an acoustic magnifying hyperlens. , 2009, Nature materials.

[25]  Fuh-Gwo Yuan,et al.  Lamb wave-based subwavelength damage imaging using the DORT-MUSIC technique in metallic plates , 2016 .

[26]  V. Giurgiutiu,et al.  In situ 2-D piezoelectric wafer active sensors arrays for guided wave damage detection. , 2008, Ultrasonics.

[27]  Lin Ye,et al.  Guided Lamb waves for identification of damage in composite structures: A review , 2006 .

[28]  Wieslaw Ostachowicz,et al.  Damage localisation in plate-like structures based on PZT sensors , 2009 .

[29]  P. Sava,et al.  Guided wave tomography based on least-squares reverse-time migration , 2020, Structural Health Monitoring.

[30]  Jean-Gabriel Minonzio,et al.  INFLUENCE OF NOISE ON SUBWAVELENGTH IMAGING OF TWO CLOSE SCATTERERS USING TIME REVERSAL METHOD: THEORY AND EXPERIMENTS , 2009 .

[31]  Geoffrey E. Hinton,et al.  Visualizing Data using t-SNE , 2008 .

[32]  Lianjie Huang,et al.  Ultrasound time-reversal MUSIC imaging with diffraction and attenuation compensation , 2012, IEEE Transactions on Ultrasonics, Ferroelectrics and Frequency Control.

[33]  Wentao Wang,et al.  Experimental and numerical validation of guided wave phased arrays integrated within standard data acquisition systems for structural health monitoring , 2018 .

[34]  F. Simonetti,et al.  High-resolution guided wave tomography , 2013 .

[35]  P. Wilcox,et al.  Post-processing of the full matrix of ultrasonic transmit-receive array data for non-destructive evaluation , 2005 .

[36]  Massimo Ruzzene Frequency–wavenumber domain filtering for improved damage visualization , 2007 .

[37]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[38]  David A. McAllester,et al.  Object Detection with Discriminatively Trained Part Based Models , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[39]  Hoon Sohn,et al.  Complete noncontact laser ultrasonic imaging for automated crack visualization in a plate , 2013 .

[40]  Peter Cawley,et al.  Guided wave diffraction tomography within the born approximation , 2010, IEEE Transactions on Ultrasonics, Ferroelectrics and Frequency Control.

[41]  W. Ostachowicz,et al.  Identification of cracks in thin-walled structures by means of wavenumber filtering , 2015 .

[42]  Xiaobo Yin,et al.  A holey-structured metamaterial for acoustic deep-subwavelength imaging , 2011 .

[43]  Loic A. Royer,et al.  Content-aware image restoration: pushing the limits of fluorescence microscopy , 2018, Nature Methods.

[44]  A. Devaney,et al.  Time-reversal imaging with multiple signal classification considering multiple scattering between the targets , 2004 .

[45]  J. Goodman Introduction to Fourier optics , 1969 .