SiWa: see into walls via deep UWB radar

Being able to see into walls is crucial for diagnostics of building health; it enables inspections of wall structure without undermining the structural integrity. However, existing sensing devices do not seem to offer a full capability in mapping the in-wall structure while identifying their status (e.g., seepage and corrosion). In this paper, we design and implement SiWa as a low-cost and portable system for wall inspections. Built upon a customized IR-UWB radar, SiWa scans a wall as a user swipes its probe along the wall surface; it then analyzes the reflected signals to synthesize an image and also to identify the material status. Although conventional schemes exist to handle these problems individually, they require troublesome calibrations that largely prevent them from practical adoptions. To this end, we equip SiWa with a deep learning pipeline to parse the rich sensory data. With innovative construction and training, the deep learning modules perform structural imaging and the subsequent analysis on material status, without the need for repetitive parameter tuning and calibrations. We build SiWa as a prototype and evaluate its performance via extensive experiments and field studies; results evidently confirm that SiWa accurately maps in-wall structures, identifies their materials, and detects possible defects, suggesting a promising solution for diagnosing building health with minimal effort and cost.

[1]  L. J. Cox Ellipsometry and Polarized Light , 1978 .

[2]  Cao Vu Dung,et al.  Autonomous concrete crack detection using deep fully convolutional neural network , 2019, Automation in Construction.

[3]  Jun Luo,et al.  MoVi-Fi: motion-robust vital signs waveform recovery via deep interpreted RF sensing , 2021, MobiCom.

[4]  Francesco Orabona,et al.  Simultaneous Model Selection and Optimization through Parameter-free Stochastic Learning , 2014, NIPS.

[5]  Susana Lagüela-Lopez,et al.  Assessing Rebar Corrosion through the Combination of Nondestructive GPR and IRT Methodologies , 2019, Remote. Sens..

[6]  Richard Baraniuk,et al.  Material parameter estimation with terahertz time-domain spectroscopy. , 2001, Journal of the Optical Society of America. A, Optics, image science, and vision.

[7]  Xu Zhang,et al.  V2iFi , 2020, Proc. ACM Interact. Mob. Wearable Ubiquitous Technol..

[8]  Yoshua Bengio,et al.  Object Recognition with Gradient-Based Learning , 1999, Shape, Contour and Grouping in Computer Vision.

[9]  M. A. Safan,et al.  Evaluation of polyurethane resin injection for concrete leak repair , 2019 .

[10]  W. Kenneth Jenkins,et al.  Convolution backprojection image reconstruction for spotlight mode synthetic aperture radar , 1992, IEEE Trans. Image Process..

[11]  Swarun Kumar,et al.  On the Feasibility of Wi-Fi Based Material Sensing , 2019, MobiCom.

[12]  B. Liang,et al.  Acoustic broadband metacouplers , 2017 .

[13]  Suraj Jog,et al.  Through Fog High-Resolution Imaging Using Millimeter Wave Radar , 2020, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[14]  Sina Montazeri,et al.  Deep Learning Meets SAR: Concepts, models, pitfalls, and perspectives , 2021, IEEE Geoscience and Remote Sensing Magazine.

[15]  S. Levine,et al.  Gradient Surgery for Multi-Task Learning , 2020, NeurIPS.

[16]  Feng Li,et al.  iLocScan: harnessing multipath for simultaneous indoor source localization and space scanning , 2014, SenSys.

[17]  Ned M. Cleland Structural integrity and progressive collapse in large-panel precast concrete structural systems , 2008 .

[18]  Aydogan Ozcan,et al.  Three-dimensional virtual refocusing of fluorescence microscopy images using deep learning , 2019, Nature Methods.

[19]  J. Ou,et al.  Smart and Multifunctional Concrete Toward Sustainable Infrastructures , 2017 .

[20]  Lei Yang,et al.  See Through Walls with COTS RFID System! , 2015, MobiCom.

[21]  J. Hasted,et al.  Microwave absorption by water in building materials , 1964 .

[22]  Andrew Markham,et al.  See through smoke: robust indoor mapping with low-cost mmWave radar , 2020, MobiSys.

[23]  C. Roychoudhuri Engineering optics , 1986, Proceedings of the IEEE.

[24]  Federico Viani,et al.  Remote Inspection of the Structural Integrity of Engineering Structures and Materials With Passive MST Probes , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[25]  Gustavo Duffo,et al.  Development of an embeddable sensor to monitor the corrosion process of new and existing reinforced concrete structures , 2009 .

[26]  A. Ogunsola,et al.  Shielding effectiveness of concrete buildings , 2005, IEEE 6th International Symposium on Electromagnetic Compatibility and Electromagnetic Ecology, 2005..

[27]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[28]  Claire Prada,et al.  Plane Wave Imaging for ultrasonic non-destructive testing: Generalization to multimodal imaging. , 2016, Ultrasonics.

[29]  L. Holmes,et al.  ENCYCLOPEDIA OF SPECTROSCOPY AND SPECTROMETRY , 2001 .

[30]  Jun Luo,et al.  RF-net: a unified meta-learning framework for RF-enabled one-shot human activity recognition , 2020, SenSys.

[31]  M. Itagaki,et al.  Non-Contact Measurement to Detect Steel Rebar Corrosion in Reinforced Concrete by Electrochemical Impedance Spectroscopy , 2019, Journal of The Electrochemical Society.

[32]  Nicholas D. Lane,et al.  Sparsification and Separation of Deep Learning Layers for Constrained Resource Inference on Wearables , 2016, SenSys.

[33]  Jun Luo,et al.  Octopus: a practical and versatile wideband MIMO sensing platform , 2021, MobiCom.

[34]  Daniel George,et al.  Deep Learning for Real-time Gravitational Wave Detection and Parameter Estimation with Advanced LIGO Data , 2017, ArXiv.

[35]  P. Berens Introduction to Synthetic Aperture Radar (SAR) , 2006 .

[36]  Seung-Jun Kwon,et al.  A novel in-situ corrosion monitoring electrode for reinforced concrete structures , 2018 .

[37]  Gangbing Song,et al.  Smart aggregates: multi-functional sensors for concrete structures—a tutorial and a review , 2008 .

[38]  Shuya Ding,et al.  Enhancing RF Sensing with Deep Learning: A Layered Approach , 2021, IEEE Communications Magazine.

[39]  Yasamin Mostofi,et al.  3D Through-Wall Imaging with Unmanned Aerial Vehicles Using WiFi , 2017, 2017 16th ACM/IEEE International Conference on Information Processing in Sensor Networks (IPSN).

[40]  Siddharth Krishna Kumar,et al.  On weight initialization in deep neural networks , 2017, ArXiv.

[41]  Ashraf F. Ashour,et al.  Self-healing cement concrete composites for resilient infrastructures: A review , 2020 .

[42]  P. Mendis,et al.  Non-Destructive Testing of Concrete: A Review of Methods , 2015, Electronic Journal of Structural Engineering.

[43]  P. Klinkhachorn,et al.  Detection of subsurface defects in fiber reinforced polymer composite bridge decks using digital infrared thermography , 2007 .

[44]  Hui Liu,et al.  On-Demand Deep Model Compression for Mobile Devices: A Usage-Driven Model Selection Framework , 2018, MobiSys.

[45]  Airborne Radar , 2021, Springer Handbook of Atmospheric Measurements.

[46]  Victor S. Lempitsky,et al.  Unsupervised Domain Adaptation by Backpropagation , 2014, ICML.

[47]  Wei Gong,et al.  Machine learning guided rapid focusing with sensor-less aberration corrections. , 2018, Optics express.

[48]  V. V. Panasyuk,et al.  Injection Technologies for the Repair of Damaged Concrete Structures , 2013 .

[49]  Lili Qiu,et al.  AIM: Acoustic Imaging on a Mobile , 2018, MobiSys.

[50]  D. Munson,et al.  A tomographic formulation of spotlight-mode synthetic aperture radar , 1983, Proceedings of the IEEE.

[51]  Nam Bui,et al.  Noninvasive glucose monitoring using polarized light , 2020, SenSys.

[52]  A. Clark,et al.  Seeing Beneath the Soil: Prospecting Methods in Archaeology , 1992 .

[53]  Tarek F. Abdelzaher,et al.  DeepIoT: Compressing Deep Neural Network Structures for Sensing Systems with a Compressor-Critic Framework , 2017, SenSys.

[54]  F. Rocca,et al.  SAR data focusing using seismic migration techniques , 1991 .

[55]  L. Varshney Radar Principles , 2005 .

[56]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[57]  Alan C. Bovik,et al.  No-Reference Image Quality Assessment in the Spatial Domain , 2012, IEEE Transactions on Image Processing.

[58]  Navid Ghassemi,et al.  Material Recognition for Automated Progress Monitoring using Deep Learning Methods , 2020, ArXiv.

[59]  Ben Y. Zhao,et al.  Reusing 60GHz Radios for Mobile Radar Imaging , 2015, MobiCom.

[60]  R. Sutton Aesthetics for Green Roofs and Green Walls , 2014 .

[61]  Enes Yigit,et al.  A Review on Migration Methods in B-Scan Ground Penetrating Radar Imaging , 2014 .

[62]  B. Hobbs,et al.  Non-destructive testing techniques for the forensic engineering investigation of reinforced concrete buildings. , 2007, Forensic science international.

[63]  Léon Bottou,et al.  Stochastic Gradient Descent Tricks , 2012, Neural Networks: Tricks of the Trade.

[64]  Chenglin Miao,et al.  Towards 3D human pose construction using wifi , 2020, MobiCom.

[65]  Sankar K. Pal,et al.  Multilayer perceptron, fuzzy sets, and classification , 1992, IEEE Trans. Neural Networks.

[66]  Fadel Adib,et al.  See through walls with WiFi! , 2013, SIGCOMM.

[67]  Longfei Shangguan,et al.  Leveraging Electromagnetic Polarization in a Two-Antenna Whiteboard in the Air , 2016, CoNEXT.

[68]  A. Zoubir,et al.  Through-the-Wall Radar Imaging , 2010 .

[69]  Antonio Nanni,et al.  Analysis of unreinforced masonry concrete walls strengthened with glass fiber-reinforced polymer bars , 2005 .

[70]  Christophe Vignat,et al.  In situ measurements of the complex permittivity of materials using reflection ellipsometry in the microwave band: experiments (Part II) , 2005, IEEE Transactions on Instrumentation and Measurement.

[71]  Graeme Keith Hopkins,et al.  Living Architecture: Green Roofs and Walls , 2011 .

[72]  Jianren Zhang,et al.  Destructive Testing of a Decommissioned Reinforced Concrete Bridge , 2013 .

[73]  David A. Forsyth,et al.  Shape, Contour and Grouping in Computer Vision , 1999, Lecture Notes in Computer Science.

[74]  S. Shihab,et al.  Radius Estimation for Cylindrical Objects Detected by Ground Penetrating Radar , 2005 .

[75]  H. Pickering Important Early Developments and Current Understanding of the IR Mechanism of Localized Corrosion , 2003 .

[76]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[77]  J T Halsey,et al.  DESTRUCTIVE TESTING OF TWO FORTY-YEAR-OLD PRESTRESSED CONCRETE BRIDGE BEAMS , 1996 .

[78]  Atri Rudra,et al.  Learning Fast Algorithms for Linear Transforms Using Butterfly Factorizations , 2019, ICML.