Hidden Object Detection and Recognition in Passive Terahertz and Mid-wavelength Infrared

The study presents the comparison of detection and recognition of concealed objects covered with various types of clothing by using passive imagers operating in a terahertz (THz) range at 1.2 mm (250 GHz) and a mid-wavelength infrared (MWIR) at 3–6 μm (50–100 THz). During this study, large dataset of images presenting various items covered with various types of clothing has been collected. The detection and classification algorithms aimed to operate robustly at high processing speed across these two spectrums. Properties of both spectrums, theoretical limitations, performance of imagers and physical properties of fabrics in both spectral domains are described. The paper presents a comparison of two deep learning–based processing methods. The comparison of the original results of various experiments for the two spectrums is presented.

[1]  Seokwon Yeom,et al.  Real-time concealed-object detection and recognition with passive millimeter wave imaging. , 2012, Optics express.

[2]  Sanya Liu,et al.  Blind image restoration with sparse priori regularization for passive millimeter-wave images , 2016, J. Vis. Commun. Image Represent..

[3]  Norbert Palka,et al.  Non-destructive evaluation of puncture region in polyethylene composite by terahertz and X-ray radiation , 2016 .

[4]  Andrew R. Harvey,et al.  Image analysis for object detection in millimetre-wave images , 2004, SPIE Security + Defence.

[5]  A. Rogalski,et al.  Terahertz detectors and focal plane arrays , 2011 .

[6]  Mehdi Anwar,et al.  Developing terahertz imaging equation and enhancement of the resolution of terahertz images using deconvolution , 2016, SPIE Commercial + Scientific Sensing and Imaging.

[7]  Yvan R. Petillot,et al.  Detection and Tracking of Multiple Metallic Objects in Millimetre-Wave Images , 2007, International Journal of Computer Vision.

[8]  Jung-Young Son,et al.  Shape Feature Analysis of Concealed Objects with Passive Millimeter Wave Imaging , 2015 .

[9]  Matti Pietikäinen,et al.  IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2009, TPAMI-2008-09-0620 1 WLD: A Robust Local Image Descriptor , 2022 .

[10]  Mircea Dragoman,et al.  Terahertz fields and applications , 2004 .

[11]  Matti Pietikäinen,et al.  A comparative study of texture measures with classification based on featured distributions , 1996, Pattern Recognit..

[12]  Yang Yu,et al.  Concealed object segmentation in terahertz imaging via adversarial learning , 2019, Optik.

[13]  Dharmendra Singh,et al.  A novel neural network based image reconstruction model with scale and rotation invariance for target identification and classification for Active millimetre wave imaging , 2014 .

[14]  Chengan Guo,et al.  A Deep Learning Method for Detection of Dangerous Equipment , 2018, 2018 Eighth International Conference on Information Science and Technology (ICIST).

[15]  Dharmendra Singh,et al.  Optimization of image processing techniques to detect and reconstruct the image of concealed blade for MMW imaging system , 2016, 2016 IEEE International Geoscience and Remote Sensing Symposium (IGARSS).

[16]  Kiarash Ahi,et al.  Quality control and authentication of packaged integrated circuits using enhanced-spatial-resolution terahertz time-domain spectroscopy and imaging , 2017 .

[17]  Ali Farhadi,et al.  You Only Look Once: Unified, Real-Time Object Detection , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[18]  Rafael Molina,et al.  Using machine learning to detect and localize concealed objects in passive millimeter-wave images , 2018, Eng. Appl. Artif. Intell..

[19]  Marcin Kowalski,et al.  Comparative Studies of Passive Imaging in Terahertz and Mid-Wavelength Infrared Ranges for Object Detection , 2016, IEEE Transactions on Information Forensics and Security.

[20]  Zoya Popovic,et al.  Detection and Segmentation of Concealed Objects in Terahertz Images , 2008, IEEE Transactions on Image Processing.

[21]  David G. Lowe,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004, International Journal of Computer Vision.

[22]  Ivan Laptev,et al.  Context-Aware CNNs for Person Head Detection , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[23]  M.C. Kemp,et al.  Millimetre wave and terahertz technology for detection of concealed threats - a review , 2006, 2007 Joint 32nd International Conference on Infrared and Millimeter Waves and the 15th International Conference on Terahertz Electronics.

[24]  Marcin Kowalski,et al.  Hidden object detection system based on fusion of THz and VIS images , 2013 .

[25]  Pramod K. Varshney,et al.  On signal/image processing for concealed weapon detection from stand-off range (Invited Paper) , 2005, SPIE Defense + Commercial Sensing.

[26]  Ruth M. Woodward,et al.  Terahertz technology in global homeland security (Invited Paper) , 2005, SPIE Defense + Commercial Sensing.

[27]  A. Lettington,et al.  An objective MRTD for discrete infrared imaging systems , 1993 .

[28]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[29]  N. Vieweg,et al.  Terahertz imaging: applications and perspectives. , 2010, Applied optics.

[30]  E. Brown,et al.  Millimeter-wave, terahertz, and mid-infrared transmissionthrough common clothing , 2004 .

[31]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[32]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[33]  J. E. Jackson.  A User's Guide to Principal Components , 1991 .

[34]  Rafael Molina,et al.  Detection and localization of objects in Passive Millimeter Wave Images , 2016, 2016 24th European Signal Processing Conference (EUSIPCO).

[35]  Hoda Mohammadzade,et al.  Critical object recognition in millimeter-wave images with robustness to rotation and scale. , 2017, Journal of the Optical Society of America. A, Optics, image science, and vision.

[36]  Pierre Comon,et al.  Independent component analysis, A new concept? , 1994, Signal Process..

[37]  D. Mittleman.  Sensing with terahertz radiation , 2003 .

[38]  Hua Yu,et al.  A direct LDA algorithm for high-dimensional data - with application to face recognition , 2001, Pattern Recognit..

[39]  Xiangguang Chen,et al.  Segmentation of Concealed Objects in Passive Millimeter-Wave Images Based on the Gaussian Mixture Model , 2015 .

[40]  Dong Yang,et al.  CNN with spatio-temporal information for fast suspicious object detection and recognition in THz security images , 2019, Signal Process..

[41]  Yeongjae Cheon,et al.  PVANET: Deep but Lightweight Neural Networks for Real-time Object Detection , 2016, ArXiv.

[42]  Mengdao Xing,et al.  Terahertz Image Detection with the Improved Faster Region-Based Convolutional Neural Network , 2018, Sensors.

[43]  Marcin Kowalski,et al.  Passive imaging of concealed objects in terahertz and long-wavelength infrared , 2015 .

[44]  Applications using high-Tc superconducting terahertz emitters , 2016, Scientific reports.

[45]  Nuria Llombart,et al.  THz Imaging Radar for Standoff Personnel Screening , 2011, IEEE Transactions on Terahertz Science and Technology.

[46]  Yi Li,et al.  R-FCN: Object Detection via Region-based Fully Convolutional Networks , 2016, NIPS.

[47]  Wan-xia Huang,et al.  Attenuation of terahertz transmission through rain , 2012 .

[48]  Antoni Rogalski,et al.  History of infrared detectors , 2012 .

[49]  Qiang Ji,et al.  A Comparative Study of Local Matching Approach for Face Recognition , 2007, IEEE Transactions on Image Processing.

[50]  Luc Van Gool,et al.  SURF: Speeded Up Robust Features , 2006, ECCV.

[51]  J. Edward Jackson,et al.  A User's Guide to Principal Components: Jackson/User's Guide to Principal Components , 2004 .

[52]  Javier Ruiz-del-Solar,et al.  Face recognition using thermal infrared images for Human-Robot Interaction applications: A comparative study , 2009, 2009 6th Latin American Robotics Symposium (LARS 2009).

[53]  Xiang Zhang,et al.  Introduction to THz Wave Photonics , 2009 .

[54]  Aggelos K. Katsaggelos,et al.  Multiframe blind deconvolution of passive millimeter wave images using variational dirichlet blur kernel estimation , 2016, 2016 IEEE International Conference on Image Processing (ICIP).

[55]  H.B. Wallace,et al.  Standoff Detection of Weapons and Contraband in the 100 GHz to 1 THz Region , 2007, IEEE Transactions on Antennas and Propagation.

[56]  Matti Pietikäinen,et al.  Performance evaluation of texture measures with classification based on Kullback discrimination of distributions , 1994, Proceedings of 12th International Conference on Pattern Recognition.

[57]  Xavier Binefa,et al.  Concealed object detection and segmentation over millimetric waves images , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Workshops.

[58]  D. Hodges,et al.  Far infrared imagery. , 1976, Applied optics.