Deep CNNs for Object Detection Using Passive Millimeter Sensors

Passive millimeter wave images (PMMWIs) can be used to detect and localize objects concealed under clothing. Unfortunately, the quality of the acquired images and the unknown position, shape, and size of the hidden objects render these tasks challenging. In this paper, we discuss a deep learning approach to this detection/localization problem. The effect of the nonstationary acquisition noise on different architectures is analyzed and discussed. A comparison with shallow architectures is also presented. The achieved detection accuracy defines a new state of the art in object detection on PMMWIs. The low computational training and testing costs of the solution allow its use in real-time applications.

[1]  Jian Sun,et al.  Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[2]  Yann LeCun,et al.  Regularization of Neural Networks using DropConnect , 2013, ICML.

[3]  Thomas Brox,et al.  Striving for Simplicity: The All Convolutional Net , 2014, ICLR.

[4]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[5]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[6]  Xiangguang Chen,et al.  Study on image enhancement algorithm applied to passive millimeter-wave imaging based on wavelet transformation , 2011, 2011 International Conference on Electrical and Control Engineering.

[7]  Naomi E. Alexander,et al.  Multispectral mm-wave imaging: materials and images , 2008, SPIE Defense + Commercial Sensing.

[8]  Roberto Cipolla,et al.  SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Emanuele Trucco,et al.  Image processing techniques for metallic object detection with millimetre-wave images , 2006, Pattern Recognit. Lett..

[10]  Liangchao Li,et al.  A new algorithm for passive millimeter-wave image enhancement , 2010, 2010 2nd International Conference on Signal Processing Systems.

[11]  L. Yujiri,et al.  Passive Millimeter Wave Imaging , 2003, 2006 IEEE MTT-S International Microwave Symposium Digest.

[12]  Seokwon Yeom,et al.  Real-time concealed-object detection and recognition with passive millimeter wave imaging. , 2012, Optics express.

[13]  Andrew R. Harvey,et al.  Image analysis for object detection in millimetre-wave images , 2004, SPIE Security + Defence.

[14]  Xiangguang Chen,et al.  Segmentation of Concealed Objects in Passive Millimeter-Wave Images Based on the Gaussian Mixture Model , 2015 .

[15]  Xavier Binefa,et al.  Concealed object detection and segmentation over millimetric waves images , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Workshops.

[16]  Geoffrey E. Hinton,et al.  Rectified Linear Units Improve Restricted Boltzmann Machines , 2010, ICML.

[17]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[18]  Aggelos K. Katsaggelos,et al.  Compressive passive millimeter-wave imaging , 2011, 2011 18th IEEE International Conference on Image Processing.

[19]  Jintao Xiong,et al.  Research on millimeter-wave image denoising method based on contourlet and compressed sensing , 2010, 2010 2nd International Conference on Signal Processing Systems.

[20]  Rafael Molina,et al.  Detection and localization of objects in Passive Millimeter Wave Images , 2016, 2016 24th European Signal Processing Conference (EUSIPCO).

[21]  Timothy Dozat,et al.  Incorporating Nesterov Momentum into Adam , 2016 .

[22]  Guosheng Lin,et al.  CRF Learning with CNN Features for Image Segmentation , 2015, Pattern Recognit..

[23]  Jung-Young Son,et al.  Shape Feature Analysis of Concealed Objects with Passive Millimeter Wave Imaging , 2015 .

[24]  Sepp Hochreiter,et al.  Fast and Accurate Deep Network Learning by Exponential Linear Units (ELUs) , 2015, ICLR.

[25]  Tadao Nagatsuma,et al.  Latest Trends in Millimeter-wave Imaging Technology , 2008 .

[26]  Zhuowen Tu,et al.  Generalizing Pooling Functions in Convolutional Neural Networks: Mixed, Gated, and Tree , 2015, AISTATS.

[27]  Aggelos K. Katsaggelos,et al.  Fast millimeter wave threat detection algorithm , 2015, 2015 23rd European Signal Processing Conference (EUSIPCO).

[28]  Aggelos K. Katsaggelos,et al.  Compressive sensing super resolution from multiple observations with application to passive millimeter wave images , 2016, Digit. Signal Process..

[29]  Tom Schaul,et al.  No more pesky learning rates , 2012, ICML.

[30]  M. Chaudhry,et al.  Radiation exposure and privacy concerns surrounding full-body scanners in airports , 2014 .

[31]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[32]  Rafael Molina,et al.  Using machine learning to detect and localize concealed objects in passive millimeter-wave images , 2018, Eng. Appl. Artif. Intell..

[33]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[34]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[35]  Trevor Darrell,et al.  Caffe: Convolutional Architecture for Fast Feature Embedding , 2014, ACM Multimedia.

[36]  Aggelos K. Katsaggelos,et al.  Multiframe blind deconvolution of passive millimeter wave images using variational dirichlet blur kernel estimation , 2016, 2016 IEEE International Conference on Image Processing (ICIP).

[37]  Benjamin Graham,et al.  Fractional Max-Pooling , 2014, ArXiv.

[38]  Honglak Lee,et al.  An Analysis of Single-Layer Networks in Unsupervised Feature Learning , 2011, AISTATS.