Using Deep Neural Networks to Address the Evolving Challenges of Concealed Threat Detection within Complex Electronic Items

X-ray baggage security screening is widely used to maintain aviation and transport safety and security. To address the future challenges of increasing volumes and complexities, the recent focus on the use of automated screening approaches are of particular interest. This includes the potential for automatic threat detection as a methodology for concealment detection within complex electronics and electrical items screened using low-cost, 2D X-ray imagery (single or multiple view). In this work, we use automatic object segmentation algorithms enabled by deep Convolutional Neural Networks (CNN, e.g. Mask R-CNN) together with the concept of image over-segmentation to the sub-component level and subsequently use CNN classification to determine the presence of anomalies at both an object or sub-component level. We evaluate the performance impact of three strategies: full frame, object segmentation, and object over-segmentation, for threat/anomaly detection within consumer electronics items. The experimental results exhibit that the object over-segmentation produces superior performance for the anomaly detection via classification, with $< 5\%$ false positive and ~99% true positive.

[1]  Rob Fergus,et al.  Visualizing and Understanding Convolutional Networks , 2013, ECCV.

[2]  Pascal Fua,et al.  SLIC Superpixels Compared to State-of-the-Art Superpixel Methods , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Toby P. Breckon,et al.  An evaluation of region based object detection strategies within X-ray baggage security imagery , 2017, 2017 IEEE International Conference on Image Processing (ICIP).

[4]  Toby P. Breckon,et al.  Transfer learning using convolutional neural networks for object classification within X-ray baggage security imagery , 2016, 2016 IEEE International Conference on Image Processing (ICIP).

[5]  Luca Antiga,et al.  Automatic differentiation in PyTorch , 2017 .

[6]  Andre Mouton,et al.  A review of automated image understanding within 3D baggage computed tomography security screening. , 2015, Journal of X-ray science and technology.

[7]  Lewis D. Griffin,et al.  Automated X-ray Image Analysis for Cargo Security: Critical Review and Future Promise , 2016, Journal of X-ray science and technology.

[8]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Toby P. Breckon,et al.  Skip-GANomaly: Skip Connected and Adversarially Trained Encoder-Decoder Anomaly Detection , 2019, 2019 International Joint Conference on Neural Networks (IJCNN).

[10]  Larry S. Davis,et al.  Learning a Discriminative Filter Bank Within a CNN for Fine-Grained Recognition , 2016, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[11]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[12]  Domingo Mery,et al.  Automated X-Ray Object Recognition Using an Efficient Search Algorithm in Multiple Views , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition Workshops.

[13]  Toby P. Breckon,et al.  Using Deep Convolutional Neural Network Architectures for Object Classification and Detection Within X-Ray Baggage Security Imagery , 2018, IEEE Transactions on Information Forensics and Security.

[14]  Matthew Caldwell,et al.  “Unexpected Item in the Bagging Area”: Anomaly Detection in X-Ray Security Images , 2019, IEEE Transactions on Information Forensics and Security.

[15]  T. P. Breckon,et al.  Improving feature-based object recognition for X-ray baggage security screening using primed visualwords , 2013, 2013 IEEE International Conference on Industrial Technology (ICIT).

[16]  Maria Alvarez Zea Marissa Metro Unexpected Item in the Bagging Area An Examination of Joint Recovery and Customer Satisfaction in Retail Self-Service Technologies , 2018 .

[17]  Toby P. Breckon,et al.  GANomaly: Semi-Supervised Anomaly Detection via Adversarial Training , 2018, ACCV.

[18]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[19]  Muhammet Bastan,et al.  Multi-view object detection in dual-energy X-ray images , 2015, Machine Vision and Applications.

[20]  Toby P. Breckon,et al.  Evaluation of a Dual Convolutional Neural Network Architecture for Object-wise Anomaly Detection in Cluttered X-ray Security Imagery , 2019, 2019 International Joint Conference on Neural Networks (IJCNN).

[21]  Michael S. Bernstein,et al.  ImageNet Large Scale Visual Recognition Challenge , 2014, International Journal of Computer Vision.

[22]  Sergey Ioffe,et al.  Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learning , 2016, AAAI.

[23]  Ross B. Girshick,et al.  Mask R-CNN , 2017, 1703.06870.

[24]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[25]  Muhammet Bastan,et al.  Object Recognition in Multi-View Dual Energy X-ray Images , 2013, BMVC.