Automated detection of smuggled high-risk security threats using Deep Learning

The security infrastructure is ill-equipped to detect and deter the smuggling of non-explosive devices that enable terror attacks such as those recently perpetrated in western Europe. The detection of so-called "small metallic threats" (SMTs) in cargo containers currently relies on statistical risk analysis, intelligence reports, and visual inspection of X-ray images by security officers. The latter is very slow and unreliable due to the difficulty of the task: objects potentially spanning less than 50 pixels have to be detected in images containing more than 2 million pixels against very complex and cluttered backgrounds. In this contribution, we demonstrate for the first time the use of Convolutional Neural Networks (CNNs), a type of Deep Learning, to automate the detection of SMTs in fullsize X-ray images of cargo containers. Novel approaches for dataset augmentation allowed to train CNNs from-scratch despite the scarcity of data available. We report fewer than 6% false alarms when detecting 90% SMTs synthetically concealed in stream-of-commerce images, which corresponds to an improvement of over an order of magnitude over conventional approaches such as Bag-of-Words (BoWs). The proposed scheme offers potentially super-human performance for a fraction of the time it would take for a security officers to carry out visual inspection (processing time is approximately 3.5s per container image).

[1]  Andrew Zisserman,et al.  Scene Classification Via pLSA , 2006, ECCV.

[2]  Toby P. Breckon,et al.  Object classification in 3D baggage security computed tomography imagery using visual codebooks , 2015, Pattern Recognit..

[3]  Gongyin Chen,et al.  Understanding X-ray cargo imaging , 2005 .

[4]  Kristin Archick U.S.-EU Cooperation Against Terrorism , 2013 .

[5]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[6]  Lewis D. Griffin,et al.  Detection of cargo container loads from X-ray images , 2015 .

[7]  Muhammet Bastan,et al.  Visual Words on Baggage X-Ray Images , 2011, CAIP.

[8]  Toby P. Breckon,et al.  Transfer learning using convolutional neural networks for object classification within X-ray baggage security imagery , 2016, 2016 IEEE International Conference on Image Processing (ICIP).

[9]  Jian Sun,et al.  Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[10]  John King,et al.  The security of merchant shipping , 2005 .

[11]  Andrew Zisserman,et al.  Image Classification using Random Forests and Ferns , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[12]  T. P. Breckon,et al.  Improving feature-based object recognition for X-ray baggage security screening using primed visualwords , 2013, 2013 IEEE International Conference on Industrial Technology (ICIT).

[13]  Lewis D. Griffin,et al.  Threat Image Projection (TIP) into X-ray images of cargo containers for training humans and machines , 2016, 2016 IEEE International Carnahan Conference on Security Technology (ICCST).

[14]  Lewis D. Griffin,et al.  Tackling the x-ray cargo inspection challenge using machine learning , 2016, SPIE Defense + Security.

[15]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[16]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[17]  Lewis D. Griffin,et al.  Automated X-ray Image Analysis for Cargo Security: Critical Review and Future Promise , 2016, Journal of X-ray science and technology.

[18]  Andrea Vedaldi,et al.  MatConvNet: Convolutional Neural Networks for MATLAB , 2014, ACM Multimedia.

[19]  Lewis D. Griffin,et al.  Natural Image Character Recognition Using Oriented Basic Image Features , 2011, 2011 International Conference on Digital Image Computing: Techniques and Applications.

[20]  Jose Emmanuel Ramirez-Marquez,et al.  Optimization of container inspection strategy via a genetic algorithm , 2011, Ann. Oper. Res..

[21]  Lewis D. Griffin,et al.  Basic Image Features (BIFs) Arising from Approximate Symmetry Type , 2009, SSVM.

[22]  Christoforos Anagnostopoulos,et al.  A better Beta for the H measure of classification performance , 2012, Pattern Recognit. Lett..

[23]  Jaroslaw W. Tuszynski,et al.  A method for automatic manifest verification of container cargo using radiography images , 2013 .

[24]  Lewis D. Griffin,et al.  Detection of concealed cars in complex cargo X-ray imagery using deep learning , 2016, Journal of X-ray science and technology.

[25]  Jeremy M Wolfe,et al.  Prevalence effects in newly trained airport checkpoint screeners: trained observers miss rare targets, too. , 2013, Journal of vision.

[26]  David J. Hand,et al.  Measuring classifier performance: a coherent alternative to the area under the ROC curve , 2009, Machine Learning.

[27]  Andrew Zisserman,et al.  Synthetic Data and Artificial Neural Networks for Natural Scene Text Recognition , 2014, ArXiv.

[28]  Jian Zhang,et al.  Joint Shape and Texture Based X-Ray Cargo Image Classification , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition Workshops.

[29]  Rob Fergus,et al.  Learning Physical Intuition of Block Towers by Example , 2016, ICML.