Threat Image Projection (TIP) into X-ray images of cargo containers for training humans and machines

We propose a framework for Threat Image Projection (TIP) in cargo transmission X-ray imagery. The method exploits the approximately multiplicative nature of X-ray imagery to extract a library of threat items. These items can then be projected into real cargo. We show using experimental data that there is no significant qualitative or quantitative difference between real threat images and TIP images. We also describe methods for adding realistic variation to TIP images in order to robustify Machine Learning (ML) based algorithms trained on TIP. These variations are derived from cargo X-ray image formation, and include: (i) translations; (ii) magnification; (iii) rotations; (iv) noise; (v) illumination; (vi) volume and density; and (vii) obscuration. These methods are particularly relevant for representation learning, since it allows the system to learn features that are invariant to these variations. The framework also allows efficient addition of new or emerging threats to a detection system, which is important if time is critical. We have applied the framework to training ML-based cargo algorithms for (i) detection of loads (empty verification), (ii) detection of concealed cars (ii) detection of Small Metallic Threats (SMTs). TIP also enables algorithm testing under controlled conditions, allowing one to gain a deeper understanding of performance. Whilst we have focused on robustifying ML-based threat detectors, our TIP method can also be used to train and robustify human threat detectors as is done in cabin baggage screening.

[1]  Shaun Helman,et al.  The impact of image based factors and training on threat detection performance in X-ray screening. , 2008 .

[2]  Francisco J. Valverde-Albacete,et al.  100% Classification Accuracy Considered Harmful: The Normalized Information Transfer Factor Explains the Accuracy Paradox , 2014, PloS one.

[3]  Najla Megherbi Bouallagu,et al.  Fully automatic 3D Threat Image Projection: Application to densely cluttered 3D Computed Tomography baggage images , 2012, 2012 3rd International Conference on Image Processing Theory, Tools and Applications (IPTA).

[4]  A. Schwaninger,et al.  Adaptive Computer-Based Training Increases on the Job Performance of X-Ray Screeners , 2007, 2007 41st Annual IEEE International Carnahan Conference on Security Technology.

[5]  Lewis D. Griffin,et al.  Detection of concealed cars in complex cargo X-ray imagery using deep learning , 2016, Journal of X-ray science and technology.

[6]  Lewis D. Griffin,et al.  Tackling the x-ray cargo inspection challenge using machine learning , 2016, SPIE Defense + Security.

[7]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[8]  Andrew Zisserman,et al.  Return of the Devil in the Details: Delving Deep into Convolutional Nets , 2014, BMVC.

[9]  Lewis D. Griffin,et al.  Detection of cargo container loads from X-ray images , 2015 .

[10]  Nitesh V. Chawla,et al.  SMOTE: Synthetic Minority Over-sampling Technique , 2002, J. Artif. Intell. Res..

[11]  Lewis D. Griffin,et al.  Automated detection of cars in transmission X-ray images of freight containers , 2014, 2014 11th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS).

[12]  Sos S. Agaian,et al.  3D threat image projection , 2008, Electronic Imaging.

[13]  Adrian Schwaninger,et al.  A statistical approach for image difficulty estimation in x-ray screening using image measurements , 2007, APGV.

[14]  Zhi-Hua Zhou,et al.  Ieee Transactions on Knowledge and Data Engineering 1 Training Cost-sensitive Neural Networks with Methods Addressing the Class Imbalance Problem , 2022 .

[15]  Toby P. Breckon,et al.  Radon transform based automatic metal artefacts generation for 3D threat image projection , 2013, Optics/Photonics in Security and Defence.

[16]  Lewis D. Griffin,et al.  Reduction of wobble artefacts in images from mobile transmission X-ray vehicle scanners , 2014, 2014 IEEE International Conference on Imaging Systems and Techniques (IST) Proceedings.

[17]  Lewis D. Griffin,et al.  Using deep learning on X-ray images to detect threats , 2016 .

[18]  Qian Gong,et al.  Rapid GPU-based simulation of x-ray transmission, scatter, and phase measurements for threat detection systems , 2016, SPIE Defense + Security.

[19]  F Hofer,et al.  Using threat image projection data for assessing individual screener performance , 2005 .

[20]  JapkowiczNathalie,et al.  The class imbalance problem: A systematic study , 2002 .

[21]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[22]  Nathalie Japkowicz,et al.  The class imbalance problem: A systematic study , 2002, Intell. Data Anal..

[23]  Robert C. Holte,et al.  C4.5, Class Imbalance, and Cost Sensitivity: Why Under-Sampling beats Over-Sampling , 2003 .

[24]  Jeremy M. Wolfe,et al.  26.5 brief comms NEW , 2005 .