Multi-Class 3D Object Detection Within Volumetric 3D Computed Tomography Baggage Security Screening Imagery

Automatic detection of prohibited objects within passenger baggage is important for aviation security. X-ray Computed Tomography (CT) based 3D imaging is widely used in airports for aviation security screening whilst prior work on automatic prohibited item detection focus primarily on 2D X-ray imagery. These works have proven the possibility of extending deep convolutional neural networks (CNN) based automatic prohibited item detection from 2D X-ray imagery to volumetric 3D CT baggage security screening imagery. However, previous work on 3D object detection in baggage security screening imagery focused on the detection of one specific type of objects (e.g., either {\it bottles} or {\it handguns}). As a result, multiple models are needed if more than one type of prohibited item is required to be detected in practice. In this paper, we consider the detection of multiple object categories of interest using one unified framework. To this end, we formulate a more challenging multi-class 3D object detection problem within 3D CT imagery and propose a viable solution (3D RetinaNet) to tackle this problem. To enhance the performance of detection we investigate a variety of strategies including data augmentation and varying backbone networks. Experimentation carried out to provide both quantitative and qualitative evaluations of the proposed approach to multi-class 3D object detection within 3D CT baggage security screening imagery. Experimental results demonstrate the combination of the 3D RetinaNet and a series of favorable strategies can achieve a mean Average Precision (mAP) of 65.3\% over five object classes (i.e. {\it bottles, handguns, binoculars, glock frames, iPods}). The overall performance is affected by the poor performance on {\it glock frames} and {\it iPods} due to the lack of data and their resemblance with the baggage clutter.

[1]  Toby P. Breckon,et al.  Evaluating the Transferability and Adversarial Discrimination of Convolutional Neural Networks for Threat Object Detection and Classification within X-Ray Security Imagery , 2019, 2019 18th IEEE International Conference On Machine Learning And Applications (ICMLA).

[2]  Charles A. Bouman,et al.  Joint metal artifact reduction and segmentation of CT images using dictionary-based image prior and continuous-relaxed potts model , 2015, 2015 IEEE International Conference on Image Processing (ICIP).

[3]  Toby P. Breckon,et al.  On the Use of Deep Learning for the Detection of Firearms in X-ray Baggage Security Imagery , 2019, 2019 IEEE International Symposium on Technologies for Homeland Security (HST).

[4]  Sebastian Scherer,et al.  VoxNet: A 3D Convolutional Neural Network for real-time object recognition , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[5]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[6]  Klaus H. Maier-Hein,et al.  Retina U-Net: Embarrassingly Simple Exploitation of Segmentation Supervision for Medical Object Detection , 2018, ML4H@NeurIPS.

[7]  Toby P. Breckon,et al.  On the Evaluation of Prohibited Item Classification and Detection in Volumetric 3D Computed Tomography Baggage Security Screening Imagery , 2020, 2020 International Joint Conference on Neural Networks (IJCNN).

[8]  Toby P. Breckon,et al.  On the Impact of Object and Sub-Component Level Segmentation Strategies for Supervised Anomaly Detection within X-Ray Security Imagery , 2019, 2019 18th IEEE International Conference On Machine Learning And Applications (ICMLA).

[9]  Najla Megherbi Bouallagu,et al.  A classifier based approach for the detection of potential threats in CT based Baggage Screening , 2010, 2010 IEEE International Conference on Image Processing.

[10]  Kaiming He,et al.  Mask R-CNN , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[11]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Toby P. Breckon,et al.  Object classification in 3D baggage security computed tomography imagery using visual codebooks , 2015, Pattern Recognit..

[13]  Xiaohui Xie,et al.  DeepLung: Deep 3D Dual Path Nets for Automated Pulmonary Nodule Detection and Classification , 2018, 2018 IEEE Winter Conference on Applications of Computer Vision (WACV).

[14]  Leonidas J. Guibas,et al.  Frustum PointNets for 3D Object Detection from RGB-D Data , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[15]  Toby P. Breckon,et al.  Using Deep Convolutional Neural Network Architectures for Object Classification and Detection Within X-Ray Baggage Security Imagery , 2018, IEEE Transactions on Information Forensics and Security.

[16]  Kaiming He,et al.  Focal Loss for Dense Object Detection , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[17]  Kai Zhang,et al.  Deep learning for image-based cancer detection and diagnosis - A survey , 2018, Pattern Recognit..

[18]  Najla Megherbi Bouallagu,et al.  A 3D extension to cortex like mechanisms for 3D object class recognition , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[19]  Leonidas J. Guibas,et al.  PointNet: Deep Learning on Point Sets for 3D Classification and Segmentation , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[20]  Najla Megherbi Bouallagu,et al.  A comparison of 3D interest point descriptors with application to airport baggage object detection in complex CT imagery , 2013, Pattern Recognit..

[21]  Natalia Gimelshein,et al.  PyTorch: An Imperative Style, High-Performance Deep Learning Library , 2019, NeurIPS.

[22]  Qian Wang,et al.  A Reference Architecture for Plausible Threat Image Projection (TIP) Within 3D X-ray Computed Tomography Volumes , 2020, Journal of X-ray science and technology.

[23]  Leonidas J. Guibas,et al.  Volumetric and Multi-view CNNs for Object Classification on 3D Data , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[24]  Najla Megherbi Bouallagu,et al.  3D object classification in baggage computed tomography imagery using randomised clustering forests , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[25]  Toby P. Breckon,et al.  Evaluation of a Dual Convolutional Neural Network Architecture for Object-wise Anomaly Detection in Cluttered X-ray Security Imagery , 2019, 2019 International Joint Conference on Neural Networks (IJCNN).

[26]  Yin Zhou,et al.  VoxelNet: End-to-End Learning for Point Cloud Based 3D Object Detection , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[27]  Shouliang Qi,et al.  Detection and Classification of Pulmonary Nodules Using Convolutional Neural Networks: A Survey , 2019, IEEE Access.

[28]  Yongdong Zhang,et al.  Automated pulmonary nodule detection in CT images using deep convolutional neural networks , 2019, Pattern Recognit..

[29]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[30]  Philippe Lacherez,et al.  When and Why Threats Go Undetected , 2016, Hum. Factors.

[31]  Toby P. Breckon,et al.  Materials-based 3D segmentation of unknown objects from dual-energy computed tomography imagery in baggage security screening , 2015, Pattern Recognit..

[32]  Andre Mouton,et al.  A review of automated image understanding within 3D baggage computed tomography security screening. , 2015, Journal of X-ray science and technology.

[33]  Toby P. Breckon,et al.  An Approach for Adaptive Automatic Threat Recognition Within 3D Computed Tomography Images for Baggage Security Screening , 2019, Journal of X-ray science and technology.

[34]  Toby P. Breckon,et al.  The Good, the Bad and the Ugly: Evaluating Convolutional Neural Networks for Prohibited Item Detection Using Real and Synthetically Composited X-ray Imagery , 2019, ArXiv.

[35]  Toby P. Breckon,et al.  Using Deep Neural Networks to Address the Evolving Challenges of Concealed Threat Detection within Complex Electronic Items , 2019, 2019 IEEE International Symposium on Technologies for Homeland Security (HST).

[36]  Kai Ma,et al.  Med3D: Transfer Learning for 3D Medical Image Analysis , 2019, ArXiv.