Prohibited Object Detection in X-ray Images with Dynamic Deformable Convolution and Adaptive IoU

Due to the variety and complexity of objects in X-ray images, how to detect the prohibited items automatically and accurately is a challenging problem. In this paper, an X-ray image prohibited object detection method based on Dynamic Deformable Convolution (DyDC) and adaptive Intersection over Union (IoU) is proposed based on Cascade R-CNN framework. The main contributions are as follows. First, DyDC is proposed to cope with the diversity of the prohibited objects in X-ray images and to improve the feature representation capability. Then, adaptive IoU mechanism is proposed, which can dynamically adjust the IoU threshold during the training process to generate high quality proposals. The proposed method is extensively evaluated on two publicly available benchmark datasets, namely SIXray and OPIXray, and the experimental results show that it can achieve the state-of-the-art detection accuracy, compared with other existing methods.

[1]  J. Zhang,et al.  Anomaly object detection in x-ray images with Gabor convolution and bigger discriminative RoI pooling , 2022, Other Conferences.

[2]  Toby P. Breckon,et al.  On the Impact of Using X-Ray Energy Response Imagery for Object Detection Via Convolutional Neural Networks , 2021, 2021 IEEE International Conference on Image Processing (ICIP).

[3]  Domingo Mery,et al.  Automated Threat Objects Detection with Synthetic Data for Real-Time X-ray Baggage Inspection , 2021, 2021 International Joint Conference on Neural Networks (IJCNN).

[4]  Yizhou Yu,et al.  A Structure-Aware Relation Network for Thoracic Diseases Detection and Segmentation , 2021, IEEE Transactions on Medical Imaging.

[5]  Yi Jiang,et al.  Sparse R-CNN: End-to-End Object Detection with Learnable Proposals , 2020, 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[6]  Domingo Mery,et al.  Detection of threat objects in baggage inspection with X-ray images using deep learning , 2020, Neural Computing and Applications.

[7]  Taimur Hassan,et al.  Detecting Prohibited Items in X-Ray Images: a Contour Proposal Learning Approach , 2020, 2020 IEEE International Conference on Image Processing (ICIP).

[8]  A. Yuille,et al.  DetectoRS: Detecting Objects with Recursive Feature Pyramid and Switchable Atrous Convolution , 2020, 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[9]  Mohamed Chouai,et al.  CH-Net: Deep adversarial autoencoders for semantic segmentation in X-ray images of cabin baggage screening at airports , 2020 .

[10]  Xianglong Liu,et al.  Occluded Prohibited Items Detection: An X-ray Security Inspection Benchmark and De-occlusion Attention Module , 2020, ACM Multimedia.

[11]  Xilin Chen,et al.  Dynamic R-CNN: Towards High Quality Object Detection via Dynamic Training , 2020, ECCV.

[12]  Jinyi Liu,et al.  Deep Convolutional Neural Network Based Object Detector for X-Ray Baggage Security Imagery , 2019, 2019 IEEE 31st International Conference on Tools with Artificial Intelligence (ICTAI).

[13]  Xiaoping Liu,et al.  Dangerous goods detection based on transfer learning in X-ray images , 2019, Neural Computing and Applications.

[14]  Y. Fu,et al.  Rethinking Classification and Localization for Object Detection , 2019, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[15]  Fang Wan,et al.  SIXray: A Large-Scale Security Inspection X-Ray Benchmark for Prohibited Item Discovery in Overlapping Images , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[16]  Junjie Yan,et al.  Grid R-CNN , 2018, 1811.12030.

[17]  Stephen Lin,et al.  Deformable ConvNets V2: More Deformable, Better Results , 2018, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[18]  Nuno Vasconcelos,et al.  Cascade R-CNN: Delving Into High Quality Object Detection , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[19]  Zi Yang,et al.  Vehicle detection in intelligent transportation systems and its applications under varying environments: A review , 2017, Image Vis. Comput..

[20]  Toby P. Breckon,et al.  An evaluation of region based object detection strategies within X-ray baggage security imagery , 2017, 2017 IEEE International Conference on Image Processing (ICIP).

[21]  Yi Li,et al.  Deformable Convolutional Networks , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[22]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[23]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[24]  Wei Liu,et al.  SSD: Single Shot MultiBox Detector , 2015, ECCV.

[25]  Ali Farhadi,et al.  You Only Look Once: Unified, Real-Time Object Detection , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[26]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[27]  J. Zhang,et al.  EAOD-Net: Effective anomaly object detection networks for X-ray images , 2022, IET Image Processing.