Detection and localization of hand fractures based on GA_Faster R-CNN

Abstract X-ray imaging is the primary diagnostic tool for clinical diagnosis of suspected fracture. Hand fracture (HF) is a world-leading health problem for children, adolescents and the elderly. A missed diagnosis of hand fracture on radiography may lead to severe consequences for patients, resulting in delayed treatment and poor recovery of function. Nevertheless, many hand fractures are fairly insidious, which often lead to misdiagnosis. In this dissertation, we propose GA_Faster R-CNN in which a guided anchoring method (GA) of GA_RPN is applied to detect and localize hand fractures in radiographs. Our new guided anchoring method makes the anchor generation more accurate and efficient, greatly improves the network performance, and saves computing power. In our work, Feature Pyramid Network (FPN) is used to solve the problem of tiny object detection which mostly appears at the joint of fingertips and knuckles. In addition, Balanced L1 Loss is applied to adapt to the imbalance of learning tasks. We evaluate the proposed algorithm on a HF dataset containing 3,067 X-ray radiographs, 2,453 of which are assigned as the training dataset and 614 as the testing dataset. The present framework achieved accuracies of 97%–99% and an average precision (AP) of 70.7%, thereby outperforming the previous state-of-the-art methods for detecting HF. As a consequence, the GA_Faster R-CNN has great potential for clinical applications.

[1]  S. Chopra,et al.  Assessment of a deep-learning system for fracture detection in musculoskeletal radiographs , 2020, npj Digital Medicine.

[2]  Marcus A. Badgeley,et al.  Deep learning predicts hip fracture using confounding patient and healthcare variables , 2018, npj Digital Medicine.

[3]  Gene Kitamura,et al.  Ankle Fracture Detection Utilizing a Convolutional Neural Network Ensemble Implemented with a Small Sample, De Novo Training, and Multiview Incorporation , 2019, Journal of Digital Imaging.

[4]  Roberto Cipolla,et al.  Multi-task Learning Using Uncertainty to Weigh Losses for Scene Geometry and Semantics , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[5]  Thomas Frauenfelder,et al.  Detection and localization of distal radius fractures: Deep learning system versus radiologists. , 2020, European journal of radiology.

[6]  Deepa Joshi,et al.  A survey of fracture detection techniques in bone X-ray images , 2020, Artificial Intelligence Review.

[7]  Gregor Sommer,et al.  Assessment of a Deep Learning Algorithm for the Detection of Rib Fractures on Whole-Body Trauma Computed Tomography , 2019, Korean journal of radiology.

[8]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Su-Bin Joo,et al.  Automatic multi-class intertrochanteric femur fracture detection from CT images based on AO/OTA classification using faster R-CNN-BO method. , 2020, Journal of applied biomedicine.

[10]  Kai Chen,et al.  Region Proposal by Guided Anchoring , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[11]  Kaiming He,et al.  Feature Pyramid Networks for Object Detection , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[12]  A. Becker,et al.  Vertebral body insufficiency fractures: detection of vertebrae at risk on standard CT images using texture analysis and machine learning , 2018, European Radiology.

[13]  Guoshan Zhang,et al.  Arm fracture detection in X-rays based on improved deep convolutional neural network , 2020, Comput. Electr. Eng..

[14]  Nuno Vasconcelos,et al.  Cascade R-CNN: Delving Into High Quality Object Detection , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[15]  Jin Keun Seo,et al.  Automatic detection and segmentation of lumbar vertebrae from X-ray images for compression fracture evaluation , 2019, Comput. Methods Programs Biomed..

[16]  Nanning Zheng,et al.  A Real-time Robotic Grasp Approach with Oriented Anchor Box , 2018, ArXiv.

[17]  Chien-Hung Liao,et al.  Application of a deep learning algorithm for detection and visualization of hip fractures on plain pelvic radiographs , 2019, European Radiology.

[18]  Guoshan Zhang,et al.  Thigh fracture detection using deep learning method based on new dilated convolutional feature pyramid network , 2019, Pattern Recognit. Lett..

[19]  Larry S. Davis,et al.  An Analysis of Scale Invariance in Object Detection - SNIP , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[20]  Simukayi Mutasa,et al.  Advanced Deep Learning Techniques Applied to Automated Femoral Neck Fracture Detection and Classification , 2020, Journal of Digital Imaging.

[21]  Wei Liu,et al.  SSD: Single Shot MultiBox Detector , 2015, ECCV.

[22]  A. Katsumata,et al.  Evaluation of an artificial intelligence system for detecting vertical root fracture on panoramic radiography , 2019, Oral Radiology.

[23]  Shifeng Zhang,et al.  Single-Shot Refinement Neural Network for Object Detection , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.