Automatic Hip Fracture Identification and Functional Subclassification with Deep Learning

Purpose: Hip fractures are a common cause of morbidity and mortality. Automatic identification and classification of hip fractures using deep learning may improve outcomes by reducing diagnostic errors and decreasing time to operation. Methods: Hip and pelvic radiographs from 1118 studies were reviewed and 3034 hips were labeled via bounding boxes and classified as normal, displaced femoral neck fracture, nondisplaced femoral neck fracture, intertrochanteric fracture, previous ORIF, or previous arthroplasty. A deep learning-based object detection model was trained to automate the placement of the bounding boxes. A Densely Connected Convolutional Neural Network (DenseNet) was trained on a subset of the bounding box images, and its performance evaluated on a held out test set and by comparison on a 100-image subset to two groups of human observers: fellowship-trained radiologists and orthopaedists, and senior residents in emergency medicine, radiology, and orthopaedics. Results: The binary accuracy for fracture of our model was 93.8% (95% CI, 91.3-95.8%), with sensitivity of 92.7% (95% CI, 88.7-95.6%), and specificity 95.0% (95% CI, 91.5-97.3%). Multiclass classification accuracy was 90.4% (95% CI, 87.4-92.9%). When compared to human observers, our model achieved at least expert-level classification under all conditions. Additionally, when the model was used as an aid, human performance improved, with aided resident performance approximating unaided fellowship-trained expert performance. Conclusions: Our deep learning model identified and classified hip fractures with at least expert-level accuracy, and when used as an aid improved human performance, with aided resident performance approximating that of unaided fellowship-trained attendings.

[1]  Gustavo Carneiro,et al.  Detecting hip fractures with radiologist-level performance using deep neural networks , 2017, ArXiv.

[2]  M. Fu,et al.  Surgery for a fracture of the hip within 24 hours of admission is independently associated with reduced short‐term post‐operative complications , 2017, The bone & joint journal.

[3]  J. Callaghan,et al.  Hip Fractures: Appropriate Timing to Operative Intervention. , 2017, The Journal of arthroplasty.

[4]  C. Moran,et al.  Effect of comorbidities and postoperative complications on mortality after hip fracture in elderly people: prospective observational cohort study , 2005, BMJ : British Medical Journal.

[5]  Marcelo Coca-Perraillon,et al.  Incidence and mortality of hip fractures in the United States. , 2009, JAMA.

[6]  Kaiming He,et al.  Feature Pyramid Networks for Object Detection , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[7]  Graham W. Taylor,et al.  Improved Regularization of Convolutional Neural Networks with Cutout , 2017, ArXiv.

[8]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[9]  S. Majumdar,et al.  Use of 2D U-Net Convolutional Neural Networks for Automated Cartilage and Meniscus Segmentation of Knee MR Imaging Data to Determine Relaxometry and Morphometry. , 2018, Radiology.

[10]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[11]  Wei Zhang,et al.  Binomial Classification of Pediatric Elbow Fractures Using a Deep Learning Multiview Approach Emulating Radiologist Decision Making. , 2019, Radiology. Artificial intelligence.

[12]  J. Zuckerman,et al.  Surgical Management of Hip Fractures: An Evidence‐based Review of the Literature. I: Femoral Neck Fractures , 2008, The Journal of the American Academy of Orthopaedic Surgeons.

[13]  A. Kurz,et al.  Early Surgery Confers 1-Year Mortality Benefit in Hip-Fracture Patients , 2017, Journal of orthopaedic trauma.

[14]  Ross B. Girshick,et al.  Focal Loss for Dense Object Detection , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Li Fei-Fei,et al.  ImageNet: A large-scale hierarchical image database , 2009, CVPR.

[16]  J. Stevens,et al.  The impact of decreasing U.S. hip fracture rates on future hip fracture estimates , 2013, Osteoporosis International.

[17]  Patrick T. Liu,et al.  Prevalence of traumatic hip and pelvic fractures in patients with suspected hip fracture and negative initial standard radiographs--a study of emergency department patients. , 2005, Academic emergency medicine : official journal of the Society for Academic Emergency Medicine.

[18]  J. Zuckerman,et al.  Surgical Management of Hip Fractures: An Evidence‐based Review of the Literature. II: Intertrochanteric Fractures , 2008, The Journal of the American Academy of Orthopaedic Surgeons.

[19]  A. Ng,et al.  Deep-learning-assisted diagnosis for knee magnetic resonance imaging: Development and retrospective validation of MRNet , 2018, PLoS medicine.

[20]  Naoto Endo,et al.  Detecting intertrochanteric hip fractures with orthopedist-level accuracy using a deep convolutional neural network , 2018, Skeletal Radiology.

[21]  Jia Deng,et al.  A large-scale hierarchical image database , 2009, CVPR 2009.

[22]  F. Liu,et al.  Deep Learning Approach for Evaluating Knee MR Images: Achieving High Diagnostic Performance for Cartilage Lesion Detection. , 2018, Radiology.

[23]  Anurag Gupta,et al.  Deep neural network improves fracture detection by clinicians , 2018, Proceedings of the National Academy of Sciences.

[24]  Richard Kijowski,et al.  Deep convolutional neural network for segmentation of knee joint anatomy , 2018, Magnetic resonance in medicine.

[25]  Xiaoliang Wang,et al.  Focal loss dense detector for vehicle surveillance , 2018, 2018 International Conference on Intelligent Systems and Computer Vision (ISCV).

[26]  Simo Saarakkala,et al.  Automatic Knee Osteoarthritis Diagnosis from Plain Radiographs: A Deep Learning-Based Approach , 2017, Scientific Reports.

[27]  S. Silvestri,et al.  Selected Topics: Emergency Radiology , 2009 .