External Validation of Deep Learning Algorithm for Detecting and Visualizing Femoral Neck Fracture Including Displaced and Non-displaced Fracture on Plain X-ray

This study aimed to develop a method for detection of femoral neck fracture (FNF) including displaced and non-displaced fractures using convolutional neural network (CNN) with plain X-ray and to validate its use across hospitals through internal and external validation sets. This is a retrospective study using hip and pelvic anteroposterior films for training and detecting femoral neck fracture through residual neural network (ResNet) 18 with convolutional block attention module (CBAM) +  + . The study was performed at two tertiary hospitals between February and May 2020 and used data from January 2005 to December 2018. Our primary outcome was favorable performance for diagnosis of femoral neck fracture from negative studies in our dataset. We described the outcomes as area under the receiver operating characteristic curve (AUC), accuracy, Youden index, sensitivity, and specificity. A total of 4,189 images that contained 1,109 positive images (332 non-displaced and 777 displaced) and 3,080 negative images were collected from two hospitals. The test values after training with one hospital dataset were 0.999 AUC, 0.986 accuracy, 0.960 Youden index, and 0.966 sensitivity, and 0.993 specificity. Values of external validation with the other hospital dataset were 0.977, 0.971, 0.920, 0.939, and 0.982, respectively. Values of merged hospital datasets were 0.987, 0.983, 0.960, 0.973, and 0.987, respectively. A CNN algorithm for FNF detection in both displaced and non-displaced fractures using plain X-rays could be used in other hospitals to screen for FNF after training with images from the hospital of interest.

[1]  Marcus A. Badgeley,et al.  Deep learning predicts hip fracture using confounding patient and healthcare variables , 2018, npj Digital Medicine.

[3]  Chien-Hung Liao,et al.  Application of a deep learning algorithm for detection and visualization of hip fractures on plain pelvic radiographs , 2019, European Radiology.

[4]  J. Zuckerman Hip fracture. , 1996, The New England journal of medicine.

[5]  E. Gould,et al.  Diagnosis of occult fractures about the hip. Magnetic resonance imaging compared with bone-scanning. , 1993, The Journal of bone and joint surgery. American volume.

[6]  E. Tsiridis,et al.  Occult fractures of the proximal femur: imaging diagnosis and management of 82 cases in a regional trauma center , 2015, World Journal of Emergency Surgery.

[7]  M. Parker Missed hip fractures. , 1992, Archives of emergency medicine.

[8]  Alex Bottle,et al.  Mortality associated with delay in operation after hip fracture: observational study , 2006, BMJ : British Medical Journal.

[9]  Who is more accurate in the diagnosis of neck of femur fractures, radiologists or orthopaedic trainees? , 2013, Skeletal Radiology.

[10]  S. Silvestri,et al.  Selected Topics: Emergency Radiology , 2009 .

[11]  Simukayi Mutasa,et al.  Advanced Deep Learning Techniques Applied to Automated Femoral Neck Fracture Detection and Classification , 2020, Journal of Digital Imaging.

[12]  F. Madsen,et al.  Garden's classification of femoral neck fractures. An assessment of inter-observer variation. , 1988, The Journal of bone and joint surgery. British volume.

[13]  Eugene Ozhinsky,et al.  Automatic Hip Fracture Identification and Functional Subclassification with Deep Learning , 2019, Radiology. Artificial intelligence.

[14]  In-So Kweon,et al.  CBAM: Convolutional Block Attention Module , 2018, ECCV.

[15]  N. Rudman,et al.  Emergency department evaluation and treatment of hip and thigh injuries. , 2000, Emergency medicine clinics of North America.

[16]  W. Ertel,et al.  Delayed recognition of an ipsilateral femoral neck and shaft fracture leading to preventable subsequent complications: a case report , 2017, Patient Safety in Surgery.

[17]  M. Liebergall,et al.  Early diagnosis of occult hip fractures MRI versus CT scan. , 2005, Injury.

[18]  L. Melton,et al.  Hip fractures: a worldwide problem today and tomorrow. , 1993, Bone.

[19]  R. S. Garden LOW-ANGLE FIXATION IN FRACTURES OF THE FEMORAL NECK , 1961 .

[20]  S. Cummings,et al.  The future of hip fractures in the United States. Numbers, costs, and potential effects of postmenopausal estrogen. , 1990, Clinical orthopaedics and related research.

[21]  G. Braemer International statistical classification of diseases and related health problems. Tenth revision. , 1988, World health statistics quarterly. Rapport trimestriel de statistiques sanitaires mondiales.

[22]  W. Youden,et al.  Index for rating diagnostic tests , 1950, Cancer.

[23]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[24]  K. Lyons,et al.  The validity of investigating occult hip fractures using multidetector CT. , 2016, The British journal of radiology.

[25]  V. Frankel,et al.  Postoperative complications and mortality associated with operative delay in older patients who have a fracture of the hip. , 1995, The Journal of bone and joint surgery. American volume.

[26]  Frank Gaillard,et al.  Computer vs human: Deep learning versus perceptual training for the detection of neck of femur fractures , 2019, Journal of medical imaging and radiation oncology.

[27]  J. Zuckerman,et al.  Mortality Risk After Hip Fracture , 2003, Journal of orthopaedic trauma.

[28]  Jaehoon Oh,et al.  Deep learning algorithms for detecting and visualising intussusception on plain abdominal radiography in children: a retrospective multicenter study , 2020, Scientific Reports.

[29]  K. Choi [Hip fracture]. , 1963, [Chapchi] Journal. Taehan Oekwa Hakhoe.

[30]  J. Mandell,et al.  Computed tomography for occult fractures of the proximal femur, pelvis, and sacrum in clinical practice: single institution, dual-site experience , 2018, Emergency Radiology.

[31]  H. Muncie,et al.  Hip fracture: diagnosis, treatment, and secondary prevention. , 2014, American family physician.

[32]  Mark D. Miller,et al.  Orthopedic pitfalls in the ED: radiographically occult hip fracture. , 2002, The American journal of emergency medicine.

[33]  G. Roukema,et al.  The reliability of a simplified Garden classification for intracapsular hip fractures. , 2012, Orthopaedics & traumatology, surgery & research : OTSR.

[34]  Naoto Endo,et al.  Detecting intertrochanteric hip fractures with orthopedist-level accuracy using a deep convolutional neural network , 2018, Skeletal Radiology.

[35]  A. Hommel,et al.  Epidemiology of femoral neck fractures. , 2002, Injury.

[36]  Abhishek Das,et al.  Grad-CAM: Visual Explanations from Deep Networks via Gradient-Based Localization , 2016, 2017 IEEE International Conference on Computer Vision (ICCV).