Deep Learning Predicts Total Knee Replacement from Magnetic Resonance Images

Knee Osteoarthritis (OA) is a common musculoskeletal disorder in the United States. When diagnosed at early stages, lifestyle interventions such as exercise and weight loss can slow OA progression, but at later stages, only an invasive option is available: total knee replacement (TKR). Though a generally successful procedure, only 2/3 of patients who undergo the procedure report their knees feeling “normal” post-operation, and complications can arise that require revision. This necessitates a model to identify a population at higher risk of TKR, particularly at less advanced stages of OA, such that appropriate treatments can be implemented that slow OA progression and delay TKR. Here, we present a deep learning pipeline that leverages MRI images and clinical and demographic information to predict TKR with AUC 0.834 ± 0.036 (p < 0.05). Most notably, the pipeline predicts TKR with AUC 0.943 ± 0.057 (p < 0.05) for patients without OA. Furthermore, we develop occlusion maps for case-control pairs in test data and compare regions used by the model in both, thereby identifying TKR imaging biomarkers. As such, this work takes strides towards a pipeline with clinical utility, and the biomarkers identified further our understanding of OA progression and eventual TKR onset.

[1]  Richard B. Souza,et al.  Anatomy and Physiology of the Knee , 2010 .

[2]  Denis Nam,et al.  Systematic Review of Patient-specific Instrumentation in Total Knee Arthroplasty: New but Not Improved , 2015, Clinical orthopaedics and related research.

[3]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[4]  Ewa M. Roos,et al.  Strategies for the prevention of knee osteoarthritis , 2016, Nature Reviews Rheumatology.

[5]  Chao Chen,et al.  Using Random Forest to Learn Imbalanced Data , 2004 .

[6]  Charles E Leddon,et al.  Efficacy of Unloader Bracing in Reducing Symptoms of Knee Osteoarthritis. , 2016, American journal of orthopedics.

[7]  Abtin Alvand,et al.  ACL and meniscal injuries increase the risk of primary total knee replacement for osteoarthritis: a matched case–control study using the Clinical Practice Research Datalink (CPRD) , 2018, British Journal of Sports Medicine.

[8]  C Hedde [Anatomy and physiology of the knee]. , 1985, Soins. Chirurgie.

[9]  Andreo A Spina The plantaris muscle: anatomy, injury, imaging, and treatment. , 2007, The Journal of the Canadian Chiropractic Association.

[10]  Francisco Figueroa,et al.  Total knee replacement in patients with osteoarthritis and concomitant inveterate patellar dislocation , 2018, Arthroplasty today.

[11]  C. Helmick,et al.  Medical Expenditures and Earnings Losses Among US Adults With Arthritis in 2013 , 2018, Arthritis care & research.

[12]  A. Akobeng,et al.  Understanding diagnostic tests 3: receiver operating characteristic curves , 2007, Acta paediatrica.

[13]  Erika Schneider,et al.  The osteoarthritis initiative: report on the design rationale for the magnetic resonance imaging protocol for the knee. , 2008, Osteoarthritis and cartilage.

[14]  Michael Tanzer,et al.  Preoperative Planning in Primary Total Knee Arthroplasty , 2016, The Journal of the American Academy of Orthopaedic Surgeons.

[15]  Yi-Chung Pai,et al.  Physical functioning over three years in knee osteoarthritis: role of psychosocial, local mechanical, and neuromuscular factors. , 2003, Arthritis and rheumatism.

[16]  Raef Lawson,et al.  Small Sample Confidence Intervals for the Odds Ratio , 2004 .

[17]  K. Bozic,et al.  Trends in total knee arthroplasty implant utilization. , 2015, The Journal of arthroplasty.

[18]  Thomas M. Link,et al.  Applying Densely Connected Convolutional Neural Networks for Staging Osteoarthritis Severity from Plain Radiographs , 2018, Journal of Digital Imaging.

[19]  J F Beary,et al.  Correlation between bone lesion changes and cartilage volume loss in patients with osteoarthritis of the knee as assessed by quantitative magnetic resonance imaging over a 24-month period , 2007, Annals of the rheumatic diseases.

[20]  M. Inacio,et al.  Projected increase in total knee arthroplasty in the United States - an alternative projection model. , 2017, Osteoarthritis and cartilage.

[21]  Yutaka Satoh,et al.  Can Spatiotemporal 3D CNNs Retrace the History of 2D CNNs and ImageNet? , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[22]  Gerd Diederichs,et al.  MR imaging of patellar instability: injury patterns and assessment of risk factors. , 2010, Radiographics : a review publication of the Radiological Society of North America, Inc.

[23]  Kun Zhu,et al.  A Predictive Model for Knee Joint Replacement in Older Women , 2013, PloS one.

[24]  M. Chang,et al.  Diagnosis, Causes and Treatments of Instability Following Total Knee Arthroplasty , 2014, Knee surgery & related research.

[25]  Lynne M Connelly,et al.  Fisher's Exact Test. , 2016, Medsurg nursing : official journal of the Academy of Medical-Surgical Nurses.

[26]  J W R Twisk,et al.  The course of limitations in activities over 5 years in patients with knee and hip osteoarthritis with moderate functional limitations: risk factors for future functional decline. , 2012, Osteoarthritis and cartilage.

[27]  Javad Parvizi,et al.  High Level of Residual Symptoms in Young Patients After Total Knee Arthroplasty , 2014, Clinical orthopaedics and related research.

[28]  T. Vos,et al.  The global burden of hip and knee osteoarthritis: estimates from the Global Burden of Disease 2010 study , 2014, Annals of the rheumatic diseases.

[29]  S. Gabriel,et al.  Estimates of the prevalence of arthritis and other rheumatic conditions in the United States. Part II. , 2008, Arthritis and rheumatism.

[30]  Ali Guermazi,et al.  Semiquantitative Imaging Biomarkers of Knee Osteoarthritis Progression: Data From the Foundation for the National Institutes of Health Osteoarthritis Biomarkers Consortium , 2016, Arthritis & rheumatology.

[31]  B. Heidari Knee osteoarthritis prevalence, risk factors, pathogenesis and features: Part I. , 2011, Caspian journal of internal medicine.

[32]  D. Flanigan,et al.  Full-Thickness Cartilage Defects Are Important Independent Predictive Factors for Progression to Total Knee Arthroplasty in Older Adults with Minimal to Moderate Osteoarthritis: Data from the Osteoarthritis Initiative , 2019, The Journal of bone and joint surgery. American volume.

[33]  Sharmila Majumdar Advances in MRI of the Knee for Osteoarthritis , 2010 .

[34]  W. Youden,et al.  Index for rating diagnostic tests , 1950, Cancer.

[35]  Simo Saarakkala,et al.  Multimodal Machine Learning-based Knee Osteoarthritis Progression Prediction from Plain Radiographs and Clinical Data , 2019, Scientific Reports.

[36]  Atlanta,et al.  Estimates of the prevalence of arthritis and other rheumatic conditions in the United States. Part I. , 2008, Arthritis and rheumatism.

[37]  Simo Saarakkala,et al.  Automatic Knee Osteoarthritis Diagnosis from Plain Radiographs: A Deep Learning-Based Approach , 2017, Scientific Reports.

[38]  Song Lee,et al.  Causes of Failure after Total Knee Arthroplasty in Osteoarthritis Patients 55 Years of Age or Younger , 2014, Knee surgery & related research.

[39]  Jerzy Adamski,et al.  Random Survival Forest in practice: a method for modelling complex metabolomics data in time to event analysis. , 2016, International journal of epidemiology.

[40]  Randy Mascarenhas,et al.  The Relationship between Anterior Cruciate Ligament Injury and Osteoarthritis of the Knee , 2015, Advances in orthopedics.

[41]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[42]  Lars Engebretsen,et al.  High prevalence of knee osteoarthritis at a minimum 10-year follow-up after knee dislocation surgery , 2017, Knee Surgery, Sports Traumatology, Arthroscopy.

[43]  Steven Salzberg,et al.  On Comparing Classifiers: Pitfalls to Avoid and a Recommended Approach , 1997, Data Mining and Knowledge Discovery.

[44]  Merrilee Zetaruk,et al.  CHAPTER 32 – Leg Injuries , 2007 .

[45]  Richard D Riley,et al.  Development and validation of prediction models to estimate risk of primary total hip and knee replacements using data from the UK: two prospective open cohorts using the UK Clinical Practice Research Datalink , 2018, Annals of the rheumatic diseases.

[46]  L SalzbergSteven On Comparing Classifiers , 1997 .

[47]  Joseph Antony,et al.  Quantifying radiographic knee osteoarthritis severity using deep convolutional neural networks , 2016, 2016 23rd International Conference on Pattern Recognition (ICPR).

[48]  Gillian A Hawker,et al.  A prospective population-based study of the predictors of undergoing total joint arthroplasty. , 2006, Arthritis and rheumatism.

[49]  Elena Losina,et al.  Number of Persons With Symptomatic Knee Osteoarthritis in the US: Impact of Race and Ethnicity, Age, Sex, and Obesity , 2016, Arthritis care & research.

[50]  Gregory Chang,et al.  Total Knee Replacement prediction using Structural MRIs and 3D Convolutional Neural Networks , 2019 .

[51]  D J Hunter,et al.  The diagnostic performance of MRI in osteoarthritis: a systematic review and meta-analysis. , 2012, Osteoarthritis and cartilage.

[52]  Thomas G. Dietterich Approximate Statistical Tests for Comparing Supervised Classification Learning Algorithms , 1998, Neural Computation.

[53]  E. Ringdahl,et al.  Treatment of knee osteoarthritis. , 2011, American family physician.

[54]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[55]  Michael S. Bernstein,et al.  ImageNet Large Scale Visual Recognition Challenge , 2014, International Journal of Computer Vision.

[56]  J. Kellgren,et al.  Radiological Assessment of Osteo-Arthrosis , 1957, Annals of the rheumatic diseases.

[57]  Cynthia S Crowson,et al.  Prevalence of Total Hip and Knee Replacement in the United States. , 2015, The Journal of bone and joint surgery. American volume.

[58]  Daniel L Riddle,et al.  Two-year incidence and predictors of future knee arthroplasty in persons with symptomatic knee osteoarthritis: preliminary analysis of longitudinal data from the osteoarthritis initiative. , 2009, The Knee.

[59]  C. Cooper,et al.  Risk factors for the incidence and progression of radiographic knee osteoarthritis. , 2000, Arthritis and rheumatism.

[60]  Ali Guermazi,et al.  Semi‐Quantitative Imaging Biomarkers of Knee Osteoarthritis Progression: Data from the FNIH OA Biomarkers Consortium , 2016 .