The Reverse Fragility Index: Interpreting the Current Literature on Long-Term Survivorship of Computer-Navigated Versus Conventional TKA

Background: Despite the most recent American Academy of Orthopaedic Surgeons clinical practice guideline making a “strong” recommendation against the use of intraoperative navigation in total knee arthroplasty (TKA), its use is increasing. We utilized the concept of the reverse fragility index (RFI) to assess the strength of neutrality of the randomized controlled trials (RCTs) comparing the long-term survivorship of computer-navigated and conventional TKA. Methods: A systematic review was performed including all RCTs through August 3, 2021, comparing the long-term outcomes of computer-navigated and conventional TKA. Randomized trials with mean follow-up of >8 years and survivorship with revision as the end point were included. The RFI quantifies the strength of a study’s neutrality by calculating the minimum number of events necessary to flip the result from nonsignificant to significant. The RFI at a threshold of p < 0.05 was calculated for each study reporting nonsignificant results. The reverse fragility quotient (RFQ) was calculated by dividing the RFI by the study sample size. Results: Ten clinical trials with 2,518 patients and 38 all-cause revisions were analyzed. All 10 studies reported nonsignificant results. The median RFI at the p < 0.05 threshold was 4, meaning that a median of 4 events would be needed to change the results from nonsignificant to significant. The median RFQ was 0.029, indicating that the nonsignificance of the results was contingent on only 2.9 events per 100 participants. The median loss to follow-up was 27 patients. In all studies, the number of patients lost to follow-up was greater than the RFI. Conclusions: The equipoise in long-term survivorship between computer-navigated and conventional TKA rests on fragile studies, as their statistical nonsignificance could be reversed by changing the outcome status of only a handful of patients––a number that was always smaller than the number lost to follow-up. Routine reporting of the RFI in trials with nonsignificant findings may provide readers with a measure of confidence in the neutrality of the results. Level of Evidence: Prognostic Level II. See Instructions for Authors for a complete description of levels of evidence.

[1]  S. Rainbird,et al.  Effect of glenosphere size on reverse shoulder arthroplasty revision rate: an analysis from the Australian Orthopaedic Association National Joint Replacement Registry (AOANJRR). , 2021, Journal of shoulder and elbow surgery.

[2]  A. Hodgson,et al.  How Large a Study Is Needed to Detect TKA Revision Rate Reductions Attributable to Robotic or Navigated Technologies? A Simulation-based Power Analysis , 2021, Clinical orthopaedics and related research.

[3]  M. Whitehouse,et al.  Common elective orthopaedic procedures and their clinical effectiveness: umbrella review of level 1 evidence , 2021, BMJ.

[4]  Dean Wang,et al.  The Statistical Fragility of Platelet-Rich Plasma in Rotator Cuff Surgery: A Systematic Review and Meta-analysis , 2021, The American journal of sports medicine.

[5]  A. Siddiqi,et al.  Not All Robotic-assisted Total Knee Arthroplasty Are the Same. , 2020, The Journal of the American Academy of Orthopaedic Surgeons.

[6]  W. Levine,et al.  Statistical Fragility of Randomized Clinical Trials in Shoulder Arthroplasty. , 2020, Journal of shoulder and elbow surgery.

[7]  Andrew J. Curley,et al.  The Statistical Fragility of Hamstring Versus Patellar Tendon Autografts for Anterior Cruciate Ligament Reconstruction: A Systematic Review of Comparative Studies , 2020, The American journal of sports medicine.

[8]  F. Harrell,et al.  Application of the Reverse Fragility Index to Statistically Nonsignificant Randomized Clinical Trial Results , 2020, JAMA network open.

[9]  N. Heckmann,et al.  Population-based Survivorship of Computer-navigated Versus Conventional Total Knee Arthroplasty. , 2020, The Journal of the American Academy of Orthopaedic Surgeons.

[10]  R. Hsu,et al.  Comparison of computer-assisted navigation and conventional instrumentation for bilateral total knee arthroplasty , 2019, Medicine.

[11]  Hyun-Jung Kim,et al.  A Comparison of Long-Term Outcomes of Computer-Navigated and Conventional Total Knee Arthroplasty: A Meta-Analysis of Randomized Controlled Trials. , 2019, The Journal of bone and joint surgery. American volume.

[12]  A. Kurmis Understanding the Role of Computer Navigation in Primary Total Knee Arthroplasty: Commentary on an article by Seung Joon Rhee, MD, et al.: "A Comparison of Long-Term Outcomes of Computer-Navigated and Conventional Total Knee Arthroplasty. A Meta-Analysis of Randomized Controlled Trials". , 2019, The Journal of bone and joint surgery. American volume.

[13]  J. Singh,et al.  Rates of Total Joint Replacement in the United States: Future Projections to 2020–2040 Using the National Inpatient Sample , 2019, The Journal of Rheumatology.

[14]  Cory K. Mayfield,et al.  Trends in computer navigation and robotic assistance for total knee arthroplasty in the United States: an analysis of patient and hospital factors , 2019, Arthroplasty today.

[15]  R. D. de Steiger,et al.  Major Aseptic Revision Following Total Knee Replacement: A Study of 478,081 Total Knee Replacements from the Australian Orthopaedic Association National Joint Replacement Registry , 2019, The Journal of bone and joint surgery. American volume.

[16]  A. Leardini,et al.  Conventional versus computer-assisted surgery in total knee arthroplasty: comparison at ten years follow-up , 2018, International Orthopaedics.

[17]  P. Schober,et al.  Statistical Significance Versus Clinical Importance of Observed Effect Sizes: What Do P Values and Confidence Intervals Really Represent? , 2018, Anesthesia and analgesia.

[18]  C. Bach,et al.  Twelve-Year Follow-Up of Navigated Computer-Assisted Versus Conventional Total Knee Arthroplasty: A Prospective Randomized Comparative Trial. , 2017, The Journal of arthroplasty.

[19]  M. Lacko,et al.  [Long-Term Results of Computer-Navigated Total Knee Arthroplasties Performed by Low-Volume and Less Experienced Surgeon]. , 2018, Acta chirurgiae orthopaedicae et traumatologiae Cechoslovaca.

[20]  Young-Hoo Kim,et al.  2017 Chitranjan S. Ranawat Award: Does Computer Navigation in Knee Arthroplasty Improve Functional Outcomes in Young Patients? A Randomized Study , 2018, Clinical orthopaedics and related research.

[21]  J. Argenson,et al.  No Benefit of Computer-assisted TKA: 10-year Results of a Prospective Randomized Study , 2018, Clinical orthopaedics and related research.

[22]  M. Inacio,et al.  Projected increase in total knee arthroplasty in the United States - an alternative projection model. , 2017, Osteoarthritis and cartilage.

[23]  Young-Hoo Kim,et al.  The Clinical Outcome of Computer-Navigated Compared with Conventional Knee Arthroplasty in the Same Patients: A Prospective, Randomized, Double-Blind, Long-Term Study , 2017, The Journal of bone and joint surgery. American volume.

[24]  Rickey E Carter,et al.  The Fragility Index: a P-value in sheep’s clothing? , 2016, European heart journal.

[25]  Matthew S Thiese,et al.  P value interpretations and considerations. , 2016, Journal of thoracic disease.

[26]  S. Goodman,et al.  Statistical tests, P values, confidence intervals, and power: a guide to misinterpretations , 2016, European Journal of Epidemiology.

[27]  H. Chong,et al.  Minimally Invasive Computer-Assisted Total Knee Arthroplasty Compared With Conventional Total Knee Arthroplasty: A Prospective 9-Year Follow-Up. , 2016, The Journal of arthroplasty.

[28]  N. Lazar,et al.  The ASA Statement on p-Values: Context, Process, and Purpose , 2016 .

[29]  E. K. Song,et al.  A randomized controlled clinical and radiological trial about outcomes of navigation-assisted TKA compared to conventional TKA: long-term follow-up , 2016, Knee Surgery, Sports Traumatology, Arthroscopy.

[30]  D. Sackett,et al.  Clinician trialist rounds: 28. When RCT participants are lost to follow-up. Part 1: Why even a few can matter , 2015, Clinical trials.

[31]  M. Chowdhry,et al.  Radiological and Functional Outcomes in Computer Assisted Total Knee Arthroplasty Between Consultants and Trainees - A Prospective Randomized Controlled Trial. , 2015, The Journal of arthroplasty.

[32]  Yen-Liang Liu,et al.  Computer navigation for total knee arthroplasty reduces revision rate for patients less than sixty-five years of age. , 2015, The Journal of bone and joint surgery. American volume.

[33]  Young-Hoo Kim,et al.  Computer-navigated versus conventional total knee arthroplasty a prospective randomized trial. , 2012, The Journal of bone and joint surgery. American volume.

[34]  Gail M. Sullivan,et al.  Using Effect Size-or Why the P Value Is Not Enough. , 2012, Journal of graduate medical education.

[35]  Tao Cheng,et al.  Does computer-assisted surgery improve postoperative leg alignment and implant positioning following total knee arthroplasty? A meta-analysis of randomized controlled trials? , 2012, Knee Surgery, Sports Traumatology, Arthroscopy.

[36]  S. Kurtz,et al.  Future Young Patient Demand for Primary and Revision Joint Replacement: National Projections from 2010 to 2030 , 2009, Clinical orthopaedics and related research.

[37]  A Leardini,et al.  Alignments and Clinical Results in Conventional and Navigated Total Knee Arthroplasty , 2006, Clinical orthopaedics and related research.

[38]  J. Ioannidis Contradicted and initially stronger effects in highly cited clinical research. , 2005, JAMA.

[39]  T C Chalmers,et al.  The importance of beta, the type II error and sample size in the design and interpretation of the randomized control trial. Survey of 71 "negative" trials. , 1978, The New England journal of medicine.