Understanding Clinical Significance in Rehabilitation

Supplemental digital content is available in the text. Abstract The objective of this review was to summarize the concept of clinical significance and associated methods focusing on the area of rehabilitation to provide a resource to rehabilitation researchers and clinicians. Studies were searched on electronic databases from inception until July 28, 2020, with no date or language limits. Manual searches as well as Scopus forward citation for relevant references were performed. Narrative synthesis of study results was performed. Definitions of the concepts related to clinical significance, ways of calculating, and interpreting each method were provided using rehabilitation examples. An explanation of methods to evaluate clinical significance (distribution, anchor, and opinion-based methods) and their advantages and disadvantages were also provided. Considering the limitations of statistical significance in assuring meaningfulness of results, clinical interpretation of research outcomes and the report of clinical significance in intervention trials should be a priority in rehabilitation research. When possible, the use of multiple methods (distribution, anchor, and opinion based) is recommended. Thus, clinical researchers are encouraged to present results in a manner that allow the rehabilitation professionals to easily interpret and implement those results in their clinical practice.

[1]  C. Fernández‐de‐las‐Peñas,et al.  Intrarater and Interrater Reliability of the Flexion Rotation Test and Cervical Range of Motion in People With Migraine. , 2020, Journal of manipulative and physiological therapeutics.

[2]  Alonso Carrasco-Labra,et al.  Mind the methods of determining minimal important differences: three critical issues to consider , 2020, Evidence-Based Mental Health.

[3]  M. V. van Tulder,et al.  Effects of exercise therapy in patients with acute low back pain: a systematic review of systematic reviews , 2020, Systematic Reviews.

[4]  G. Guyatt,et al.  Evaluating the credibility of anchor based estimates of minimal important differences for patient reported outcomes: instrument development and reliability study , 2020, BMJ.

[5]  A. Sedaghat,et al.  Characterising the potential for recall bias in anchor‐based MCID calculation of patient‐reported outcome measures for chronic rhinosinusitis , 2020, Clinical otolaryngology : official journal of ENT-UK ; official journal of Netherlands Society for Oto-Rhino-Laryngology & Cervico-Facial Surgery.

[6]  M. Petrarca,et al.  Minimum Clinically Important Difference of Gross Motor Function and Gait Endurance in Children with Motor Impairment: A Comparison of Distribution-Based Approaches , 2020, BioMed research international.

[7]  Yosra Mouelhi,et al.  How is the minimal clinically important difference established in health-related quality of life instruments? Review of anchors and methods , 2020, Health and Quality of Life Outcomes.

[8]  Adam R Kinney,et al.  Novel Effect Size Interpretation Guidelines and an Evaluation of Statistical Power in Rehabilitation Research. , 2020, Archives of physical medicine and rehabilitation.

[9]  Rick Sarre.  Training , 2020, Journal of Failure Analysis and Prevention.

[10]  D. H. Kamonseki,et al.  Psychometric properties of the Brazilian version of the Bournemouth questionnaire for low back pain: validity and reliability. , 2020, Brazilian journal of physical therapy.

[11]  A. Marques,et al.  Minimal Clinically Important Differences for Patient-Reported Outcome Measures of Cough and Sputum in Patients with COPD , 2020, International journal of chronic obstructive pulmonary disease.

[12]  A. Oliveira,et al.  What is the minimal important difference of pain intensity, mandibular function, and headache impact in patients with temporomandibular disorders? Clinical significance analysis of a randomized controlled trial. , 2020, Musculoskeletal science & practice.

[13]  John P Collins,et al.  Measures of Clinical Meaningfulness and Important Differences. , 2019, Physical therapy.

[14]  D. Çelik,et al.  Minimal clinically important difference of commonly used hip-, knee-, foot-, and ankle-specific questionnaires: a systematic review. , 2019, Journal of clinical epidemiology.

[15]  Christopher R Brydges,et al.  Effect Size Guidelines, Sample Size Calculations, and Statistical Power in Gerontology , 2019, Innovation in aging.

[16]  L. Moja,et al.  Rehabilitation interventions in randomized controlled trials for low back pain: proof of statistical significance often is not relevant , 2019, Health and Quality of Life Outcomes.

[17]  A. Sedaghat.  Understanding the Minimal Clinically Important Difference (MCID) of Patient-Reported Outcome Measures , 2019, Otolaryngology--head and neck surgery : official journal of American Academy of Otolaryngology-Head and Neck Surgery.

[18]  M. Monticone,et al.  Sensitivity to change and minimal clinically important difference of the Locomotor Capabilities Index-5 in people with lower limb amputation undergoing prosthetic training. , 2019, Annals of physical and rehabilitation medicine.

[19]  I. S. J. Merkies,et al.  The minimum clinically important difference: which direction to take , 2019, European journal of neurology.

[20]  F. Cottone,et al.  Distribution- and anchor-based methods to determine the minimally important difference on patient-reported outcome questionnaires in oncology: a structured review , 2018, Health and Quality of Life Outcomes.

[21]  A. Jette,et al.  Meaningful Change Estimates for the Late-Life Function and Disability Instrument in Older Adults , 2018, The journals of gerontology. Series A, Biological sciences and medical sciences.

[22]  S. Costi,et al.  Occupational Therapy in Complex Patients: A Pilot Randomized Controlled Trial , 2018, Occupational therapy international.

[23]  H. Takasaki,et al.  No increase in 6-week treatment effect of Mechanical Diagnosis and Therapy with the use of the LUMOback in people with non-acute non-specific low back pain and a directional preference of extension: a pilot randomized controlled trial. , 2018, Physiotherapy.

[24]  B. Kollen,et al.  Assessing health status over time: impact of recall period and anchor question on the minimal clinically important difference of copd health status tools , 2018, Health and Quality of Life Outcomes.

[25]  D. Beaton,et al.  Minimal Clinically Important Difference: A Review of Outcome Measure Score Interpretation. , 2018, Rheumatic diseases clinics of North America.

[26]  S. Armijo-Olivo.  The importance of determining the clinical significance of research results in physical therapy clinical research. , 2018, Brazilian journal of physical therapy.

[27]  F. Kovacs,et al.  Minimal Clinically Important Difference in Quality of Life for Patients With Low Back Pain , 2017, Spine.

[28]  K. Kroenke,et al.  Estimating minimally important differences for the PROMIS pain interference scales: results from 3 randomized clinical trials , 2017, Pain.

[29]  Jodi L. Young,et al.  The influence of dosing on effect size of exercise therapy for musculoskeletal foot and ankle disorders: a systematic review , 2017, Brazilian journal of physical therapy.

[30]  G. Guyatt,et al.  Presentation approaches for enhancing interpretability of patient-reported outcomes (PROs) in meta-analysis: a protocol for a systematic survey of Cochrane reviews , 2017, BMJ Open.

[31]  K. Hellström,et al.  Short-term and long-term effects of a progressive resistance and balance exercise program in individuals with chronic stroke: a randomized controlled trial , 2017, Disability and rehabilitation.

[32]  G. Guyatt,et al.  Application of minimal important differences in degenerative knee disease outcomes: a systematic review and case study to inform BMJ Rapid Recommendations , 2017, BMJ Open.

[33]  D. Quintana.  Statistical considerations for reporting and planning heart rate variability case-control studies. , 2017, Psychophysiology.

[34]  J. Angst,et al.  The minimal clinically important difference raised the significance of outcome effects above the statistical level, with methodological implications for future studies. , 2017, Journal of clinical epidemiology.

[35]  C. de Bisschop,et al.  Is the 1-minute sit-to-stand test a good tool for the evaluation of the impact of pulmonary rehabilitation? Determination of the minimal important difference in COPD , 2016, International journal of chronic obstructive pulmonary disease.

[36]  J. Nijs,et al.  Patient-centeredness in physiotherapy: What does it entail? A systematic review of qualitative studies , 2016, Physiotherapy theory and practice.

[37]  R. Rosenheck,et al.  Obtaining employment as an anchor for estimating the minimum clinically important difference on the Positive and Negative Syndrome Scale (PANSS) in schizophrenia , 2016, Psychiatry Research.

[38]  E. Roos,et al.  Examining the Minimal Important Difference of Patient-reported Outcome Measures for Individuals with Knee Osteoarthritis: A Model Using the Knee Injury and Osteoarthritis Outcome Score , 2016, The Journal of Rheumatology.

[39]  B. Wirth,et al.  Patients’ and therapists’ perception of change following physiotherapy in an orthopedic hospital’s outpatient clinic , 2015, Physiotherapy theory and practice.

[40]  J. Abbott,et al.  Global ratings of change do not accurately reflect functional change over time in clinical practice. , 2015, The Journal of orthopaedic and sports physical therapy.

[41]  Phil Page,et al.  Beyond statistical significance: clinical interpretation of rehabilitation research literature. , 2014, International journal of sports physical therapy.

[42]  B. Dick,et al.  Enhanced Therapeutic Alliance Modulates Pain Intensity and Muscle Pain Sensitivity in Patients With Chronic Low Back Pain: An Experimental Controlled Study , 2013, Physical Therapy.

[43]  P. Nilsen,et al.  Towards evidence-based physiotherapy - research challenges and needs. , 2013, Journal of physiotherapy.

[44]  David J Beard,et al.  Extending the use of PROMs in the NHS—using the Oxford Knee Score in patients undergoing non-operative management for knee osteoarthritis: a validation study , 2013, BMJ Open.

[45]  M. Law,et al.  Research utilization and evidence-based practice in occupational therapy: a scoping study. , 2013, The American journal of occupational therapy : official publication of the American Occupational Therapy Association.

[46]  K. Hammell,et al.  Client-centred practice in occupational therapy: Critical reflections , 2013, Scandinavian journal of occupational therapy.

[47]  Jason N Doctor,et al.  Minimal clinically important differences for the EQ-5D and QWB-SA in Post-traumatic Stress Disorder (PTSD): results from a Doubly Randomized Preference Trial (DRPT) , 2013, Health and Quality of Life Outcomes.

[48]  N. R. Olsen,et al.  Evidence based practice in clinical physiotherapy education: a qualitative interpretive description , 2013, BMC medical education.

[49]  S. Acaster,et al.  Methods for interpreting change over time in patient-reported outcome measures , 2013, Quality of Life Research.

[50]  A. Wein,et al.  Comparison of distribution- and anchor-based approaches to infer changes in health-related quality of life of prostate cancer survivors. , 2012, Health services research.

[51]  Anna Maria Turcato,et al.  Comparison of Reliability, Validity, and Responsiveness of the Mini-BESTest and Berg Balance Scale in Patients With Balance Disorders , 2012, Physical Therapy.

[52]  Alexis Wright,et al.  Clinimetrics corner: a closer look at the minimal clinically important difference (MCID) , 2012, The Journal of manual & manipulative therapy.

[53]  M. Dijkers,et al.  Evidence-based practice for rehabilitation professionals: concepts and controversies. , 2012, Archives of physical medicine and rehabilitation.

[54]  P. Stratford,et al.  When Minimal Detectable Change Exceeds a Diagnostic Test–Based Threshold Change Value for an Outcome Measure: Resolving the Conflict , 2012, Physical Therapy.

[55]  Susan Armijo-Olivo,et al.  Clinical relevance vs. statistical significance: Using neck outcomes in patients with temporomandibular disorders as an example. , 2011, Manual therapy.

[56]  H. Vet,et al.  Measurement in Medicine: A Practical Guide , 2011 .

[57]  M. Koller,et al.  Tinnitus Handicap Inventory for Evaluating Treatment Effects , 2011, Otolaryngology--head and neck surgery : official journal of American Academy of Otolaryngology-Head and Neck Surgery.

[58]  M. King.  A point of minimal important difference (MID): a critique of terminology and methods , 2011, Expert review of pharmacoeconomics & outcomes research.

[59]  L. San,et al.  Validation of the Excited Component of the Positive and Negative Syndrome Scale (PANSS-EC) in a naturalistic sample of 278 patients with acute psychosis and agitation in a psychiatric emergency room , 2011, Health and quality of life outcomes.

[60]  F. Fregni,et al.  Sample size calculation in physical medicine and rehabilitation: a systematic review of reporting, characteristics, and results in randomized controlled trials. , 2011, Archives of physical medicine and rehabilitation.

[61]  J. Higgins,et al.  Cochrane Handbook for Systematic Reviews of Interventions , 2010, International Coaching Psychology Review.

[62]  C. Terwee,et al.  Mind the MIC: large variation among populations and methods. , 2010, Journal of clinical epidemiology.

[63]  A. Holland,et al.  Updating the minimal important difference for six-minute walk distance in patients with chronic obstructive pulmonary disease. , 2010, Archives of physical medicine and rehabilitation.

[64]  Yen-ho Wang,et al.  Minimal Detectable Change and Clinically Important Difference of the Stroke Impact Scale in Stroke Patients , 2010, Neurorehabilitation and neural repair.

[65]  C. Maher,et al.  Global Rating of Change Scales: A Review of Strengths and Weaknesses and Considerations for Design , 2009, The Journal of manual & manipulative therapy.

[66]  R. Hays,et al.  Recommended methods for determining responsiveness and minimally important differences for patient-reported outcomes. , 2008, Journal of clinical epidemiology.

[67]  John D. Childs,et al.  Effectiveness of an Extension-Oriented Treatment Approach in a Subgroup of Subjects With Low Back Pain: A Randomized Clinical Trial , 2007, Physical Therapy.

[68]  K. Musselman.  Clinical significance testing in rehabilitation research: what, why, and how? , 2007 .

[69]  R. Day,et al.  Assessment of diclofenac or spinal manipulative therapy, or both, in addition to recommended first-line treatment for acute low back pain: a randomised controlled trial , 2007, The Lancet.

[70]  S. Hogg-Johnson,et al.  Three methods for minimally important difference: no relationship was found with the net proportion of patients improving. , 2007, Journal of clinical epidemiology.

[71]  Roger E. Kirk,et al.  Effect magnitude: A different focus , 2007 .

[72]  B. Hermann,et al.  Measuring Clinical Significance in Rehabilitation Research , 2006 .

[73]  Jamie L. Callahan,et al.  Making Subjective Judgments in Quantitative Studies: The Importance of Using Effect Sizes and Confidence Intervals. , 2006 .

[74]  S. Studenski,et al.  Meaningful Change and Responsiveness in Common Physical Performance Measures in Older Adults , 2006, Journal of the American Geriatrics Society.

[75]  V. Robertson,et al.  The effect of heat on tissue extensibility: a comparison of deep and superficial heating. , 2005, Archives of physical medicine and rehabilitation.

[76]  A. Gnanasakthy,et al.  Using multiple anchor- and distribution-based estimates to evaluate clinically meaningful change on the Functional Assessment of Cancer Therapy-Biologic Response Modifiers (FACT-BRM) instrument. , 2005, Value in health : the journal of the International Society for Pharmacoeconomics and Outcomes Research.

[77]  Rodney X. Sturdivant,et al.  Applied Logistic Regression: Hosmer/Applied Logistic Regression , 2005 .

[78]  N. Leidy,et al.  Bridging the Gap: Using Triangulation Methodology to Estimate Minimal Clinically Important Differences (MCIDs) , 2005, COPD.

[79]  K. Wyrwich.  Minimal Important Difference Thresholds and the Standard Error of Measurement: Is There a Connection? , 2004, Journal of biopharmaceutical statistics.

[80]  N. Fagley.  Methodological issues & strategies in clinical research , 2004, Psychotherapy research : journal of the Society for Psychotherapy Research.

[81]  S. Millis.  Emerging standards in statistical practice: implications for clinical trials in rehabilitation medicine. , 2003, American journal of physical medicine & rehabilitation.

[82]  S. Piva,et al.  A modified neuromuscular electrical stimulation protocol for quadriceps strength training following anterior cruciate ligament reconstruction. , 2003, The Journal of orthopaedic and sports physical therapy.

[83]  Ross D Crosby,et al.  Defining clinically meaningful change in health-related quality of life. , 2003, Journal of clinical epidemiology.

[84]  G. Norman,et al.  Interpretation of Changes in Health-related Quality of Life: The Remarkable Universality of Half a Standard Deviation , 2003, Medical care.

[85]  D. Cella,et al.  Combining anchor and distribution-based methods to derive minimal clinically important differences on the Functional Assessment of Cancer Therapy (FACT) anemia and fatigue scales. , 2002, Journal of pain and symptom management.

[86]  Gordon H Guyatt,et al.  Methods to explain the clinical significance of health status measures. , 2002, Mayo Clinic proceedings.

[87]  D. Beaton,et al.  Many faces of the minimal clinically important difference (MCID): a literature review and directions for future research. , 2002, Current opinion in rheumatology.

[88]  B. Ogles,et al.  Clinical significance: history, application, and current practice. , 2001, Clinical psychology review.

[89]  J. Sterne,et al.  Sifting the evidence—what's wrong with significance tests? , 2001, BMJ : British Medical Journal.

[90]  D. Gladman,et al.  Methods for assessing responsiveness: a critical review and recommendations. , 2000, Journal of clinical epidemiology.

[91]  F D Wolinsky,et al.  Identifying meaningful intra-individual change standards for health-related quality of life measures. , 2000, Journal of evaluation in clinical practice.

[92]  A. Kazdin.  The meanings and measurement of clinical significance. , 1999, Journal of consulting and clinical psychology.

[93]  R. Kirk.  Practical Significance: A Concept Whose Time Has Come , 1996 .

[94]  S. Shott,et al.  Power and sample size. , 1990, Journal of the American Veterinary Medical Association.

[95]  G. Guyatt,et al.  Measurement of health status. Ascertaining the minimal clinically important difference. , 1989, Controlled clinical trials.

[96]  P. Lachenbruch.  Statistical Power Analysis for the Behavioral Sciences (2nd ed.) , 1989 .

[97]  K. Ottenbacher,et al.  Measures of Effect Size in the Reporting of Rehabilitation Research , 1989, American journal of physical medicine & rehabilitation.

[98]  P. Major,et al.  Head and cervical posture in patients with temporomandibular disorders. , 2011, Journal of orofacial pain.

[99]  G. Guyatt,et al.  The minimal detectable change cannot reliably replace the minimal important difference. , 2010, Journal of clinical epidemiology.

[100]  A. Kazdin.  Clinical significance: Measuring whether interventions make a difference. , 2003 .

[101]  Bendix Anderson,et al.  All correspondence should be addressed to , 2001 .

[102]  K. Masters,et al.  Assessing outcome in clinical practice , 1996 .

[103]  F. Goodwin,et al.  From the Alcohol, Drug Abuse, and Mental Health Administration. , 1990, JAMA.

[104]  Jacob Cohen,et al.  CHAPTER 1 – The Concepts of Power Analysis , 1977 .