Mind the methods of determining minimal important differences: three critical issues to consider

Objective Clinical trialists, meta-analysts and clinical guideline developers are increasingly using minimal important differences (MIDs) to enhance the interpretability of patient-reported outcome measures (PROMs). Here, we elucidate three critical issues of which MID users should be aware. Improved understanding of MID concepts and awareness of common pitfalls in methodology and reporting will better inform the application of MIDs in clinical research and decision-making. Methods We conducted a systematic review to inform the development of an inventory of anchor-based MID estimates for PROMs. We searched four electronic databases to identify primary studies empirically calculating an anchor-based MID estimate for any PROM in adolescent or adult populations across all clinical areas. Our findings are based on information from 338 studies reporting 3389 MIDs for 358 PROMs published between 1989 and 2015. Results We identified three key issues in the MID literature that demand attention. (1) The profusion of terms representing the MID concept adds unnecessary complexity to users’ task in identifying relevant MIDs, requiring meticulous inspection of methodology to ensure estimates offered truly reflect the MID. (2) A multitude of diverse methods for MID estimation that will yield different estimates exist, and whether there are superior options remains unresolved. (3) There are serious issues of incomplete presentation and reporting of key aspects of the design, methodology and results of studies providing anchor-based MIDs, which threatens the optimal use of these estimates for interpretation of intervention effects on PROMs. Conclusions Although the MID represents a powerful tool for enhancing the interpretability of PROMs, realising its full value will require improved understanding and reporting of its measurement fundamentals.

[1]  G. Guyatt,et al.  Measurement Properties and Interpretability of the Chronic Respiratory Disease Questionnaire (CRQ) , 2005, COPD.

[2]  Gordon H Guyatt,et al.  Methods to explain the clinical significance of health status measures. , 2002, Mayo Clinic proceedings.

[3]  A. Copay,et al.  Understanding the minimum clinically important difference: a review of concepts and methods. , 2007, The spine journal : official journal of the North American Spine Society.

[4]  Mohit Bhandari,et al.  Patients at the centre: in our practice, and in our use of language , 2004, ACP journal club.

[5]  Ross D Crosby,et al.  Defining clinically meaningful change in health-related quality of life. , 2003, Journal of clinical epidemiology.

[6]  P. Greenbaum,et al.  Five methods for computing significant individual client change and improvement rates: support for an individual growth curve approach. , 1995, Journal of consulting and clinical psychology.

[7]  G. Guyatt,et al.  The impact of measuring patient-reported outcomes in clinical practice: a systematic review of the literature , 2008, Quality of Life Research.

[8]  David Moher,et al.  Reporting of patient-reported outcomes in randomized trials: the CONSORT PRO extension. , 2013, JAMA.

[9]  G H Guyatt,et al.  Determining a minimal important change in a disease-specific Quality of Life Questionnaire. , 1994, Journal of clinical epidemiology.

[10]  G. Guyatt,et al.  Measuring disease-specific quality of life in clinical trials. , 1986, CMAJ : Canadian Medical Association journal = journal de l'Association medicale canadienne.

[11]  A. Gnanasakthy,et al.  Patient reported outcomes: looking beyond the label claim , 2010, Health and quality of life outcomes.

[12]  J. Larsson,et al.  Health and Quality of Life Outcomes , 2005 .

[13]  David Moher,et al.  Consolidated standards of reporting trials (CONSORT) and the completeness of reporting of randomised controlled trials (RCTs) published in medical journals. , 2012, The Cochrane database of systematic reviews.

[14]  G. Guyatt,et al.  Evaluating the credibility of anchor based estimates of minimal important differences for patient reported outcomes: instrument development and reliability study , 2020, BMJ.

[15]  G. Guyatt,et al.  Minimally important difference estimates and methods: a protocol , 2015, BMJ Open.

[16]  A. Bowling,et al.  Just One Question: If One Question Works, Why Ask Several? Single Compared with Multi- Item Measures , 2005 .

[17]  Jacob Cohen Statistical Power Analysis for the Behavioral Sciences , 1969, The SAGE Encyclopedia of Research Design.

[18]  N. Jacobson,et al.  Clinical significance: a statistical approach to defining meaningful change in psychotherapy research. , 1991, Journal of consulting and clinical psychology.

[19]  D. Revicki,et al.  Can Methods Developed for Interpreting Group-level Patient-reported Outcome Data be Applied to Individual Patient Management? , 2019, Medical care.

[20]  D. Altman,et al.  Effect of using reporting guidelines during peer review on quality of final manuscripts submitted to a biomedical journal: masked randomised trial , 2011, BMJ : British Medical Journal.

[21]  U. S. Department of Health and Human Services FDA Cen Research,et al.  Guidance for industry: patient-reported outcome measures: use in medical product development to support labeling claims: draft guidance , 2006, Health and quality of life outcomes.

[22]  G. Guyatt,et al.  Measurement of health status. Ascertaining the minimal clinically important difference. , 1989, Controlled clinical trials.

[23]  D. Gladman,et al.  Methods for assessing responsiveness: a critical review and recommendations. , 2000, Journal of clinical epidemiology.

[24]  G. Norman,et al.  Interpretation of Changes in Health-related Quality of Life: The Remarkable Universality of Half a Standard Deviation , 2003, Medical care.

[25]  G. Guyatt,et al.  Measuring change over time: assessing the usefulness of evaluative instruments. , 1987, Journal of chronic diseases.

[26]  M. Liang,et al.  Relative responsiveness of condition-specific and generic health status measures in degenerative lumbar spinal stenosis. , 1995, Journal of clinical epidemiology.

[27]  C. Terwee,et al.  Mind the MIC: large variation among populations and methods. , 2010, Journal of clinical epidemiology.

[28]  M. King The interpretation of scores from the EORTC quality of life questionnaire QLQ-C30 , 1996, Quality of Life Research.

[29]  M. King A point of minimal important difference (MID): a critique of terminology and methods , 2011, Expert review of pharmacoeconomics & outcomes research.

[30]  E. Roos,et al.  Examining the Minimal Important Difference of Patient-reported Outcome Measures for Individuals with Knee Osteoarthritis: A Model Using the Knee Injury and Osteoarthritis Outcome Score , 2016, The Journal of Rheumatology.

[31]  D. Goldfarb Patients at the centre: in our practice, and in our use of language , 2004, ACP journal club.