Interpreting Patient-reported Outcome Scores for Clinical Research and Practice: Definition, Determination, and Application of Cutpoints

Objectives: Cutpoints are specific numeric values used to create discrete categories for patient-reported outcome (PRO) items or scales. Cutpoints are widely used in both clinical research and practice. This article offers a definition for cutpoints, describes strategies for determining actionable cutpoints, and discusses considerations related to interpreting cutpoints in clinical applications. Methods: We clarify the definition of cutpoints for PRO measures and summarize the major statistical approaches for identifying cutpoints, including multivariate analysis of variance and receiver operating characteristic and regression modeling. Discussion: We review issues related to cutpoint determination and interpretation that should be considered when integrating PROs into clinical research and practice, including the selection of anchors, variability of cutpoints, and clinical burden that may be generated when a cutpoint is used as a threshold for further clinical action. Key Points: Cutpoints are widely used to categorize PRO responses in both clinical research and practice. Cutpoints can be derived for PRO measures regardless of the response scale used; however, the mild, moderate, and severe categories generated from numeric cutpoints are distinct from the mild, moderate, and severe categories found in some PRO measures that use verbal descriptors as response options. Bootstrap analysis is recommended to quantify the variability of cutpoints. The application of cutpoints is limited by how well the anchors are chosen and how cutpoints developed using group-level data are applied at the individual level.

[1]  W. Maixner,et al.  Relationship of ethnicity, gender, and ambulatory blood pressure to pain sensitivity: effects of individualized pain rating scales. , 2004, The journal of pain : official journal of the American Pain Society.

[2]  S. Paul,et al.  Categorizing the severity of cancer pain: further exploration of the establishment of cutpoints , 2005, Pain.

[3]  Jonathan Sussman,et al.  Do high symptom scores trigger clinical actions? An audit after implementing electronic symptom screening. , 2012, Journal of oncology practice.

[4]  J. Strong,et al.  Establishment of cutpoints to categorize the severity of chronic pain using composite ratings with Rasch analysis , 2017, European journal of pain.

[5]  P. White.  Stedman's Medical Dictionary for the Health Professions and Nursing (6th edition) , 2009 .

[6]  B. Given,et al.  Establishing mild, moderate, and severe scores for cancer-related symptoms: how consistent and clinically meaningful are interference-based severity cut-points? , 2008, Journal of pain and symptom management.

[7]  J. Squires,et al.  Determining Cutoff Scores on a Developmental Screening Measure: Use of Receiver Operating Characteristics and Item Response Theory , 2006 .

[8]  K. Bjordal,et al.  Differences in the use of pain coping strategies between oncology inpatients with mild vs. moderate to severe pain. , 2009, Journal of pain and symptom management.

[9]  V. Johnson,et al.  Impact of cultural and linguistic factors on symptom reporting by patients with cancer. , 2010, Journal of the National Cancer Institute.

[10]  D. Ehde,et al.  Pain site and the effects of amputation pain: further clarification of the meaning of mild, moderate, and severe pain , 2001, Pain.

[11]  C. Cleeland,et al.  Assessment of clinical relevant fatigue level in cancer , 2007, Supportive Care in Cancer.

[12]  Gordon H Guyatt,et al.  Methods to explain the clinical significance of health status measures. , 2002, Mayo Clinic proceedings.

[13]  C. Cleeland,et al.  Validation of brief pain inventory to Brazilian patients with pain , 2010, Supportive Care in Cancer.

[14]  Nancy A Obuchowski,et al.  Receiver operating characteristic (ROC) curves: review of methods with applications in diagnostic medicine , 2018, Physics in medicine and biology.

[15]  K. Anderson.  Role of cutpoints: why grade pain intensity? , 2005, Pain.

[16]  Xuelei Ma,et al.  The diagnostic role of a short screening tool—the distress thermometer: a meta-analysis , 2014, Supportive Care in Cancer.

[17]  K. Ding,et al.  Revisiting classification of pain from bone metastases as mild, moderate, or severe based on correlation with function and quality of life , 2016, Supportive Care in Cancer.

[18]  C. Cleeland,et al.  Assessment of Fatigue in Cancer Patients and Community Dwellers: Validation Study of the Filipino Version of the Brief Fatigue Inventory , 2010, Oncology.

[19]  Douglas G Altman,et al.  Dichotomizing continuous predictors in multiple regression: a bad idea , 2006, Statistics in medicine.

[20]  W. T. van der Graaf,et al.  A Specific Distress Cutoff Score Shortly After Breast Cancer Diagnosis , 2017, Cancer nursing.

[21]  E. Chow,et al.  What should be the optimal cut points for mild, moderate, and severe pain? , 2007, Journal of palliative medicine.

[22]  A. Beck,et al.  Beck Depression Inventory–II , 2011 .

[23]  Katherine R. Edwards,et al.  When is cancer pain mild, moderate or severe? Grading pain severity by its interference with function , 1995, Pain.

[24]  H. Soliman,et al.  Cut points for mild, moderate, and severe pain among cancer and non-cancer patients: a literature review. , 2015, Annals of Palliative Medicine.

[25]  C. Cleeland,et al.  Russian Brief Pain Inventory: validation and application in cancer pain. , 2008, Journal of pain and symptom management.

[26]  Augusto Caraceni,et al.  Studies comparing Numerical Rating Scales, Verbal Rating Scales, and Visual Analogue Scales for assessment of pain intensity in adults: a systematic literature review. , 2011, Journal of pain and symptom management.

[27]  David Cella,et al.  Prevalence and characteristics of moderate to severe fatigue: A multicenter study in cancer patients and survivors , 2014, Cancer.

[28]  P. Brown,et al.  Working plan for the use of patient-reported outcome measures in adults with brain tumours: a Response Assessment in Neuro-Oncology (RANO) initiative. , 2018, The Lancet. Oncology.

[29]  M. Kris,et al.  Overall Survival Results of a Trial Assessing Patient-Reported Outcomes for Symptom Monitoring During Routine Cancer Treatment , 2017, JAMA.

[30]  Laura M J Hochstenbach,et al.  Update on Prevalence of Pain in Patients With Cancer: Systematic Review and Meta-Analysis. , 2016, Journal of pain and symptom management.

[31]  W. Sauerbrei,et al.  Confidence intervals for the effect of a prognostic factor after selection of an ‘optimal’ cutpoint , 2004, Statistics in medicine.

[32]  M. Edelen,et al.  Correspondence of verbal descriptor and numeric rating scales for pain intensity: an item response theory calibration. , 2010, The journals of gerontology. Series A, Biological sciences and medical sciences.

[33]  D. Selby,et al.  A single set of numerical cutpoints to define moderate and severe symptoms for the Edmonton Symptom Assessment System. , 2010, Journal of pain and symptom management.

[34]  A. Abernethy,et al.  Hazards for pain severity and pain interference with daily living, with exploration of brief pain inventory cutpoints, among women with metastatic breast cancer. , 2007, Journal of pain and symptom management.

[35]  S. Pluijm,et al.  The distress thermometer provides a simple screening tool for selecting distressed childhood cancer survivors , 2018, Acta paediatrica.

[36]  J. Hanley,et al.  The meaning and use of the area under a receiver operating characteristic (ROC) curve. , 1982, Radiology.

[37]  W. Youden,et al.  Index for rating diagnostic tests , 1950, Cancer.

[38]  Qiuling Shi,et al.  Automated symptom alerts reduce postoperative symptom severity after cancer surgery: a randomized controlled clinical trial. , 2011, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[39]  G. Hirschfeld,et al.  Variability of “optimal” cut points for mild, moderate, and severe pain: Neglected problems when comparing groups , 2013, PAIN®.

[40]  C. Cleeland,et al.  Validation study of the korean version of the brief fatigue inventory. , 2005, Journal of pain and symptom management.

[41]  C. Benedetti,et al.  Adult cancer pain. , 2010, Journal of the National Comprehensive Cancer Network : JNCCN.

[42]  K. Cropsey,et al.  Determining the optimal clinical cutoff on the CES-D for depression in a community corrections sample. , 2018, Journal of affective disorders.

[43]  Katja Wiech,et al.  Deconstructing the sensation of pain: The influence of cognitive processes on pain perception , 2016, Science.

[44]  C. Cleeland,et al.  Determination of mild, moderate, and severe pain interference in patients with cancer , 2017, Pain.

[45]  C. Cleeland,et al.  Asking the community about cutpoints used to describe mild, moderate, and severe pain. , 2006, The journal of pain : official journal of the American Pain Society.