Is my patient suffering clinically significant emotional distress? Demonstration of a probabilities approach to evaluating algorithms for screening for distress

Goals of workScreening oncology patients for clinically significant emotional distress is a recommended standard of care in psycho-oncology. However, principles regarding the interpretation of screening and diagnostic tests developed in other areas of medicine have not been widely applied in psycho-oncology. This paper explores the application of the concepts of likelihood ratios and post-test probabilities to the interpretation of psychological screening instruments and demonstrates the development of an algorithm for screening for emotional distress and common psychopathology.Materials and methodsThree hundred forty oncology/haematology outpatients at the Calvary Mater Newcastle, Australia completed the Distress Thermometer (DT), the PSYCH-6 subscale of the Somatic and Psychological Health Report and the Kessler-10 scale. The Hospital Anxiety and Depression Scale (HADS) (cutoff 15+) was used as the gold standard.Main resultsLikelihood ratios showed that a score over threshold on the DT was 2.77 times more likely in patients who were cases on the HADS. These patients had a 53% post-test probability of being cases on the HADS compared with the pretest probability of 29%. Adding either the PSYCH-6 (3+) or the Kessler-10 (22+) to the DT (4+) significantly increased this post-test probability to 94% and 92%, respectively. The significance of these improvements was confirmed by logistic regression analysis.ConclusionsThis study demonstrated the application of probability statistics to develop an algorithm for screening for distress in oncology patients. In our sample, a two-stage screening algorithm improved appreciably on the performance of the DT alone to identify distressed patients. Sequential administration of a very brief instrument followed by selective use of a longer inventory may save time and increase acceptability.

[1]  Jeff Dunn,et al.  The tiered model of psychosocial intervention in cancer: a community based approach , 2006, Psycho-oncology.

[2]  A. Mackinnon,et al.  Combining cognitive testing and informant report to increase accuracy in screening for dementia. , 1998, The American journal of psychiatry.

[3]  A. Mitchell Pooled results from 38 analyses of the accuracy of distress thermometer and other ultra-short methods of detecting cancer-related mood disorders. , 2007, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[4]  A. Mitchell,et al.  Acceptability of common screening methods used to detect distress and related mood disorders—preferences of cancer specialists and non‐specialists , 2008, Psycho-oncology.

[5]  Nils Toft,et al.  7 MEASURES OF ASSOCIATION AND EFFECT , 2004 .

[6]  R. Snaith,et al.  The hospital anxiety and depression scale. , 2013, Acta psychiatrica Scandinavica.

[7]  N. Adler,et al.  Cancer Care for the Whole Patient , 2008 .

[8]  Andrew Mackinnon,et al.  A spreadsheet for the calculation of comprehensive statistics for the assessment of diagnostic tests and inter-rater agreement , 2000, Comput. Biol. Medicine.

[9]  G. Andrews,et al.  Interpreting scores on the Kessler Psychological Distress Scale (K10) , 2001, Australian and New Zealand journal of public health.

[10]  G. Guyatt,et al.  Users' guides to the medical literature. , 1993, JAMA.

[11]  S. Burgess “Users’ Guide to the Medical Literature - A Manual for Evidence Based Clinical Practice”. Edited by Gordon Guyatt and Drummond Rennie, 2002, AMA Press, Chicago, 706 pages , 2003 .

[12]  I. Hickie,et al.  Development of a simple screening tool for common mental disorders in general practice , 2001, The Medical journal of Australia.

[13]  Seth Wolpin,et al.  Depression screening using the Patient Health Questionnaire‐9 administered on a touch screen computer , 2009, Psycho-oncology.

[14]  D. Altman,et al.  Diagnostic tests 4: likelihood ratios , 2004, BMJ : British Medical Journal.

[15]  Trisha Greenhalgh,et al.  How to read a paper: Papers that report diagnostic or screening tests , 1997, BMJ.

[16]  T. T. Haug,et al.  The validity of the Hospital Anxiety and Depression Scale. An updated literature review. , 2002, Journal of psychosomatic research.

[17]  G. Guyatt,et al.  Users' Guides to the Medical Literature: III. How to Use an Article About a Diagnostic Test: B. What Are the Results and Will They Help Me In Caring for My Patients? , 1994 .

[18]  T. J. Fagan,et al.  Nomogram for Bayes's theorem , 1975 .

[19]  C. Gatsonis,et al.  Designing studies to ensure that estimates of test accuracy are transferable , 2002, BMJ : British Medical Journal.

[20]  Quantitative assessments from the clinical examination , 1997, Journal of General Internal Medicine.

[21]  A. House,et al.  Validating automated screening for psychological distress by means of computer touchscreens for use in routine oncology practice , 2001, British Journal of Cancer.

[22]  Fagan Tj Letter: Nomogram for Bayes theorem. , 1975 .

[23]  C. Herrmann International experiences with the Hospital Anxiety and Depression Scale--a review of validation data and clinical results. , 1997, Journal of psychosomatic research.

[24]  Paul F. Griner,et al.  Diagnostic Strategies for Common Medical Problems , 1991 .

[25]  A. Liebetrau Measures of association , 1983 .

[26]  Michael C. Perry,et al.  American Society of Clinical Oncology educational book , 2003 .

[27]  G. Guyatt,et al.  Users' guides to the medical literature. III. How to use an article about a diagnostic test. B. What are the results and will they help me in caring for my patients? The Evidence-Based Medicine Working Group. , 1994, JAMA.

[28]  L. Carlson,et al.  Cancer distress screening. Needs, models, and methods. , 2003, Journal of psychosomatic research.

[29]  T. Ibbotson,et al.  Screening for anxiety and depression in cancer patients: the effects of disease and treatment. , 1994, European journal of cancer.

[30]  J. González,et al.  Use of distress and depression thermometers to measure psychosocial morbidity among southern European cancer patients , 2005, Supportive Care in Cancer.

[31]  Donald R Holleman Jr.,et al.  Quantitative Assessments from the Clinical Examination: How Should Clinicians Integrate the Numerous Results? , 2006, Journal of General Internal Medicine.

[32]  C. Schmid,et al.  Why clinicians are natural bayesians , 2005, BMJ : British Medical Journal.

[33]  John Attia,et al.  Moving beyond sensitivity and specificity: using likelihood ratios to help interpret diagnostic tests , 2003 .

[34]  J. Holland,et al.  Screening for psychologic distress in ambulatory cancer patients , 2005, Cancer.