Causal variables, indicator variables and measurement scales: an example from quality of life

There is extensive literature on the development and validation of multi‐item measurement scales. Much of this is based on principles derived from psychometric theory and assumes that the individual items form parallel tests, so that simple weighted or unweighted summation is an appropriate method of aggregation. More recent work either continues to promulgate these methods or places emphasis on modern techniques centred on item response theory. In fact, however, clinical measuring instruments often have different underlying principles, so adopting such approaches is inappropriate. We illustrate, using health‐related quality of life, that clinimetric and psychometric ideas need to be combined to yield a suitable measuring instrument. We note the fundamental distinction between indicator and causal variables and propose that this distinction suffices to explain fully the need for both clinimetric and psychometric techniques, and identifies their respective roles in scale development, validation and scoring.

[1]  J L Hutton,et al.  Assessing the potential for bias in meta-analysis due to selective reporting of subgroup analyses within studies. , 2000, Statistics in medicine.

[2]  A. Nolan,et al.  Conceptual and Methodological Issues Related to Welfare Assessment: A Framework for Measurement , 2001 .

[3]  David J. Bartholomew,et al.  The Statistical Approach to Social Measurement , 1996 .

[4]  D. Hand,et al.  Causal indicators in quality of life research , 1997, Quality of Life Research.

[5]  L. Guttman A basis for scaling qualitative data. , 1944 .

[6]  P M Fayers,et al.  Measuring and analysing quality of life in cancer clinical trials: a review. , 1983, Statistics in medicine.

[7]  J Alonso,et al.  Scaling the Spanish version of the Nottingham Health Profile: evidence of limited value of item weights. , 1996, Journal of clinical epidemiology.

[8]  M Johannesson,et al.  Interpretation of change scores in ordinal clinical scales and health status measures: the whole may not equal the sum of the parts. , 1996, Journal of clinical epidemiology.

[9]  D. Sackett Evidence-Based Medicine: How to Practice and Teach EBM , 2018 .

[10]  A Coulter,et al.  Evidence for the sensitivity of the SF-36 health status measure to inequalities in health: results from the Oxford healthy lifestyles survey. , 1996, Journal of epidemiology and community health.

[11]  D. Streiner,et al.  Health Measurement Scales: A practical guide to thier development and use , 1989 .

[12]  C. Bombardier,et al.  Clinimetric and psychometric strategies for development of a health measurement scale. , 1999, Journal of clinical epidemiology.

[13]  L. Cronbach Coefficient alpha and the internal structure of tests , 1951 .

[14]  Patrick D. Wall,et al.  Acute pain in an emergency clinic: Latency of onset and descriptor patterns related to different injuries , 1982, Pain.

[15]  G Dunn,et al.  Statistics and the nature of depression , 1993, Psychological Medicine.

[16]  D. Feeny,et al.  Multiattribute utility function for a comprehensive health status classification system. Health Utilities Index Mark 2. , 1996, Medical care.

[17]  P. Fayers,et al.  A 12 country field study of the EORTC QLQ-C30 (version 3.0) and the head and neck cancer specific module (EORTC QLQ-H&N35) in head and neck patients. EORTC Quality of Life Group. , 2000, European journal of cancer.

[18]  Abraham S. Levine,et al.  A Technique for Developing Suppression Tests , 1952 .

[19]  Howard Wainer,et al.  Estimating Coefficients in Linear Models: It Don't Make No Nevermind , 1976 .

[20]  Alexander Basilevsky,et al.  Statistical Factor Analysis and Related Methods , 1994 .

[21]  P. Williamson,et al.  Bias in meta‐analysis due to outcome variable selection within studies , 2000 .

[22]  H. McGee,et al.  Individual quality of life in patients undergoing hip replacement , 1992, The Lancet.

[23]  J. Olsen,et al.  Some consequences of adopting a conditional deterministic causal model in epidemiology , 1993 .

[24]  M. Dewey,et al.  Depression, depressive symptoms and mortality in persons aged 65 and over living in the community: a systematic review of the literature , 2001, International journal of geriatric psychiatry.

[25]  A M Nolan,et al.  Relationship between physiological factors and clinical pain in dogs scored using a numerical rating scale. , 1998, The Journal of small animal practice.

[26]  S P McKenna,et al.  Weighting the seriousness of perceived health problems using Thurstone's method of paired comparisons. , 1981, International journal of epidemiology.

[27]  C. McHorney,et al.  Evaluation of the MOS SF-36 Physical Functioning Scale (PF-10): II. Comparison of relative precision using Likert and Rasch scoring methods. , 1997, Journal of clinical epidemiology.

[28]  D. Romney,et al.  Toward a general model of health-related quality of life , 1996, Quality of Life Research.

[29]  Andrew Bottomley,et al.  EORTC QLQ-C30 Scoring Manual , 1995 .

[30]  D. Feeny,et al.  Methods for assessing relative importance in preference based outcome measures , 1993, Quality of Life Research.

[31]  C. McHorney,et al.  Evaluation of the MOS SF-36 physical functioning scale (PF-10): I. Unidimensionality and reproducibility of the Rasch item scale. , 1994, Journal of clinical epidemiology.

[32]  D. Hand,et al.  Factor analysis, causal indicators and quality of life , 1997, Quality of Life Research.

[33]  H. Northcott,et al.  Quality of life of patients with end stage renal disease: a structural equation model , 1996, Quality of Life Research.

[34]  David J. Hand,et al.  Statistics and the theory of measurement , 1996 .

[35]  L. Ryan,et al.  Latent Variable Models for Mixed Discrete and Continuous Outcomes , 1997 .

[36]  Graham Dunn,et al.  Review papers : Design and analysis of reliability studies , 1992 .

[37]  M. R. Novick,et al.  Statistical Theories of Mental Test Scores. , 1971 .

[38]  G. Guyatt,et al.  Clinical impact versus factor analysis for quality of life questionnaire construction. , 1997, Journal of clinical epidemiology.

[39]  T M Gill,et al.  A critical appraisal of the quality of quality-of-life measurements. , 1994, JAMA.

[40]  R. Hambleton,et al.  Fundamentals of Item Response Theory , 1991 .

[41]  E. McGlynn,et al.  Part 2: Measuring Quality of Care , 1996 .

[42]  D. Hunter,et al.  Qualitative Research: Consensus methods for medical and health services research , 1995 .

[43]  D J Hand,et al.  Clinical impact versus factor analysis for quality of life questionnaire construction. , 1998, Journal of clinical epidemiology.

[44]  T M Gill,et al.  Quality of Life Assessment: Values and Pitfalls , 1995, Journal of the Royal Society of Medicine.

[45]  G Bury,et al.  A new short form individual quality of life measure (SEIQoL-DW): application in a cohort of individuals with HIV/AIDS , 1996, BMJ.

[46]  H. Wainer,et al.  Differential Item Functioning. , 1994 .

[47]  R. Snaith,et al.  The Hospital Anxiety and Depression Scale , 1983 .

[48]  B. Everitt,et al.  Modelling Covariances and Latent Variables Using EQS , 1993 .

[49]  J. Browne,et al.  Development of a direct weighting procedure for quality of life domains , 1997, Quality of Life Research.

[50]  P. Fayers,et al.  Quality of Life: Assessment, Analysis, and Interpretation , 2000 .

[51]  David R. Cox,et al.  Quality‐Of‐Life Assessment: Can We Keep it Simple? , 1992 .

[52]  H. Blalock Conceptualization and Measurement in the Social Sciences , 1982 .

[53]  D. Bartholomew Latent Variable Models And Factor Analysis , 1987 .

[54]  J. Ware SF-36 health survey: Manual and interpretation guide , 2003 .

[55]  R Milroy,et al.  Quality of life: perception of lung cancer patients. , 1996, European journal of cancer.

[56]  M Ryan,et al.  Using conjoint analysis to elicit preferences for health care , 2000, BMJ : British Medical Journal.

[57]  R. Dawes Judgment under uncertainty: The robust beauty of improper linear models in decision making , 1979 .

[58]  P Tugwell,et al.  The MACTAR Patient Preference Disability Questionnaire--an individualized functional priority approach for assessing improvement in physical disability in clinical trials in rheumatoid arthritis. , 1987, The Journal of rheumatology.

[59]  C. Spearman General intelligence Objectively Determined and Measured , 1904 .

[60]  D. Osoba,et al.  The European Organization for Research and Treatment of Cancer QLQ-C30: a quality-of-life instrument for use in international clinical trials in oncology. , 1993, Journal of the National Cancer Institute.

[61]  Kenneth A. Bollen,et al.  Structural Equations with Latent Variables , 1989 .

[62]  A R Feinstein,et al.  A comparative contrast of clinimetric and psychometric methods for constructing indexes and rating scales. , 1992, Journal of clinical epidemiology.

[63]  P. Fayers,et al.  Quality of life in head and neck cancer patients: validation of the European Organization for Research and Treatment of Cancer Quality of Life Questionnaire-H&N35. , 1999, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[64]  C. Jenkins,et al.  A Structural Analysis of Health-Related Quality of Life Dimensions , 1992 .

[65]  G. Karabatsos,et al.  Validation of the Functional Assessment of Multiple Sclerosis quality of life instrument , 1996, Neurology.

[66]  A. M. Nolan,et al.  Preliminary study on owner-reported behaviour changes associated with chronic pain in dogs , 2001, Veterinary Record.

[67]  Irini Moustaki,et al.  A general class of latent variable models for ordinal manifest variables with covariate effects on the manifest and latent variables. , 2003, The British journal of mathematical and statistical psychology.

[68]  Anastasia E. Raczek,et al.  Comparison of Rasch and summated rating scales constructed from SF-36 physical functioning items in seven countries: results from the IQOLA Project. International Quality of Life Assessment. , 1998, Journal of clinical epidemiology.

[69]  A. Nolan,et al.  Development of a behaviour-based scale to measure acute pain in dogs , 2001, Veterinary Record.