Goal attainment scaling as an outcome measure in rare disease trials: a conceptual proposal for validation

BackgroundGoal Attainment Scaling (GAS) is an instrument that is intended to evaluate the effect of an intervention by assessing change in daily life activities on an individual basis. However, GAS has not been validated adequately in an RCT setting. In this paper we propose a conceptual validation plan of GAS in the setting of rare disease drug trials, and describe a hypothetical trial where GAS could be validated.MethodsWe have used the COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) taxonomy to deduce which measurement properties of GAS can be evaluated, and how. As individual GAS scores cannot be interpreted outside the context of a RCT, the validation of GAS needs to be done on trial as well as on individual level.ResultsThe procedure of GAS consists of three steps. For the step of goal selection (step 1) and definition of levels of attainment (step 2), face validity may be assessed by clinical experts. For the evaluation of the goal attainment (step 3), the inter and intra rater reliability can be evaluated on an individual level. Construct validity may be evaluated by comparison with change scores on other instruments measuring in the same domain as particular goals, if available, and by testing hypotheses about differences between groups. A difference in mean GAS scores between a group who received an efficacious intervention and a control group is an indication of well-chosen goals, and corroborates construct validity of GAS on trial level. Responsiveness of GAS cannot be evaluated due to the nature of the construct being assessed.ConclusionGAS may be useful as an instrument to assess functional change as an outcome measure in heterogeneous chronic rare diseases, but it can only be interpreted and validated when used in RCTs with blinded outcome assessment. This proposed theoretical validation plan can be used as a starting point to validate GAS in specific conditions.

[1]  A. Myers,et al.  Clinical Experience with Goal Attainment Scaling in Geriatric Care , 1999, Journal of aging and health.

[2]  L. Turner-Stokes,et al.  Results from the Upper Limb International Spasticity Study-II (ULIS-II): a large, international, prospective cohort study investigating practice and goal attainment following treatment with botulinum toxin A in real-life clinical management , 2013, BMJ Open.

[3]  Goal attainment scaling: An idiosyncratic method to assess treatment effectiveness in agoraphobia , 1993 .

[4]  S Urach,et al.  Statistical analysis of Goal Attainment Scaling endpoints in randomised trials , 2018, Statistical methods in medical research.

[5]  A. Law,et al.  Goal-attainment scaling: a review and applications to pharmacy practice. , 2012, Research in social & administrative pharmacy : RSAP.

[6]  Michael D. Toland,et al.  Goal Attainment Scaling as an Outcome Measure in Randomized Controlled Trials of Psychosocial Interventions in Autism , 2012, Journal of Autism and Developmental Disorders.

[7]  D. Steenbeek,et al.  Goal Attainment Scaling in paediatric rehabilitation: a report on the clinical training of an interdisciplinary team. , 2008, Child: care, health and development.

[8]  Jonathan J. Evans,et al.  Proposed Criteria for Appraising Goal Attainment Scales Used as Outcome Measures in Rehabilitation Research. , 2016, Archives of physical medicine and rehabilitation.

[9]  Bruno Falissard,et al.  The improved Clinical Global Impression Scale (iCGI): development and validation in depression , 2007, BMC psychiatry.

[10]  Donald B. Rubin,et al.  The Dependability of Behavioral Measurements: Theory of Generalizability for Scores and Profiles. , 1974 .

[11]  Ralf Dresner,et al.  Health Measurement Scales A Practical Guide To Their Development And Use , 2016 .

[12]  G. Lankhorst,et al.  The effect of botulinum toxin type A treatment of the lower extremity on the level of functional abilities in children with cerebral palsy: evaluation with goal attainment scaling , 2005, Clinical rehabilitation.

[13]  Hilde van der Togt,et al.  Publisher's Note , 2003, J. Netw. Comput. Appl..

[14]  Eva Nick,et al.  The dependability of behavioral measurements: theory of generalizability for scores and profiles , 1973 .

[15]  K. Rockwood,et al.  Responsiveness of goal attainment scaling in a randomized controlled trial of comprehensive geriatric assessment. , 2003, Journal of clinical epidemiology.

[16]  I. Wilson,et al.  Linking clinical variables with health-related quality of life. A conceptual model of patient outcomes. , 1995, JAMA.

[17]  T. Brümmendorf,et al.  Development of a disease-specific quality of life questionnaire for patients with aplastic anemia and/or paroxysmal nocturnal hemoglobinuria (QLQ-AA/PNH)—report on phases I and II , 2016, Annals of Hematology.

[18]  Lynne Turner-Stokes,et al.  Goal attainment scaling (GAS) in rehabilitation: a practical guide , 2009, Clinical rehabilitation.

[19]  D. Steenbeek,et al.  Responsiveness of Goal Attainment Scaling in comparison to two standardized measures in outcome evaluation of children with cerebral palsy , 2011, Clinical rehabilitation.

[20]  D. Steenbeek,et al.  Goal attainment scaling in paediatric rehabilitation: a critical review of the literature , 2007, Developmental medicine and child neurology.

[21]  J. H. van der Lee,et al.  A systematic review to investigate the measurement properties of goal attainment scaling, towards use in drug trials , 2016, BMC Medical Research Methodology.

[22]  S. Wood-Dauphinée,et al.  The Balance Scale: reliability assessment with elderly residents and patients with an acute stroke. , 1995, Scandinavian journal of rehabilitation medicine.

[23]  J. R. Landis,et al.  The measurement of observer agreement for categorical data. , 1977, Biometrics.

[24]  C. Terwee,et al.  Rating the methodological quality in systematic reviews of studies on measurement properties: a scoring system for the COSMIN checklist , 2011, Quality of Life Research.

[25]  S. Cano,et al.  Measuring what matters to rare disease patients – reflections on the work by the IRDiRC taskforce on patient-centered outcome measures , 2017, Orphanet Journal of Rare Diseases.

[26]  W. G. Mills,et al.  A standardized menu for Goal Attainment Scaling in the care of frail elders. , 1998, The Gerontologist.

[27]  Solomon Cytrynbaum,et al.  Goal Attainment Scaling , 1979 .

[28]  T. Fleming,et al.  Biomarkers and surrogate endpoints in clinical trials , 2012, Statistics in medicine.

[29]  D. Wade,et al.  Writing SMART rehabilitation goals and achieving goal attainment scaling: a practical guide , 2009, Clinical rehabilitation.

[30]  Caroline B. Terwee,et al.  Measurement in Medicine: Index , 2011 .

[31]  C. Terwee,et al.  The COSMIN checklist for assessing the methodological quality of studies on measurement properties of health status measurement instruments: an international Delphi study , 2010, Quality of Life Research.

[32]  A. Tennant.  Goal attainment scaling: Current methodological challenges , 2007, Disability and rehabilitation.

[33]  P. Stolee,et al.  A multi-site study of the feasibility and clinical utility of Goal Attainment Scaling in geriatric day hospitals , 2012, Disability and rehabilitation.

[34]  Robert W. Taylor,et al.  Prevalence of mitochondrial DNA disease in adults , 2008, Annals of neurology.

[35]  Caroline B. Terwee,et al.  Measurement in Medicine: A Practical Guide , 2011 .

[36]  C. Terwee,et al.  On assessing responsiveness of health-related quality of life instruments: Guidelines for instrument evaluation , 2003, Quality of Life Research.

[37]  Goal Attainment Scaling , 2000 .

[38]  Thomas J. Kiresuk,et al.  Goal attainment scaling: A general method for evaluating comprehensive community mental health programs , 1968, Community Mental Health Journal.

[39]  D. Turnbull,et al.  Mitochondrial disease in adults: A scale to monitor progression and treatment , 2006, Neurology.

[40]  S. Targum,et al.  The clinical global impressions scale: applying a research tool in clinical practice. , 2007, Psychiatry (Edgmont (Pa. : Township)).