Instruments Measuring Integrated Care: A Systematic Review of Measurement Properties.

Policy Points: Investigations on systematic methodologies for measuring integrated care should coincide with the growing interest in this field of research. A systematic review of instruments provides insights into integrated care measurement, including setting the research agenda for validating available instruments and informing the decision to develop new ones. This study is the first systematic review of instruments measuring integrated care with an evidence synthesis of the measurement properties. We found 209 index instruments measuring different constructs related to integrated care; the strength of evidence on the adequacy of the majority of their measurement properties remained largely unassessed. CONTEXT Integrated care is an important strategy for increasing health system performance. Despite its growing significance, detailed evidence on the measurement properties of integrated care instruments remains vague and limited. Our systematic review aims to provide evidence on the state of the art in measuring integrated care. METHODS Our comprehensive systematic review framework builds on the Rainbow Model for Integrated Care (RMIC). We searched MEDLINE/PubMed for published articles on the measurement properties of instruments measuring integrated care and identified eligible articles using a standard set of selection criteria. We assessed the methodological quality of every validation study reported using the COSMIN checklist and extracted data on study and instrument characteristics. We also evaluated the measurement properties of each examined instrument per validation study and provided a best evidence synthesis on the adequacy of measurement properties of the index instruments. FINDINGS From the 300 eligible articles, we assessed the methodological quality of 379 validation studies from which we identified 209 index instruments measuring integrated care constructs. The majority of studies reported on instruments measuring constructs related to care integration (33%) and patient-centered care (49%); fewer studies measured care continuity/comprehensive care (15%) and care coordination/case management (3%). We mapped 84% of the measured constructs to the clinical integration domain of the RMIC, with fewer constructs related to the domains of professional (3.7%), organizational (3.4%), and functional (0.5%) integration. Only 8% of the instruments were mapped to a combination of domains; none were mapped exclusively to the system or normative integration domains. The majority of instruments were administered to either patients (60%) or health care providers (20%). Of the measurement properties, responsiveness (4%), measurement error (7%), and criterion (12%) and cross-cultural validity (14%) were less commonly reported. We found <50% of the validation studies to be of good or excellent quality for any of the measurement properties. Only a minority of index instruments showed strong evidence of positive findings for internal consistency (15%), content validity (19%), and structural validity (7%); with moderate evidence of positive findings for internal consistency (14%) and construct validity (14%). CONCLUSIONS Our results suggest that the quality of measurement properties of instruments measuring integrated care is in need of improvement with the less-studied constructs and domains to become part of newly developed instruments.

[1]  T. Gelsema,et al.  The Consumer Quality Index Hip Knee Questionnaire measuring patients' experiences with quality of care after a total hip or knee arthroplasty , 2007, BMC Health Services Research.

[2]  Caroline B. Terwee,et al.  Measurement in Medicine: Index , 2011 .

[3]  S. Wait,et al.  Integrated care: a guide for policymakers. , 2006 .

[4]  Michelle Fiander,et al.  THE EFFECT OF ENGLISH-LANGUAGE RESTRICTION ON SYSTEMATIC REVIEW-BASED META-ANALYSES: A SYSTEMATIC REVIEW OF EMPIRICAL STUDIES , 2012, International Journal of Technology Assessment in Health Care.

[5]  L. Cash-Gibson,et al.  Project INTEGRATE - a common methodological approach to understand integrated health care in Europe , 2014, International journal of integrated care.

[6]  A. Frølich,et al.  Instruments to assess integrated care: a systematic review , 2014, International journal of integrated care.

[7]  Robbert Huijsman,et al.  The implementation of integrated care: the empirical validation of the Development Model for Integrated Care , 2011, BMC health services research.

[8]  Kris Vanhaecht,et al.  An in-depth analysis of theoretical frameworks for the study of care coordination , 2013, International journal of integrated care.

[9]  M. Strandberg-Larsen,et al.  Measurement of integrated healthcare delivery: a systematic review of methods and future research directions , 2009, International journal of integrated care.

[10]  Nick Goodwin,et al.  Understanding integrated care: a complex process, a fundamental principle , 2013, International journal of integrated care.

[11]  Pim P Valentijn,et al.  Understanding integrated care: a comprehensive conceptual framework based on the integrative functions of primary care , 2013, International journal of integrated care.

[12]  G. Wistow,et al.  Inter-agency services in England and The Netherlands. A comparative study of integrated care development and delivery. , 1999, Health policy.

[13]  M. Minkman.  Developing integrated care. Towards a development model for integrated care , 2012, International Journal of Integrated Care.

[14]  Nelly D. Oelke,et al.  Health systems integration: state of the evidence , 2009, International journal of integrated care.

[15]  D. Mannino,et al.  Ageing and the epidemiology of multimorbidity , 2014, European Respiratory Journal.

[16]  Edward H. Wagner,et al.  A Survey of Leading Chronic Disease Management Programs: Are They Consistent with the Literature? , 2002, Managed care quarterly.

[17]  Blessing Mberu,et al.  Global population trends and policy options , 2012, The Lancet.

[18]  Gina Browne,et al.  Conceptualization and measurement of integrated human service networks for evaluation , 2007, International journal of integrated care.

[19]  Jeroen N. Struijs,et al.  Towards a taxonomy for integrated care: a mixed-methods study , 2015, International journal of integrated care.

[20]  A. Berendsen,et al.  Assessment of patient's experiences across the interface between primary and secondary care: Consumer Quality Index Continuum of care. , 2009, Patient education and counseling.

[21]  S M Shortell,et al.  Conceptualizing and measuring integration: findings from the health systems integration study. , 1993, Hospital & health services administration.

[22]  A. Donabedian.  Evaluating the quality of medical care. 1966. , 1966, The Milbank quarterly.

[23]  P. Younger.  Stedman's Medical Dictionary for the Health Professions and Nursing (Illustrated 5th edition) , 2005 .

[24]  E. Nolte,et al.  APPROACHES TO CHRONIC DISEASE MANAGEMENT EVALUATION IN USE IN EUROPE: A REVIEW OF CURRENT METHODS AND PERFORMANCE MEASURES , 2012, International Journal of Technology Assessment in Health Care.

[25]  M. Strandberg-Larsen.  Measuring integrated care. , 2011, Danish medical bulletin.

[26]  Dennis L Kodner,et al.  All together now: a conceptual exploration of integrated care. , 2009, Healthcare quarterly.

[27]  Abdullah Alkenizan,et al.  Innovative care for chronic conditions: building blocks for action , 2004, Annals of Saudi Medicine.

[28]  Michael J. Zickar,et al.  Measurement Theory in Action: Case Studies and Exercises , 2004 .

[29]  D. Berwick,et al.  The triple aim: care, health, and cost. , 2008, Health affairs.

[30]  L. Burns,et al.  Integrated delivery networks: a detour on the road to integrated health care? , 2002, Health affairs.

[31]  S. Shortell,et al.  Interpretations of integration in early accountable care organizations. , 2012, The Milbank quarterly.

[32]  D. Delnoij,et al.  Patients' experiences with quality of hospital care: the Consumer Quality Index Cataract Questionnaire , 2007, BMC ophthalmology.

[33]  Stephen M Shortell,et al.  Primary care and accountable care--two essential elements of delivery-system reform. , 2009, The New England journal of medicine.

[34]  Jordi Alonso,et al.  The COSMIN checklist for evaluating the methodological quality of studies on measurement properties: A clarification of its content , 2010, BMC medical research methodology.

[35]  Liset Grooten,et al.  Identification of mechanisms enabling integrated care for patients with chronic diseases: a literature review , 2014, International journal of integrated care.

[36]  M. Fleury,et al.  Divergent modes of integration: the Canadian way , 2011, International journal of integrated care.

[37]  Walter Leutz,et al.  Reflections on Integrating Medical and Social Care: Five , 2005 .

[38]  Alan D. Lopez,et al.  The Global Burden of Disease Study , 2003 .

[39]  C. Haigh,et al.  The myth of patient centrality in integrated care: the case of back pain services , 2007, International journal of integrated care.

[40]  G. Freeman,et al.  Developing a 'consultation quality index' (CQI) for use in general practice. , 2000, Family practice.

[41]  A. Kramer,et al.  Development and testing of a measure designed to assess the quality of care transitions , 2002, International journal of integrated care.

[42]  H. Kluge.  Developing a regional action framework for coordinated/ integrated Health Services Delivery (CIHSD) in the WHO European region , 2013 .

[43]  C. Spreeuwenberg,et al.  Integrated care: meaning, logic, applications, and implications – a discussion paper , 2002, International journal of integrated care.

[44]  Stephen M. Shortell,et al.  Health care reform requires accountable care systems. , 2008, JAMA.

[45]  Ingrid M. Nembhard,et al.  Measuring Teamwork in Health Care Settings: A Review of Survey Instruments , 2014, Medical care.

[46]  O. Damman,et al.  Towards more patient centred healthcare: A new Consumer Quality Index instrument to assess patients' experiences with breast care. , 2009, European journal of cancer.

[47]  E. Fisher,et al.  Creating accountable care organizations: the extended hospital medical staff. , 2006, Health affairs.

[48]  C. Terwee,et al.  Quality criteria were proposed for measurement properties of health status questionnaires. , 2007, Journal of clinical epidemiology.

[49]  Bengt Åhgren.  The Art of Integrating Care: Theories Revisited , 2012 .

[50]  José Maria Paganni,et al.  Evaluating the quality of medical care. , 1966, The Milbank Memorial Fund quarterly.

[51]  Dan J Stein,et al.  Global, regional, and national incidence, prevalence, and years lived with disability for 301 acute and chronic diseases and injuries in 188 countries, 1990–2013: a systematic analysis for the Global Burden of Disease Study 2013 , 2015, The Lancet.

[52]  Andreas Sönnichsen,et al.  Overcoming fragmentation in health care: chronic care in Austria, Germany and the Netherlands , 2012, Health Economics, Policy and Law.

[53]  Runo Axelsson,et al.  Evaluating integrated health care: a model for measurement , 2005, International journal of integrated care.

[54]  C. Terwee,et al.  The COSMIN study reached international consensus on taxonomy, terminology, and definitions of measurement properties for health-related patient-reported outcomes. , 2010, Journal of clinical epidemiology.

[55]  W N Leutz,et al.  Five laws for integrating medical and social services: lessons from the United States and the United Kingdom. , 1999, The Milbank quarterly.

[56]  Elena Rusticelli,et al.  Improved Health System Performance through better Care Coordination , 2007 .

[57]  Bengt Åhgren,et al.  A decade of integration and collaboration: the development of integrated health care in Sweden 2000–2010 , 2011, International journal of integrated care.

[58]  Sara A Kreindler,et al.  Silos and Social Identity: The Social Identity Approach as a Framework for Understanding and Overcoming Divisions in Health Care , 2012, The Milbank quarterly.

[59]  Jenny R. Billings.  What do we Mean by Integrated Care? A European Interpretation , 2005 .

[60]  T. Wiegers,et al.  Measuring client experiences in long-term care in the Netherlands: a pilot study with the Consumer Quality Index Long-term Care , 2010, BMC health services research.

[61]  Lucian Leape,et al.  Defining and Measuring Integrated Patient Care: Promoting the Next Frontier in Health Care Delivery , 2011, Medical care research and review : MCRR.

[62]  C. Terwee,et al.  Development of a methodological PubMed search filter for finding studies on measurement properties of measurement instruments , 2009, Quality of Life Research.

[63]  C. Terwee,et al.  The COSMIN checklist for assessing the methodological quality of studies on measurement properties of health status measurement instruments: an international Delphi study , 2010, Quality of Life Research.

[64]  P. Curtis,et al.  The concept and measurement of continuity in primary care. , 1980, American journal of public health.

[65]  Paul Thomas,et al.  Combined horizontal and vertical integration of care: a goal of practice-based commissioning. , 2008, Quality in primary care.

[66]  Building integrated care Lessons from the UK and elsewhere the voice of NHS leadership , 2005 .

[67]  Niek Klazinga,et al.  Integrated care in an international perspective⋆ , 2002, International journal of integrated care.

[68]  D. Woods,et al.  Medline and Embase complement each other in literature searches , 1998, BMJ.

[69]  Pim P Valentijn,et al.  Towards an international taxonomy of integrated primary care: a Delphi consensus approach , 2015, BMC Family Practice.

[70]  E. Wagner,et al.  Quality of integrated chronic care measured by patient survey: identification, selection and application of most appropriate instruments , 2009, Health expectations : an international journal of public participation in health care and health policy.

[71]  C. Terwee,et al.  Rating the methodological quality in systematic reviews of studies on measurement properties: a scoring system for the COSMIN checklist , 2011, Quality of Life Research.

[72]  Improving cancer patient care: development of a generic cancer consumer quality index questionnaire for cancer patients , 2013, BMC Cancer.

[73]  C. Adair,et al.  Continuity of care: a multidisciplinary review , 2003, BMJ : British Medical Journal.

[74]  Christin Juhnke,et al.  Clinical and service integration. The route to improved outcomes , 2012, International Journal of Integrated Care.

[75]  J. Haggerty,et al.  Validation of instruments to evaluate primary healthcare from the patient perspective: overview of the method. , 2011, Healthcare policy = Politiques de sante.

[76]  Oliver Groene,et al.  Integrated care , 2001, International journal of integrated care.

[77]  Nick Goodwin.  Integrated care as a scientific discipline: the need for more theory and new analytical methods , 2010, International journal of integrated care.

[78]  J. Haggerty,et al.  Interpersonal communication from the patient perspective: comparison of primary healthcare evaluation instruments. , 2011, Healthcare policy = Politiques de sante.

[79]  J. Haggerty,et al.  Accessibility from the patient perspective: comparison of primary healthcare evaluation instruments. , 2011, Healthcare policy = Politiques de sante.

[80]  Lars Edgren,et al.  The meaning of integrated care: a systems approach , 2008, International journal of integrated care.

[81]  Runo Axelsson,et al.  Integration and collaboration in public health--a conceptual framework. , 2006, The International journal of health planning and management.

[82]  H. Vet,et al.  Evaluation of the methodological quality of systematic reviews of health status measurement instruments , 2009, Quality of Life Research.

[83]  J. Haggerty,et al.  Comprehensiveness of care from the patient perspective: comparison of primary healthcare evaluation instruments. , 2011, Healthcare policy = Politiques de sante.

[84]  C. Terwee,et al.  Measurement Properties of Questionnaires Measuring Continuity of Care: A Systematic Review , 2012, PloS one.

[85]  K. McDonald,et al.  A systematic review of the care coordination measurement landscape , 2013, BMC Health Services Research.

[86]  Jennifer Dixon,et al.  A report to the Department of Health and the NHS Future Forum Integrated care for patients and populations: Improving outcomes by working together , 2011 .

[87]  Lawton Robert Burns,et al.  Hospital-physician collaboration: landscape of economic integration and impact on clinical integration. , 2008, The Milbank quarterly.

[88]  Review of quality measures of the most integrated health care settings for children and the need for improved measures: recommendations for initial core measurement set for CHIPRA. , 2011, Academic pediatrics.

[89]  V. Burau,et al.  Care coordination of multimorbidity: a scoping study , 2015, Journal of comorbidity.

[90]  Unfpa and HelpAge.  Ageing in the Twenty-First Century: A Celebration and A Challenge , 2012 .

[91]  J. F. Springer,et al.  THE INSTITUTE OF MEDICINE FRAMEWORK AND ITS IMPLICATION FOR THE ADVANCEMENT OF PREVENTION POLICY , PROGRAMS AND PRACTICE By : , 2007 .

[92]  M. Minkman.  The current state of integrated care: an overview , 2012 .

[93]  S. Flocke.  Measuring attributes of primary care: development of a new instrument. , 1997, The Journal of family practice.

[94]  S. Thomson,et al.  Measuring care coordination: health system and patient perspectives: report prepared for the Main Association of Austrian Social Security Institutions , 2013 .

[95]  M. Lawrence,et al.  Defining and measuring patient‐centred care: an example from a mixed‐methods systematic review of the stroke literature , 2012, Health expectations : an international journal of public participation in health care and health policy.

[96]  Caroline B. Terwee,et al.  Measurement in Medicine: A Practical Guide , 2011 .