Assessing the quality of primary healthcare in seven Chinese provinces with unannounced standardised patients: protocol of a cross-sectional survey

Introduction Primary healthcare (PHC) serves as the cornerstone for the attainment of universal health coverage (UHC). Efforts to promote UHC should focus on the expansion of access and on healthcare quality. However, robust quality evidence has remained scarce in China. Common quality assessment methods such as chart abstraction, patient rating and clinical vignette use indirect information that may not represent real practice. This study will send standardised patients (SP or healthy person trained to consistently simulate the medical history, physical symptoms and emotional characteristics of a real patient) unannounced to PHC providers to collect quality information and represent real practice. Methods and analysis 1981 SP–clinician visits will be made to a random sample of PHC providers across seven provinces in China. SP cases will be developed for 10 tracer conditions in PHC. Each case will include a standard script for the SP to use and a quality checklist that the SP will complete after the clinical visit to indicate diagnostic and treatment activities performed by the clinician. Patient-centredness will be assessed according to the Patient Perception of Patient-Centeredness Rating Scale by the SP. SP cases and the checklist will be developed through a standard protocol and assessed for content, face and criterion validity, and test–retest and inter-rater reliability before its full use. Various descriptive analyses will be performed for the survey results, such as a tabulation of quality scores across geographies and provider types. Ethics and dissemination This study has been reviewed and approved by the Institutional Review Board of the School of Public Health of Sun Yat-sen University (#SYSU 2017-011). Results will be actively disseminated through print and social media, and SP tools will be made available for other researchers.

[1]  Wei Zhou,et al.  Using smartphone-based virtual patients to assess the quality of primary healthcare in rural China: protocol for a prospective multicentre study , 2018, BMJ Open.

[2]  Shengshou Hu,et al.  The primary health-care system in China , 2017, The Lancet.

[3]  S. Rozelle,et al.  Tuberculosis detection and the challenges of integrated care in rural China: A cross-sectional standardized patient study , 2017, PLoS medicine.

[4]  Yang Zhang,et al.  Guideline use behaviours and needs of primary care practitioners in China: a cross-sectional survey , 2017, BMJ Open.

[5]  M. Roland,et al.  Bridging the Gaps Between Patients and Primary Care in China: A Nationwide Representative Survey , 2017, The Annals of Family Medicine.

[6]  A. Bitton,et al.  A systematic tale of two differing reviews: evaluating the evidence on public and private sector quality of primary care in low and middle income countries , 2017, Globalization and Health.

[7]  J. Hanefeld,et al.  Understanding and measuring quality of care: dealing with complexity , 2017, Bulletin of the World Health Organization.

[8]  Leiyu Shi,et al.  Comparison of Primary Care Experiences in Village Clinics with Different Ownership Models in Guangdong Province, China , 2017, PloS one.

[9]  Hannah L Ratcliffe,et al.  Primary Health Care as a Foundation for Strengthening Health Systems in Low- and Middle-Income Countries , 2016, Journal of General Internal Medicine.

[10]  A. Jerant,et al.  Watchful Waiting Strategy May Reduce Low-Value Diagnostic Testing , 2016, The Journal of the American Board of Family Medicine.

[11]  H. Bang,et al.  Promoting Patient-Centered Counseling to Reduce Use of Low-Value Diagnostic Tests: A Randomized Clinical Trial. , 2016, JAMA internal medicine.

[12]  Alan D. Lopez,et al.  Cause-specific mortality for 240 causes in China during 1990–2013: a systematic subnational analysis for the Global Burden of Disease Study 2013 , 2016, The Lancet.

[13]  Y. Hao,et al.  General practitioners versus other physicians in the quality of primary care: a cross-sectional study in Guangdong Province, China , 2015, BMC Family Practice.

[14]  Leiyu Shi,et al.  Changes in the perceived quality of primary care in Shanghai and Shenzhen, China: a difference-in-difference analysis , 2015, Bulletin of the World Health Organization.

[15]  S. Rozelle,et al.  Survey using incognito standardized patients shows poor quality care in China's rural clinics. , 2015, Health policy and planning.

[16]  A. Kalet,et al.  Directly Observed Care: Can Unannounced Standardized Patients Address a Gap in Performance Measurement? , 2014, Journal of General Internal Medicine.

[17]  J. Hammer,et al.  Quality of Primary Care in Low-Income Countries: Facts and Economics , 2014 .

[18]  Chunqing Lin,et al.  Using standardized patients to evaluate hospital-based intervention outcomes. , 2014, International journal of epidemiology.

[19]  D. Elbourne,et al.  Systematic review of the Hawthorne effect: New concepts are needed to study research participation effects☆ , 2014, Journal of clinical epidemiology.

[20]  C. Shisslak,et al.  Assessing culturally competent diabetes care with unannounced standardized patients. , 2013, Family medicine.

[21]  Alaka Holla,et al.  In urban and rural India, a standardized patient study showed low levels of provider training and huge quality gaps. , 2012, Health affairs.

[22]  K. Rhodes,et al.  Simulated patient studies: an ethical analysis. , 2012, The Milbank quarterly.

[23]  S. Parikh,et al.  Training and Validation of Standardized Patients for Unannounced Assessment of Physicians’ Management of Depression , 2011, Academic psychiatry : the journal of the American Association of Directors of Psychiatric Residency Training and the Association for Academic Psychiatry.

[24]  R. Epstein,et al.  Three questions that patients can ask to improve the quality of information physicians give about treatment options: a cross-over trial. , 2011, Patient education and counseling.

[25]  K. Rhodes Taking the mystery out of "mystery shopper" studies. , 2011, The New England journal of medicine.

[26]  M. Blettner,et al.  Concordance analysis: part 16 of a series on evaluation of scientific publications. , 2011, Deutsches Arzteblatt international.

[27]  Sandy Oliver,et al.  Quality of Private and Public Ambulatory Health Care in Low and Middle Income Countries: Systematic Review of Comparative Studies , 2011, PLoS medicine.

[28]  M. Fortin,et al.  Measuring Patients’ Perceptions of Patient-Centered Care: A Systematic Review of Tools for Family Medicine , 2011, The Annals of Family Medicine.

[29]  L. Siminoff,et al.  The advantages and challenges of unannounced standardized patient methodology to assess healthcare communication. , 2011, Patient education and counseling.

[30]  Janet Currie,et al.  Patient Knowledge and Antibiotic Abuse: Evidence from an Audit Study in China , 2010, Journal of health economics.

[31]  A. Kalet,et al.  Can unannounced standardized patients assess professionalism and communication skills in the emergency department? , 2009, Academic emergency medicine : official journal of the Society for Academic Emergency Medicine.

[32]  K. Leonard,et al.  The Quality of Medical Advice in Low-Income Countries , 2008, The journal of economic perspectives : a journal of the American Economic Association.

[33]  M. Reznik,et al.  Can standardised patients reliably assess communication skills in asthma cases? , 2007, Medical education.

[34]  L. Bloomfield,et al.  Reasons to try ‘RIME’ , 2007, Medical education.

[35]  Linda Morrison,et al.  Unannounced standardised patients in real practice: a systematic literature review , 2007, Medical education.

[36]  P. Gertler,et al.  Variations in practice quality in five low-income countries: a conceptual overview. , 2007, Health affairs.

[37]  Richard L Kravitz,et al.  Caught in the act? Prevalence, predictors, and consequences of physician detection of unannounced standardized patients. , 2006, Health services research.

[38]  K. Leonard,et al.  Outpatient process quality evaluation and the Hawthorne Effect. , 2006, Social science & medicine.

[39]  Yongyuth Pongsupap,et al.  Choosing between public and private or between hospital and primary care: responsiveness, patient‐centredness and prescribing patterns in outpatient consultations in Bangkok , 2006, Tropical medicine & international health : TM & IH.

[40]  J. Hammer,et al.  Which doctor? Combining vignettes and item response to measure clinical competence , 2005 .

[41]  J. Hammer,et al.  Money for Nothing: The Dire Straits of Medical Practice in Delhi, India , 2005 .

[42]  J. Rethans,et al.  Fielding incognito standardised patients as ‘known’ patients in a controlled trial in general practice , 2004, Medical education.

[43]  S. Jain,et al.  Assessing the Accuracy of Administrative Data in Health Information Systems , 2004, Medical care.

[44]  A. Hutchinson,et al.  Research methods used in developing and applying quality indicators in primary care , 2002, BMJ : British Medical Journal.

[45]  J. Luck,et al.  Using standardised patients to measure physicians' practice: validation study using audio recordings , 2002, BMJ : British Medical Journal.

[46]  Cees van der Vleuten,et al.  Developing Case‐specific Checklists for Standardized‐patient—Based Assessments in Internal Medicine: A Review of the Literature , 2000, Academic medicine : journal of the Association of American Medical Colleges.

[47]  P. Glassman,et al.  Using standardized patients to measure quality: evidence from the literature and a prospective study. , 2000, The Joint Commission journal on quality improvement.

[48]  M. Stewart,et al.  The impact of patient-centered care on outcomes. , 2000, The Journal of family practice.

[49]  A Donabedian,et al.  The quality of care. How can it be assessed? 1988. , 1997, Archives of pathology & laboratory medicine.

[50]  D. Klass,et al.  Standardized patients' accuracy in recording examinees' behaviors using checklists , 1997, Academic medicine : journal of the Association of American Medical Colleges.

[51]  J. Colliver,et al.  Validating the standardized‐patient assessment administered to medical students in the New York City Consortium , 1997, Academic medicine : journal of the Association of American Medical Colleges.

[52]  J. Mckillip,et al.  Fundamentals of item response theory , 1993 .

[53]  M. Abrahamowicz,et al.  First‐visit bias in the measurement of clinical competence with standardized patients , 1992, Academic medicine : journal of the Association of American Medical Colleges.

[54]  L. Lin Assay Validation Using the Concordance Correlation Coefficient , 1992 .

[55]  H. Barrows,et al.  Standardized (simulated) patients' accuracy in recording clinical performance check‐list items , 1992, Medical education.

[56]  F. Sturmans,et al.  A method for introducing standardized (simulated) patients into general practice consultations. , 1991, The British journal of general practice : the journal of the Royal College of General Practitioners.

[57]  L. Lin,et al.  A concordance correlation coefficient to evaluate reproducibility. , 1989, Biometrics.

[58]  A. Donabedian,et al.  The quality of care. How can it be assessed? , 1988, JAMA.

[59]  D. Steward,et al.  An assessment of the consistency and accuracy of standardized patients' simulations. , 1987, Journal of medical education.

[60]  D. Altman,et al.  STATISTICAL METHODS FOR ASSESSING AGREEMENT BETWEEN TWO METHODS OF CLINICAL MEASUREMENT , 1986, The Lancet.

[61]  C. Woodward,et al.  Measurement of Physician Performance by Standardized Patients: Refining Techniques for Undetected Entry in Physicians' Offices , 1985, Medical care.

[62]  Xiaoxi Li Transforming Our World: The 2030 Agenda for Sustainable Development: An Appeal of Global Cooperation for Building Green Civilization , 2020, Green Civilization.

[63]  Ross Ryan,et al.  The 2030 Agenda for Sustainable Development , 2015, An Insider's Guide to the UN.

[64]  L. Qi Analyze the development of standardized patient teaching in China by literature review in recent 10 years , 2009 .

[65]  Julio Frenk,et al.  A WHO Framework for Health System Performance Assessment , 2001 .

[66]  S. van der Linden,et al.  How to introduce incognito standardized patients into outpatient clinics of specialists in rheumatology. , 2001, Medical teacher.

[67]  J. W. Lewis,et al.  A note on concordance correlation coefficient. , 2000, PDA journal of pharmaceutical science and technology.