Performance Monitoring and Competence Assessment in Health Services

Health and health service monitoring is among the most promising research area today and the world work towards efficient and cost effective health care. This paper deals with monitoring health service performance using more than one performance outcome variable (multi-attribute processes), which is common in most health services. Although monitoring whether a health service changes or improves over time is important this is well covered in the current literature. Therefore this paper focuses on comparing similar health services in terms of their performance. The proposed procedure is based on an appropriate control chart. The paper deals with firstly the case when no risk adjustment is required because the health services being compared treat the same patient case-mix which does not vary over time. Secondly it deals with comparing health services where risk adjustment is required because the patient case-mix they service do differ because they service either very different geographical locations or service very different demographics of the same population. The technology developed in this paper could be used for example to assess and compare health practitioners’ competence over time, i.e. to decide if two doctors are equivalent in terms of their outcome performances. The waiting time random variable associated with the run length distribution of the control charts (as well as to competence testing) is studied using a Markov Chain embedding technique. Numerical results are provided that exhibit the value of the proposed procedures.

[1]  Antoine Duclos,et al.  Patient- and surgeon-adjusted control charts for monitoring performance , 2014, BMJ Open.

[2]  Douglas C. Montgomery,et al.  Some Current Directions in the Theory and Application of Statistical Process Monitoring , 2014 .

[3]  Vern T. Farewell,et al.  An overview of risk‐adjusted charts , 2004 .

[4]  William H. Woodall,et al.  Control Charts Based on Attribute Data: Bibliography and Review , 1997 .

[5]  Artur Dubrawski,et al.  The Role of Data Aggregation in Public Health and Food Safety Surveillance , 2010 .

[6]  Min Zhang,et al.  Exponential CUSUM Charts with Estimated Control Limits , 2014, Qual. Reliab. Eng. Int..

[7]  S. Bersimis,et al.  Run and Frequency Quota Rules in Process Monitoring and Acceptance Sampling , 2009 .

[8]  Jaime A. Camelio,et al.  The Effect of Aggregating Data When Monitoring a Poisson Process , 2013 .

[9]  T. Papaioannou,et al.  Flexible designs for phase II comparative clinical trials involving two response variables , 2015, Statistics in medicine.

[10]  F. Sturmans,et al.  Competence and performance: two different concepts in the assessment of quality of medical care. , 1990, Family practice.

[11]  William H. Woodall,et al.  Methods for Monitoring Multiple Proportions When Inspecting Continuously , 2011 .

[12]  Athanasios C. Rakitzis,et al.  The Modified r Out of m Control Chart , 2008, Commun. Stat. Simul. Comput..

[13]  Stelios Psarakis,et al.  Review of multinomial and multiattribute quality control charts , 2009, Qual. Reliab. Eng. Int..

[14]  S. Steiner,et al.  Monitoring surgical performance using risk-adjusted cumulative sum charts. , 2000, Biostatistics.

[15]  M. Koutras,et al.  Improving the Performance of the Chi-square Control Chart via Runs Rules , 2006 .

[16]  Marion R. Reynolds,et al.  Should Observations Be Grouped for Effective Process Monitoring? , 2004 .

[17]  Sheila A Ryan,et al.  The use of aggregate data for measuring practice improvement. , 2002, Seminars for nurse managers.

[18]  Petros E. Maravelakis,et al.  Statistical Process Control using Shewhart Control Charts with Supplementary Runs Rules , 2007 .

[19]  Xiang Zhang,et al.  Dynamic probability control limits for risk‐adjusted Bernoulli CUSUM charts , 2015, Statistics in medicine.

[20]  Landon H. Sego,et al.  Risk‐adjusted monitoring of survival times , 2009, Statistics in medicine.

[21]  M. R. Reynolds,et al.  A general approach to modeling CUSUM charts for a proportion , 2000 .

[22]  Kwok-Leung Tsui,et al.  A Review of Healthcare, Public Health, and Syndromic Surveillance , 2008 .

[23]  T. Lim,et al.  Assessing doctors' competence: application of CUSUM technique in monitoring doctors' performance. , 2002, International journal for quality in health care : journal of the International Society for Quality in Health Care.

[24]  Douglas C. Montgomery,et al.  Introduction to Statistical Quality Control , 1986 .

[25]  H. Burkom,et al.  Role of data aggregation in biosurveillance detection strategies with applications from ESSENCE. , 2004, MMWR supplements.