A Review of Some Sampling and Aggregation Strategies for Basic Statistical Process Monitoring

Abstract We review the long-established rational subgrouping principle for determining an effective sampling plan for process monitoring. We present some other general advice that has been given in the literature and discuss some issues related to sampling as it applies to monitoring. Because it is very common to form samples by aggregating data over fixed time intervals, we review the literature on the effect of temporal aggregation on process monitoring performance and provide our perspective. We offer some practical advice and some directions for future research.

[1]  Stefan H. Steiner,et al.  The Monitoring and Improvement of Surgical-Outcome Quality , 2015 .

[2]  Fah Fatt Gan,et al.  Shewhart Charts for Monitoring the Variance Components , 2004 .

[3]  Zachary G. Stoumbos,et al.  A CUSUM Chart for Monitoring a Proportion When Inspecting Continuously , 1999 .

[4]  David Goldsman,et al.  Spaced batch means , 1991, Oper. Res. Lett..

[5]  S. Papavassiliou,et al.  Understanding and Evaluating the Impact of Sampling on Anomaly Detection Techniques , 2006, MILCOM 2006 - 2006 IEEE Military Communications conference.

[6]  Xiuzhen Zhang,et al.  Anomaly detection in online social networks , 2014, Soc. Networks.

[7]  Justin B Dimick,et al.  Optimizing ACS NSQIP modeling for evaluation of surgical quality and risk: patient risk adjustment, procedure mix adjustment, shrinkage adjustment, and surgical focus. , 2013, Journal of the American College of Surgeons.

[8]  Bu Hyoung Lee,et al.  The use of temporally aggregated data on detecting a mean change of a time series process , 2017 .

[9]  Hao Yan,et al.  Image-Based Process Monitoring Using Low-Rank Tensor Decomposition , 2015, IEEE Transactions on Automation Science and Engineering.

[10]  Jaime A. Camelio,et al.  The Effect of Aggregating Data When Monitoring a Poisson Process , 2013 .

[11]  Geert Gins,et al.  Industrial Process Monitoring in the Big Data/Industry 4.0 Era: from Detection, to Diagnosis, to Prognosis , 2017 .

[12]  T. Speroff,et al.  Using real time process measurements to reduce catheter related bloodstream infections in the intensive care unit , 2005, Quality and Safety in Health Care.

[13]  Mazda A. Marvasti,et al.  Cusum techniques for timeslot sequences with applications to network surveillance , 2009, Comput. Stat. Data Anal..

[14]  Shervin Asadzadeh,et al.  Monitoring and Diagnosing Multistage Processes: A Review of Cause Selecting Control Charts , 2008 .

[15]  A. R. Crathorne,et al.  Economic Control of Quality of Manufactured Product. , 1933 .

[16]  Yajun Mei,et al.  An Adaptive Sampling Strategy for Online High-Dimensional Process Monitoring , 2015, Technometrics.

[17]  Ronald J. M. M. Does,et al.  Quality Quandaries: Improving Revenue by Attracting More Clients Online , 2015 .

[18]  William H. Woodall,et al.  An overview and perspective on social network monitoring , 2016, ArXiv.

[19]  Galit Shmueli,et al.  Early statistical detection of anthrax outbreaks by tracking over-the-counter medication sales , 2002, Proceedings of the National Academy of Sciences of the United States of America.

[20]  Víctor Hugo Morales,et al.  Monitoring Aggregated Poisson Data for Processes with Time-Varying Sample Sizes , 2017 .

[21]  Alexander G. Tartakovsky,et al.  Statistical methods for network surveillance , 2018 .

[22]  Stelios Psarakis,et al.  Adaptive Control Charts: Recent Developments and Extensions , 2015, Qual. Reliab. Eng. Int..

[23]  Willis A. Jensen,et al.  Design issues for adaptive control charts , 2008, Qual. Reliab. Eng. Int..

[24]  Emmanuel Yashchin,et al.  Monitoring Variance Components , 1994 .

[25]  J. Benneyan,et al.  Illustration of a Statistical Process Control Approach to Regional Prescription Opioid Abuse Surveillance , 2011, Journal of addiction medicine.

[26]  James R. Evans,et al.  The management and control of quality , 1989 .

[27]  George Tagaras.  A Survey of Recent Developments in the Design of Adaptive Control Charts , 1998 .

[28]  Emmanuel Yashchin.  Statistical Monitoring of Multi-Stage Processes , 2018 .

[29]  Abdur Rahim,et al.  A CCC‐r chart for high‐yield processes , 2001 .

[30]  Anne R. Driscoll,et al.  The effect of temporal aggregation level in social network monitoring , 2018, PloS one.

[31]  Douglas C. Montgomery,et al.  Introduction to Statistical Quality Control , 1986 .

[32]  Sven Knoth,et al.  The Case Against the Use of Synthetic Control Charts , 2016 .

[33]  Douglas C. Montgomery,et al.  Some Current Directions in the Theory and Application of Statistical Process Monitoring , 2014 .

[34]  David J. Marchette,et al.  Scan Statistics on Enron Graphs , 2005, Comput. Math. Organ. Theory.

[35]  Michael Murphy,et al.  Errors in patient specimen collection: application of statistical process control , 2008, Transfusion.

[36]  Rainer Göb,et al.  An Overview of Control Charts for High‐quality Processes , 2016, Qual. Reliab. Eng. Int..

[37]  Ross Sparks,et al.  Detecting and diagnosing hotspots for the enhanced management of hospital emergency departments in Queensland, Australia , 2013, BMC Medical Informatics and Decision Making.

[38]  Layth C. Alwan,et al.  TIME-SERIES INVESTIGATION OF SUBSAMPLE MEAN CHARTS , 1992 .

[39]  Erwin M. Saniga,et al.  Economic Statistical Control-Chart Designs With an Application to and R Charts , 1989 .

[40]  Marcello Pagano,et al.  Effect of spatial resolution on cluster detection: a simulation study , 2007, International journal of health geographics.

[41]  S. Joe Qin,et al.  Statistical process monitoring: basics and beyond , 2003 .

[42]  S. Steiner,et al.  Monitoring surgical performance using risk-adjusted cumulative sum charts. , 2000, Biostatistics.

[43]  John C. Young,et al.  Multivariate statistical process control with industrial applications , 2002, ASA-SIAM series on statistics and applied probability.

[44]  Jianjun Shi,et al.  Quality control and improvement for multistage systems: A survey , 2009 .

[45]  Fah Fatt Gan.  Design of optimal exponential CUSUM control charts , 1994 .

[46]  Mahmoud A. Mahmoud,et al.  On the Monitoring of Linear Profiles , 2003 .

[47]  Marion R. Reynolds,et al.  Control Charts and the Efficient Allocation of Sampling Resources , 2004, Technometrics.

[48]  J C Benneyan,et al.  Number-Between g-Type Statistical Quality Control Charts for Monitoring Adverse Events , 2001, Health care management science.

[49]  M. R. Reynolds,et al.  A general approach to modeling CUSUM charts for a proportion , 2000 .

[50]  William H. Woodall,et al.  Surveillance of Nonhomogeneous Poisson Processes , 2015, Technometrics.

[51]  Ron S. Kenett,et al.  Assessing the value of information of data-centric activities in the chemical processing industry 4.0 , 2018, AIChE Journal.

[52]  I. Vlaev,et al.  Considering chance in quality and safety performance measures: an analysis of performance reports by boards in English NHS trusts , 2016, BMJ Quality & Safety.

[53]  Zachary G. Stoumbos,et al.  Monitoring a Proportion Using CUSUM and SPRT Control Charts , 2001 .

[54]  Cecile Paris,et al.  We Feel: Taking the emotional pulse of the world , 2015 .

[55]  Xiang Zhang,et al.  Dynamic probability control limits for risk‐adjusted Bernoulli CUSUM charts , 2015, Statistics in medicine.

[56]  William H. Woodall,et al.  A review and analysis of cause-selecting control charts , 1993 .

[57]  H. Burkom,et al.  Role of data aggregation in biosurveillance detection strategies with applications from ESSENCE. , 2004, MMWR supplements.

[58]  Alberto Ferrer,et al.  Latent Structures-Based Multivariate Statistical Process Control: A Paradigm Shift , 2014 .

[59]  William H. Woodall,et al.  Bridging the gap between theory and practice in basic statistical process monitoring , 2016 .

[60]  Marion R. Reynolds,et al.  Should Observations Be Grouped for Effective Process Monitoring? , 2004 .

[61]  Fadel M. Megahed,et al.  Statistical Learning Methods Applied to Process Monitoring: An Overview and Perspective , 2016 .

[62]  Ling Bian,et al.  Comparing Effects of Aggregation Methods on Statistical and Spatial Properties of Simulated Spatial Data , 1999 .

[63]  William H. Woodall,et al.  A Review and perspective on surveillance of Bernoulli processes , 2011, Qual. Reliab. Eng. Int..

[64]  Robert V. Baxley,et al.  An Application of Variable Sampling Interval Control Charts , 1995 .

[65]  Jaime A Camelio,et al.  Control charts for accident frequency: a motivation for real-time occupational safety monitoring , 2014, International journal of injury control and safety promotion.

[66]  Marcello Pagano,et al.  Using temporal context to improve biosurveillance , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[67]  William H. Woodall,et al.  Statistical process control with several components of common cause variability , 1995 .

[68]  Marcus B. Perry,et al.  An EWMA control chart for categorical processes with applications to social network monitoring , 2019, Journal of Quality Technology.

[69]  G. Moustakides.  Optimal stopping times for detecting changes in distributions , 1986 .

[70]  Stephen E. Fienberg,et al.  Current and Potential Statistical Methods for Monitoring Multiple Data Streams for Biosurveillance , 2006 .

[71]  Russell R. Barton,et al.  Optimal Monitoring of Multivariate Data for Fault Patterns , 2007 .

[72]  Daniel W. Apley,et al.  A Factor-Analysis Method for Diagnosing Variability in Mulitvariate Manufacturing Processes , 2001, Technometrics.

[73]  David Veredas,et al.  Temporal Aggregation of Univariate and Multivariate Time Series Models: A Survey , 2008 .

[74]  Krishna P. Gummadi,et al.  On the evolution of user interaction in Facebook , 2009, WOSN '09.

[75]  Stefan H. Steiner,et al.  An Overview of Phase I Analysis for Process Improvement and Monitoring , 2014 .

[76]  J. Bert Keats,et al.  Economic Modeling for Statistical Process Control , 1997 .

[77]  Fugee Tsung,et al.  Directional MEWMA Schemes for Multistage Process Monitoring and Diagnosis , 2008 .

[78]  Landon H. Sego,et al.  A comparison of surveillance methods for small incidence rates , 2008, Statistics in medicine.

[79]  Richard J Cook,et al.  Monitoring the evolutionary process of quality: risk-adjusted charting to track outcomes in intensive care. , 2003, Critical care medicine.

[80]  Al Ozonoff,et al.  Research Paper: Power to Detect Spatial Disturbances under Different Levels of Geographic Aggregation , 2009, J. Am. Medical Informatics Assoc..

[81]  Andrew C. Palm,et al.  Discussion: integrating SPC and APC , 1992 .

[82]  P. Santhi Thilagam,et al.  Mining social networks for anomalies: Methods and challenges , 2016, J. Netw. Comput. Appl..

[83]  Rocco J. Perla,et al.  Sampling Considerations for Health Care Improvement , 2013, Quality management in health care.

[84]  Galit Shmueli,et al.  On information quality , 2012, SSRN Electronic Journal.

[85]  Jenny Neuburger,et al.  Comparison of control charts for monitoring clinical performance using binary data , 2017, BMJ Quality & Safety.

[86]  George C. Runger,et al.  Batch-means control charts for autocorrelated data , 1996 .

[87]  Mark E. J. Newman,et al.  Stochastic blockmodels and community structure in networks , 2010, Physical review. E, Statistical, nonlinear, and soft matter physics.

[88]  Artur Dubrawski,et al.  The Role of Data Aggregation in Public Health and Food Safety Surveillance , 2010 .

[89]  Ross Sparks,et al.  Challenges in designing a disease surveillance plan: What we have and what we need? , 2013 .