Some Current Directions in the Theory and Application of Statistical Process Monitoring

The purpose of this paper is to provide an overview and our perspective of recent research and applications of statistical process monitoring. The focus is on work done over the past decade or so. We review briefly a number of important areas, including health-related monitoring, spatiotemporal surveillance, profile monitoring, use of autocorrelated data, the effect of estimation error, and high-dimensional monitoring, among others. We briefly discuss the choice of performance metrics. We provide references and offer some directions for further research.

[1]  Stelios Psarakis,et al.  The use of neural networks in statistical process control charts , 2011, Qual. Reliab. Eng. Int..

[2]  Jaime A. Camelio,et al.  The Effect of Aggregating Data When Monitoring a Poisson Process , 2013 .

[3]  Peihua Qiu,et al.  Multivariate Statistical Process Control Using LASSO , 2009 .

[4]  Paul H. Garthwaite,et al.  Statistical methods for the prospective detection of infectious disease outbreaks: a review , 2012 .

[5]  Kathleen M. Carley,et al.  Social Network Change Detection , 2008 .

[6]  Abdel-Salam G. Abdel-Salam,et al.  On the use and evaluation of prospective scan methods for health‐related surveillance , 2007 .

[7]  William H. Woodall,et al.  The Use of Control Charts in Health-Care and Public-Health Surveillance , 2006 .

[8]  Yajun Mei.  SUBOPTIMAL PROPERTIES OF PAGE'S CUSUM AND SHIRYAYEV-ROBERTS PROCEDURES IN CHANGE-POINT PROBLEMS WITH DEPENDENT OBSERVATIONS , 2006 .

[9]  J. D. T. Tannock,et al.  A review of neural networks for statistical process control , 1998, J. Intell. Manuf..

[10]  Ron S. Kenett,et al.  Statistical methods in healthcare , 2012 .

[11]  Peihua Qiu,et al.  Using p values to design statistical process control charts , 2013 .

[12]  Stefan H Steiner,et al.  Assessing the effect of estimation error on risk-adjusted CUSUM chart performance. , 2012, International journal for quality in health care : journal of the International Society for Quality in Health Care.

[13]  William H. Woodall,et al.  Research Issues and Ideas on Health-Related Surveillance , 2010 .

[14]  Jan Terje Kvaløy,et al.  Risk-adjusted monitoring of time to event , 2010 .

[15]  Gregory F Cooper,et al.  Issues in applied statistics for public health bioterrorism surveillance using multiple data streams: research needs , 2007, Statistics in medicine.

[16]  Changliang Zou,et al.  The computation of average run length and average time to signal: an overview , 2014 .

[17]  Mahmoud A. Mahmoud,et al.  The Performance of Phase II Simple Linear Profile Approaches when Parameters Are Estimated , 2012, Commun. Stat. Simul. Comput..

[18]  Dean V. Neubauer.  Statistical Process Adjustment for Quality Control , 2003, Technometrics.

[19]  Mazda A. Marvasti,et al.  Cusum techniques for timeslot sequences with applications to network surveillance , 2009, Comput. Stat. Data Anal..

[20]  Søren Bisgaard,et al.  The Future of Quality Technology: From a Manufacturing to a Knowledge Economy & From Defects to Innovations , 2012 .

[21]  Fugee Tsung,et al.  Monitoring Profiles Based on Nonparametric Regression Methods , 2008, Technometrics.

[22]  David J. Spiegelhalter,et al.  Statistical methods for healthcare regulation: rating, screening and surveillance , 2012 .

[23]  Connie M. Borror,et al.  EWMA control charts for multivariate Poisson-distributed data , 2011 .

[24]  Giovanna Capizzi,et al.  Comparison of Phase II Control Charts Based on Variable Selection Methods , 2015 .

[25]  York Marcel Dekker.  The State of Statistical Process Control as We Proceed into the 21st Century , 2000 .

[26]  Jaime A. Camelio,et al.  A Review and Perspective on Control Charting with Image Data , 2011 .

[27]  Yu Ding,et al.  Phase I Analysis for Monitoring Nonlinear Profiles in Manufacturing Processes , 2006 .

[28]  Fugee Tsung,et al.  A Multivariate Sign EWMA Control Chart , 2011, Technometrics.

[29]  Ronald D. Fricker,et al.  Protecting against Biological Terrorism: Statistical Issues in Electronic Biosurveillance , 2006 .

[30]  Alexander G. Tartakovsky,et al.  On optimality of the Shiryaev-Roberts procedure for detecting a change in distribution , 2009, 0904.3370.

[31]  Kathleen M. Carley,et al.  Spectral Analysis of Social Networks to Identify Periodicity , 2012 .

[32]  Y. Mei.  Efficient scalable schemes for monitoring a large number of data streams , 2010 .

[33]  Rolf Stadler,et al.  In-Network Monitoring , 2010, Algorithms for Next Generation Networks.

[34]  Douglas C. Montgomery,et al.  Research Issues and Ideas in Statistical Process Control , 1999 .

[35]  David J. Spiegelhalter,et al.  An Empirical Approximation to the Null Unbounded Steady-State Distribution of the Cumulative Sum Statistic , 2008, Technometrics.

[36]  A. Lawson,et al.  Review of methods for space–time disease surveillance , 2010, Spatial and Spatio-temporal Epidemiology.

[37]  Jaime A. Camelio,et al.  A Spatiotemporal Method for the Monitoring of Image Data , 2012, Qual. Reliab. Eng. Int..

[38]  Eugenio K. Epprecht.  Statistical Control of Multiple-Stream Processes: A Literature Review , 2015 .

[39]  Peihua Qiu,et al.  Nonparametric Profile Monitoring by Mixed Effects Modeling , 2010, Technometrics.

[40]  M. R. Reynolds,et al.  A general approach to modeling CUSUM charts for a proportion , 2000 .

[41]  Giovanna Capizzi.  Design of change detection algorithms based on the generalized likelihood ratio test , 2001 .

[42]  Qi Zhang,et al.  A cusum change-point detection algorithm for non-stationary sequences with application to data network surveillance , 2010, J. Syst. Softw..

[43]  William H. Woodall,et al.  Control Charts for Poisson Count Data with Varying Sample Sizes , 2010 .

[44]  Yajun Mei,et al.  EARLY DETECTION OF A CHANGE IN POISSON RATE AFTER ACCOUNTING FOR POPULATION SIZE EFFECTS , 2011 .

[45]  Kwok-Leung Tsui,et al.  A Review of Healthcare, Public Health, and Syndromic Surveillance , 2008 .

[46]  Wei Jiang,et al.  A LASSO-Based Diagnostic Framework for Multivariate Statistical Process Control , 2011, Technometrics.

[47]  Wei Jiang,et al.  Recent Research and Developments in Temporal and Spatiotemporal Surveillance for Public Health , 2011, IEEE Transactions on Reliability.

[48]  Kaibo Wang,et al.  Adaptive Charting Techniques: Literature Review and Extensions , 2010 .

[49]  Stephen E. Fienberg,et al.  Discussion on the paper by Spiegelhalter, Sherlaw-Johnson, Bardsley, Blunt, Wood and Grigg , 2012 .

[50]  Marion R. Reynolds,et al.  Should Observations Be Grouped for Effective Process Monitoring? , 2004 .

[51]  William H. Woodall,et al.  Performance comparison of some likelihood ratio-based statistical surveillance methods , 2008 .

[52]  S. W. Roberts.  A Comparison of Some Control Chart Procedures , 1966 .

[53]  Massimo Pacella,et al.  Monitoring and diagnosis of multichannel nonlinear profile variations using uncorrelated multilinear principal component analysis , 2013 .

[54]  Rassoul Noorossana,et al.  Statistical Analysis of Profile Monitoring: Noorossana/Profile Monitoring , 2011 .

[55]  George C. Runger,et al.  System Monitoring with Real-Time Contrasts , 2012 .

[56]  S. Chakraborti,et al.  Nonparametric Control Charts: An Overview and Some Results , 2001 .

[57]  Minitab.  Statistical Methods for Quality Improvement , 2001 .

[58]  Thomas P. Ryan,et al.  Statistical Methods for Quality Improvement: Ryan/Quality Improvement 3E , 2011 .

[59]  Denisa Anca Olteanu,et al.  Cumulative Sum Control Charts for Censored Reliability Data , 2010 .

[60]  Changliang Zou,et al.  A control chart based on a change-point model for monitoring linear profiles , 2006 .

[61]  Emmanuel Yashchin,et al.  On Detection of Changes in Categorical Data , 2012 .

[62]  Stelios Psarakis,et al.  Multivariate statistical process control charts: an overview , 2007, Qual. Reliab. Eng. Int..

[63]  Marion R. Reynolds,et al.  An Evaluation of a GLR Control Chart for Monitoring the Process Mean , 2010 .

[64]  Fugee Tsung,et al.  False Discovery Rate-Adjusted Charting Schemes , 2009 .

[65]  Stelios Psarakis,et al.  Review of multinomial and multiattribute quality control charts , 2009, Qual. Reliab. Eng. Int..

[66]  Jianjun Shi,et al.  Quality control and improvement for multistage systems: A survey , 2009 .

[67]  M. R. Reynolds,et al.  A CUSUM Chart for Monitoring a Proportion with Autocorrelated Binary Observations , 2009 .

[68]  Giovanna Capizzi,et al.  Efficient control chart calibration by simulated stochastic approximation , 2016 .

[69]  Ron S. Kenett,et al.  On Assessing the Performance of Sequential Procedures for Detecting a Change , 2012, Qual. Reliab. Eng. Int..

[70]  George E. P. Box,et al.  Rethinking Statistics for Quality Control , 2010 .

[71]  Mats Brommels,et al.  Application of statistical process control in healthcare improvement: systematic review , 2007, Quality and Safety in Health Care.

[72]  Andrew B. Lawson,et al.  Spatial and syndromic surveillance for public health , 2005 .

[73]  Ron S. Kenett,et al.  Statistical Methods in Healthcare: Faltin/Statistical Methods in Healthcare , 2012 .

[74]  R. Tennant,et al.  Monitoring patients using control charts: a systematic review. , 2007, International journal for quality in health care : journal of the International Society for Quality in Health Care.

[75]  Douglas C. Montgomery,et al.  Introduction to Statistical Quality Control , 1986 .

[76]  William H. Woodall,et al.  Some Recent Results on Monitoring the Rate of a Rare Event , 2015 .

[77]  Ronald D. Fricker.  Introduction to Statistical Methods for Biosurveillance: With an Emphasis on Syndromic Surveillance , 2013 .

[78]  Rassoul Noorossana,et al.  Statistical Analysis of Profile Monitoring , 2011 .

[79]  Joel Smith,et al.  Control Charts Based on the Exponential Distribution: Adapting Runs Rules for the t Chart , 2013 .

[80]  Marianne Frisén,et al.  Optimal Sequential Surveillance for Finance, Public Health, and Other Areas , 2009 .

[81]  Nien Fan Zhang,et al.  Statistical Development of Quality in Medicine , 2007 .

[82]  Andrew W. Moore,et al.  Algorithms for rapid outbreak detection: a research synthesis , 2005, J. Biomed. Informatics.

[83]  Amirhossein Amiri,et al.  Change Point Estimation Methods for Control Chart Postsignal Diagnostics: A Literature Review , 2012, Qual. Reliab. Eng. Int..

[84]  S. Joe Qin,et al.  Statistical process monitoring: basics and beyond , 2003 .

[85]  Benjamin Yakir,et al.  Minimax optimality of the Shiryayev–Roberts change-point detection rule , 2008 .

[86]  S. Steiner,et al.  Monitoring surgical performance using risk-adjusted cumulative sum charts. , 2000, Biostatistics.

[87]  William H. Woodall,et al.  Introduction to Statistical Quality Control, Fifth Edition , 2005 .

[88]  Philippe Castagliola,et al.  Some Recent Developments on the Effects of Parameter Estimation on Control Charts , 2014, Qual. Reliab. Eng. Int..

[89]  Ikuho Yamada,et al.  Statistical Detection and Surveillance of Geographic Clusters , 2008 .

[90]  Jian Li,et al.  Directional Control Schemes for Multivariate Categorical Processes , 2012 .

[91]  Joseph J. Pignatiello,et al.  Estimation of the Change Point of a Normal Process Mean in SPC Applications , 2001 .

[92]  Daniel W. Apley,et al.  Posterior Distribution Charts: A Bayesian Approach for Graphically Exploring a Process Mean , 2012, Technometrics.

[93]  Sven Knoth,et al.  Control Charts for Time Series: A Review , 2004 .

[94]  Karim Atashgar,et al.  Identification of the change point: an overview , 2013 .

[95]  Joseph S. Lombardo,et al.  A systems overview of the Electronic Surveillance System for the Early Notification of Community-Based Epidemics (ESSENCE II) , 2003, Journal of Urban Health.

[96]  Smiley W. Cheng,et al.  Single Variables Control Charts: an Overview , 2006, Qual. Reliab. Eng. Int..

[97]  Sirish L. Shah,et al.  Treatment of missing values in process data analysis , 2008 .

[98]  Johannes Ledolter,et al.  Challenges in constructing time series models from process data , 2011, Qual. Reliab. Eng. Int..

[99]  Douglas C. Montgomery,et al.  An Overview of Six Sigma , 2008 .

[100]  Anthony Amicelle,et al.  FINANCIAL SURVEILLANCE , 2012 .

[101]  Fugee Tsung,et al.  False Discovery Rate-Adjusted Charting Schemes for Multistage Process Monitoring and Fault Identification , 2009, Technometrics.

[102]  Mahmoud A. Mahmoud,et al.  A change point method for linear profile data , 2007, Qual. Reliab. Eng. Int..

[103]  Min Zhang,et al.  Exponential CUSUM Charts with Estimated Control Limits , 2014, Qual. Reliab. Eng. Int..

[104]  Jaime A. Camelio,et al.  Statistical process monitoring approach for high-density point clouds , 2012, Journal of Intelligent Manufacturing.

[105]  Jian Liu.  Variation reduction for multistage manufacturing processes: a comparison survey of statistical-process-control vs stream-of-variation methodologies , 2010, Qual. Reliab. Eng. Int..

[106]  S. Chakraborti.  Nonparametric (Distribution-Free) Quality Control Charts† , 2011 .

[107]  William H. Woodall,et al.  A Comparison of the Performance of Phase II Simple Linear Profile Control Charts when Parameters are Estimated , 2015, Commun. Stat. Simul. Comput..

[108]  Murat Caner Testik,et al.  CUSUM Monitoring of First-Order Integer-Valued Autoregressive Processes of Poisson Counts , 2009 .

[109]  Stefan H. Steiner,et al.  Effective Monitoring of Processes with Parts Per Million Defective. A Hard Problem , 2004 .

[110]  M. A. Graham,et al.  Phase I Statistical Process Control Charts: An Overview and Some Results , 2008 .

[111]  Andrew B. Lawson,et al.  Spatial and Syndromic Surveillance for Public Health: Lawson/Spatial and Syndromic Surveillance for Public Health , 2005 .

[112]  Jean Meloche,et al.  Statistical Aspects of the Analysis of Data Networks , 2007, Technometrics.

[113]  Jaime A. Camelio,et al.  A framework for variation visualization and understanding in complex manufacturing systems , 2011, Journal of Intelligent Manufacturing.

[114]  Shuo Li,et al.  Monitoring the Weibull Shape Parameter by Control Charts for the Sample Range of Type II Censored Data , 2011, Qual. Reliab. Eng. Int..

[115]  Marianne Frisén,et al.  Statistical Surveillance. Optimality and Methods , 2003 .

[116]  Charles W. Champ,et al.  Effects of Parameter Estimation on Control Chart Properties: A Literature Review , 2006 .

[117]  Christian Sonesson,et al.  A CUSUM framework for detection of space–time disease clusters using scan statistics , 2007, Statistics in medicine.

[118]  L Zeng,et al.  A Bayesian approach to risk‐adjusted outcome monitoring in healthcare , 2011, Statistics in medicine.

[119]  F. Megahed,et al.  A Statistical Process Monitoring Perspective on “ Big Data ” , 2013 .

[120]  Jerald F. Lawless,et al.  Monitoring Warranty Claims With Cusums , 2012, Technometrics.

[121]  A. Shiryaev.  Quickest Detection Problems: Fifty Years Later , 2010 .

[122]  Su-Fen Yang,et al.  Process Control for the Vector Autoregressive Model , 2014, Qual. Reliab. Eng. Int..

[123]  A. Shiryaev.  On Optimum Methods in Quickest Detection Problems , 1963 .

[124]  Edit Gombay,et al.  Monitoring binary outcomes using risk‐adjusted charts: a comparative study , 2011, Statistics in medicine.

[125]  Y. Mei.  Efficient scalable schemes for monitoring a large number of data streams , 2010 .

[126]  R. Fricker.  Some methodological issues in biosurveillance , 2011, Statistics in medicine.

[127]  Giovanna Capizzi,et al.  Adaptive Generalized Likelihood Ratio Control Charts for Detecting Unknown Patterned Mean Shifts , 2012 .

[128]  Artur Dubrawski,et al.  The Role of Data Aggregation in Public Health and Food Safety Surveillance , 2010 .

[129]  Kwok-Leung Tsui,et al.  A review and comparison of likelihood-based charting methods , 2012 .

[130]  Ross Sparks,et al.  Challenges in designing a disease surveillance plan: What we have and what we need? , 2013 .

[131]  Peihua Qiu,et al.  On Nonparametric Statistical Process Control of Univariate Processes , 2011, Technometrics.

[132]  John I. McCool.  Statistical Engineering: An Algorithm for Reducing Variation in Manufacturing Processes , 2006, Technometrics.

[133]  Chuanhai Liu,et al.  Adaptive Thresholds , 2006 .

[134]  E. Del Castillo,et al.  Statistical process adjustment: A brief retrospective, current status, and some opportunities for further work , 2006 .

[135]  Mark H. Hansen,et al.  Statistics in Advanced Manufacturing , 2000 .

[136]  Fugee Tsung,et al.  Statistical process control for multistage manufacturing and service operations: A review and some extensions , 2008 .

[137]  Stefan H. Steiner,et al.  An Overview of Phase I Analysis for Process Improvement and Monitoring , 2014 .

[138]  A. K. McCracken,et al.  Control Charts for Joint Monitoring of Mean and Variance: An Overview , 2013 .

[139]  Sukhraj Singh,et al.  Control charts for monitoring the autocorrelated process parameters: a literature review , 2012 .

[140]  V. Veeravalli,et al.  General Asymptotic Bayesian Theory of Quickest Change Detection , 2005 .

[141]  H. Burkom,et al.  Enhancing time-series detection algorithms for automated biosurveillance. , 2009, Emerging infectious diseases.

[142]  Douglas C. Montgomery,et al.  Using Control Charts to Monitor Process and Product Quality Profiles , 2004 .

[143]  Giovanna Capizzi,et al.  Self-Starting CUSCORE Control Charts for Individual Multivariate Observations , 2010 .

[144]  Emmanuel Yashchin.  Computational and Monte-Carlo Aspects of Systems for Monitoring Reliability Data , 2010, COMPSTAT.

[145]  Daniel W. Apley,et al.  Simultaneous Identification of Premodeled and Unmodeled Variation Patterns* , 2010 .

[146]  Alberto Ferrer,et al.  Latent Structures-Based Multivariate Statistical Process Control: A Paradigm Shift , 2014 .

[147]  Vern T. Farewell,et al.  An overview of risk‐adjusted charts , 2004 .

[148]  Lloyd S. Nelson,et al.  A Control Chart for Parts-Per-Million Nonconforming Items , 1994 .

[149]  Jianjun Shi,et al.  Stream of Variation Modeling and Analysis for Multistage Manufacturing Processes , 2006 .

[150]  David Bock,et al.  A review and discussion of prospective statistical surveillance in public health , 2003 .

[151]  Arthur B. Yeh,et al.  Multivariate Control Charts for Monitoring Covariance Matrix: A Review , 2006 .

[152]  Stephen A. Freitas,et al.  Modern Industrial Statistics: Design and Control of Quality and Reliability , 1999, Technometrics.

[153]  Zachary G. Stoumbos,et al.  Robustness to Non-Normality of the Multivariate EWMA Control Chart , 2002 .

[154]  Yajun Mei,et al.  Is Average Run Length to False Alarm Always an Informative Criterion? , 2008 .

[155]  Wei Jiang,et al.  High-Dimensional Process Monitoring and Fault Isolation via Variable Selection , 2009 .

[156]  Jianjun Shi,et al.  The GLRT for statistical process control of autocorrelated processes , 1999 .

[157]  Arthur B. Yeh,et al.  Phase I Risk-Adjusted Control Charts for Monitoring Surgical Performance by Considering Categorical Covariates , 2012 .

[158]  William H. Woodall,et al.  Current research on profile monitoring , 2007 .

[159]  Abbas Saghaei,et al.  A Review on Fuzzy Control Charts for Monitoring Attribute Data , 2012 .

[160]  Stelios Psarakis,et al.  SPC Procedures for Monitoring Autocorrelated Processes , 2007 .

[161]  M Frisén,et al.  Evaluations of methods for statistical surveillance. , 1992, Statistics in medicine.

[162]  Wei Jiang,et al.  Likelihood-Based EWMA Charts for Monitoring Poisson Count Data With Time-Varying Sample Sizes , 2012 .

[163]  H. Burkom,et al.  Role of data aggregation in biosurveillance detection strategies with applications from ESSENCE. , 2004, MMWR supplements.

[164]  Wei Jiang,et al.  Spatiotemporal surveillance methods in the presence of spatial correlation , 2011, Statistics in medicine.

[165]  William H. Woodall,et al.  Performance Metrics for Surveillance Schemes , 2008 .

[166]  Dimitris K. Tasoulis,et al.  Nonparametric Monitoring of Data Streams for Changes in Location and Scale , 2011, Technometrics.

[167]  William H. Woodall,et al.  A Review and perspective on surveillance of Bernoulli processes , 2011, Qual. Reliab. Eng. Int..

[168]  Jianjun Shi,et al.  A Bayesian Approach for Interpreting Mean Shifts in Multivariate Quality Control , 2012, Technometrics.

[169]  Steven E. Rigdon,et al.  A Bayesian Approach to Change Point Estimation in Multivariate SPC , 2012 .

[170]  K. Leveno,et al.  The continuing value of the Apgar score for the assessment of newborn infants. , 2001, The New England journal of medicine.

[171]  Eugenio K. Epprecht,et al.  Adaptive Control Charts for Attributes , 2003 .

[172]  Howard S. Burkom,et al.  Statistical Challenges Facing Early Outbreak Detection in Biosurveillance , 2010, Technometrics.

[173]  Daniel J. Bachmann,et al.  Biosurveillance: A Review and Update , 2012, Advances in preventive medicine.