Using novelty detection to identify abnormalities caused by mean shifts in bivariate processes

Non-random (abnormal) behaviour indicates that a process is under the influence of special causes of variation. Detection of abnormal patterns is well established in univariate statistical process control (SPC). Various solutions including heuristics, traditional computer programming, expert systems and neural networks (NNs) have been successfully implemented. In multivariate SPC (MSPC), on the other hand, there is a clear need for more investigations into pattern detection. Bivariate SPC is a special case of MSPC where the number of variates is two and is studied here in terms of identification of shift patterns. In this work, an existing NN classification technique-known as novelty detection (ND)--whose application for MSPC has not been reported is applied for pattern recognition. ND successfully detects non-random bivariate time-series patterns representing shifts of various magnitudes in the process mean vector. The investigation proposes a simple heuristic approach for applying ND as an effective and useful tool for pattern detection in bivariate SPC with potential applicability for MSPC in general.

[1]  George C. Runger,et al.  Comparison of multivariate CUSUM charts , 1990 .

[2]  R. Redner,et al.  Mixture densities, maximum likelihood, and the EM algorithm , 1984 .

[3]  Stephen J. Roberts,et al.  Supervised and unsupervised learning in radial basis function classifiers , 1994 .

[4]  Cecilia Surace,et al.  Using Novelty Detection to diagnose damage in structures with timevaryingparameters , 1998 .

[5]  Chih-Chou Chiu,et al.  Using radial basis function neural networks to recognize shifts in correlated manufacturing process parameters , 1998 .

[6]  S. Roberts.  Novelty detection using extreme value statistics , 1999 .

[7]  Peter Kolesar,et al.  The relevance of research on statistical process control to the total quality movement , 1993 .

[8]  Theodora Kourti,et al.  Multivariate SPC Methods for Process and Product Monitoring , 1996 .

[9]  W. A. Wallis,et al.  Techniques of Statistical Analysis. , 1950 .

[10]  Christopher M. Bishop,et al.  Novelty detection and neural network validation , 1994 .

[11]  Christopher M. Bishop,et al.  Neural networks for pattern recognition , 1995 .

[12]  Mike Alder,et al.  Initializing the EM Algorithm for use in Gaussian Mixture Modelling , 1993 .

[13]  Amjed M. Al-Ghanim,et al.  Unnatural pattern recognition on control charts using correlation analysis techniques , 1995 .

[14]  D. Hawkins.  Multivariate quality control based on regression-adjusted variables , 1991 .

[15]  J. MacQueen.  Some methods for classification and analysis of multivariate observations , 1967 .

[16]  Robert J. Schalkoff,et al.  Pattern recognition - statistical, structural and neural approaches , 1991 .

[17]  Kern W. Dickman,et al.  Sample and population score matrices and sample correlation matrices from an arbitrary population correlation matrix , 1962 .

[18]  A. K. Kochhar,et al.  Pattern recognition for statistical process control charts , 1998 .

[19]  S. J. Wierda.  Multivariate statistical process control—recent results and directions for future research , 1994 .

[20]  H. Hotelling,et al.  Multivariate Quality Control , 1947 .

[21]  Douglas C. Montgomery,et al.  Introduction to Statistical Quality Control , 1986 .

[22]  J.D.T. Tannock,et al.  Recognition of control chart concurrent patterns using a neural network approach , 1999 .

[23]  Thomas P. Ryan,et al.  Statistical methods for quality improvement , 1989 .

[24]  W. Edwards Deming,et al.  Out of the Crisis , 1982 .

[25]  William A. Sands,et al.  A Computer Program for the Generation of Score Vectors from a Multivariate Normal Distribution with a Specified Mean Vector and Variance-Covariance Matrix , 1973 .

[26]  Herbert Moskowitz,et al.  Run-Length Distributions of Special-Cause Control Charts for Correlated Processes , 1994 .

[27]  Richard O. Duda,et al.  Pattern classification and scene analysis , 1974, A Wiley-Interscience publication.

[28]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[29]  King-Sun Fu,et al.  Handbook of pattern recognition and image processing , 1986 .

[30]  John C. Young,et al.  A Bivariate Control Chart for Paired Measurements , 1995 .

[31]  D. Stoller,et al.  On the Generation of Normal Random Vectors , 1962 .

[32]  Charles W. Champ,et al.  A multivariate exponentially weighted moving average control chart , 1992 .

[33]  Keinosuke Fukunaga,et al.  Introduction to statistical pattern recognition (2nd ed.) , 1990 .

[34]  R. Crosier.  Multivariate generalizations of cumulative sum quality-control schemes , 1988 .

[35]  Chuen-Sheng Cheng.  A multi-layer neural network model for detecting changes in the process mean , 1995 .

[36]  Stephen J. Roberts,et al.  A Probabilistic Resource Allocating Network for Novelty Detection , 1994, Neural Computation.

[37]  John Moody,et al.  Fast Learning in Networks of Locally-Tuned Processing Units , 1989, Neural Computation.

[38]  Teuvo Kohonen,et al.  Self-Organization and Associative Memory , 1988 .

[39]  W. Woodall,et al.  Multivariate CUSUM Quality- Control Procedures , 1985 .

[40]  Clifford Goodman,et al.  American Society of Mechanical Engineers , 1988 .

[41]  H. Hotelling.  Multivariate Quality Control-illustrated by the air testing of sample bombsights , 1947 .

[42]  Shing I. Chang,et al.  An integrated neural network approach for simultaneous monitoring of process mean and variance shifts a comparative study , 1999 .

[43]  Frank Montgomery,et al.  IDENTIFYING MOTORWAY INCIDENTS BY NOVELTY DETECTION , 1999 .

[44]  Stephen J. Roberts,et al.  Extreme value statistics for novelty detection in biomedical signal processing , 2000 .

[45]  Keinosuke Fukunaga,et al.  Introduction to Statistical Pattern Recognition , 1972 .

[46]  James D. Keeler,et al.  Layered Neural Networks with Gaussian Hidden Units as Universal Approximations , 1990, Neural Computation.

[47]  Teuvo Kohonen,et al.  Self-organization and associative memory: 3rd edition , 1989 .

[48]  Douglas C. Montgomery,et al.  A review of multivariate control charts , 1995 .

[49]  Norma Faris Hubele,et al.  Back-propagation pattern recognizers for X¯ control charts: methodology and performance , 1993 .

[50]  Frank B. Alt.  Multivariate Quality Control , 1984 .

[51]  Kevin Swingler,et al.  Applying neural networks - a practical guide , 1996 .

[52]  J. Healy.  A note on multivariate CUSUM procedures , 1987 .

[53]  A. R. Crathorne,et al.  Economic Control of Quality of Manufactured Product. , 1933 .

[54]  J. D. T. Tannock,et al.  A review of neural networks for statistical process control , 1998, J. Intell. Manuf..

[55]  Donald R. Barr,et al.  A comparison of multivariate normal generators , 1972, Commun. ACM.