Control Chart Pattern Recognition Using Artificial Neural Networks

Precise and fast control chart pattern (CCP) recognition is important for monitoring process environments to achieve appropriate control and to produce high quality products. CCPs can exhibit six types of pattern: normal, cyclic, increasing trend, decreasing trend, upward shift and downward shift. Except for normal patterns, all other patterns indicate that the process being monitored is not functioning correctly and requires adjustment. This paper describes a new type of neural network for speeding up the training process and to compare three training algorithms in terms of speed, performance and parameter complexity for CCP recognition. The networks are multilayered perceptrons trained with a resilient propagation, backpropagation (BP) and extended delta-bar-delta algorithms. The recognition results of CCPs show the BP algorithm is accurate and provides better and faster results.

[1]  Mukul Agarwal,et al.  Three Methods to Speed up the Training of Feedforward and Feedback Perceptrons , 1997, Neural Networks.

[2]  Duc Truong Pham,et al.  XPC: an on-line expert system for statistical process control , 1992 .

[3]  Seref Sagiroglu,et al.  Training multilayered perceptrons for pattern recognition: a comparative study of four training algorithms , 2001 .

[4]  Ali A. Minai,et al.  Back-propagation heuristics: a study of the extended delta-bar-delta algorithm , 1990, 1990 IJCNN International Joint Conference on Neural Networks.

[5]  James L. McClelland,et al.  Parallel distributed processing: explorations in the microstructure of cognition, vol. 1: foundations , 1986 .

[6]  Duc Truong Pham,et al.  Control chart pattern recognition using learning vector quantization networks , 1994 .

[7]  Martin A. Riedmiller,et al.  A direct adaptive method for faster backpropagation learning: the RPROP algorithm , 1993, IEEE International Conference on Neural Networks.

[8]  Duc Truong Pham,et al.  Feature-based control chart pattern recognition , 1997 .

[9]  Yadira Solano,et al.  A Comparative Study of Eight Learning Algorithms for Artifical Neural Networks Based on a Real Application , 1998 .

[10]  C. Charalambous,et al.  Conjugate gradient algorithm for efficient training of artifi-cial neural networks , 1990 .

[11]  Patrick van der Smagt.  Minimisation methods for training feedforward neural networks , 1994, Neural Networks.

[12]  Martin Fodslette Møller,et al.  A scaled conjugate gradient algorithm for fast supervised learning , 1993, Neural Networks.

[13]  Robert A. Jacobs,et al.  Increased rates of convergence through learning rate adaptation , 1987, Neural Networks.

[14]  John Mark Bishop,et al.  A comparison of fast training algorithms over two real problems , 1997 .

[15]  G. Kane.  Parallel Distributed Processing: Explorations in the Microstructure of Cognition, vol 1: Foundations, vol 2: Psychological and Biological Models , 1994 .

[16]  Duc Truong Pham,et al.  Control chart pattern recognition using a new type of self-organizing neural network , 1998 .

[17]  Martin A. Riedmiller,et al.  Advanced supervised learning in multi-layer perceptrons — From backpropagation to adaptive learning algorithms , 1994 .

[18]  Duc Truong Pham,et al.  Efficient control chart pattern recognition through synergistic and distributed artificial neural networks , 1999 .

[19]  D. T. Pham,et al.  Three methods of training multi-layer perceptrons to model a robot sensor , 1995, Robotica.

[20]  Scott E. Fahlman,et al.  An empirical study of learning speed in back-propagation networks , 1988 .

[21]  K. W. Tang,et al.  Artificial Neural Networks for the Diagnosis of Coronary Artery Disease , 1997 .

[22]  Duc Truong Pham,et al.  A Novel Self-organising Neural Network for Control Chart Pattern Recognition , 1998 .

[23]  M. Møller.  A Scaled Conjugate Gradient Algorithm for Fast Supervised Learning , 1990 .

[24]  Robert M. Pap,et al.  Handbook of neural computing applications , 1990 .

[25]  Kerim Guney,et al.  Resonant frequency calculation for circular microstrip antennas using artificial neural networks , 1998 .

[26]  Duc Truong Pham,et al.  Control Chart Pattern Recognition Using Combinations of Multi-Layer Perceptrons and Learning-Vector-Quantization Neural Networks , 1993 .

[27]  Ah Chung Tsoi,et al.  Efficacy of modified backpropagation and optimisation methods on a real-world medical problem , 1995, Neural Networks.

[28]  Joos Vandewalle,et al.  Comparison of gradient descent and conjugate gradient learning algorithms for classification of electrogastrogram , 1995, Proceedings of 17th International Conference of the Engineering in Medicine and Biology Society.

[29]  Seref Sagiroglu,et al.  Neural network classification of defects in veneer boards , 2000 .

[30]  Seref Sagiroglu,et al.  Synergistic Neural Models of a Robot Sensor for Part Orientation Detection , 1996 .

[31]  S. J. Perantonis,et al.  Comparison of learning algorithms for feedforward networks in large scale networks and problems , 1993, Proceedings of 1993 International Conference on Neural Networks (IJCNN-93-Nagoya, Japan).