Multivariate statistical process monitoring using classical multidimensional scaling

A new Multivariate Statistical Process Monitoring (MSPM) system, which comprises of three main frameworks, is proposed where the system utilizes Classical Multidimensional Scaling (CMDS) as the main multivariate data compression technique instead of using the linearbased Principal Component Analysis (PCA). The conventional method which usually applies variance-covariance or correlation measure in developing the multivariate scores is found to be inappropriately used especially in modelling nonlinear processes, where a high number of principal components will be typically required. Alternatively, the proposed method utilizes the inter-dissimilarity scales in describing the relationships among the monitored variables instead of variance-covariance measure for the multivariate scores development. However, the scores are plotted in terms of variable structure, thus providing different formulation of statistics for monitoring. Nonetheless, the proposed statistics still correspond to the conceptual objective of Hotelling’s T2 and Squared Prediction Errors (SPE). The first framework corresponds to the original CMDS framework, whereas the second utilizes Procrustes Analysis (PA) functions which is analogous to the concept of loading factors in PCA for score projection. Lastly, the final framework employs dynamic mechanism of PA functions as an alternative for enhancing the procedures of the second approach. A simulated system of Continuous Stirred Tank Reactor with Recycle (CSTRwR) has been chosen for the demonstration and the fault detection results were comparatively analyzed to the outcomes of PCA on the grounds of false alarm rates, total number of detected cases and also total number of fastest detection cases. The last two performance factors are obtained through fault detection time. The overall outcomes show that the three CMDS-based systems give almost comparable performances to the linear PCA based monitoring systemwhen dealing the abrupt fault events, whereas the new systems have demonstrated significant improvement over the conventional method in detecting incipient fault cases. More importantly, this monitoring accomplishment can be efficiently executed based on lower compressed dimensional space compared to the PCA technique, thus providing much simpler solution. All of these evidences verified that the proposed approaches are successfully developed conceptually as well as practically for monitoring while complying fundamentally with the principles and technical steps of the conventional MSPM system.

[1]  A. Householder,et al.  Discussion of a set of points in terms of their mutual distances , 1938 .

[2]  John F. MacGregor STATISTICAL PROCESS CONTROL OF MULTIVARIATE PROCESSES , 1994 .

[3]  Jorge Henriques,et al.  Iterative Multidimensional Scaling for Industrial Process Monitoring , 2006, 2006 IEEE International Conference on Systems, Man and Cybernetics.

[4]  John F. MacGregor,et al.  Multivariate SPC charts for monitoring batch processes , 1995 .

[5]  J. Edward Jackson,et al.  The User's Guide to Multidimensional Scaling , 1985 .

[6]  Manabu Kano,et al.  Data-based process monitoring, process control, and quality improvement: Recent developments and applications in steel industry , 2008, Comput. Chem. Eng..

[7]  Neslihan Delacruz Process Monitoring and Quality by Design for Biotechnology Products , 2010 .

[8]  George W. Irwin,et al.  Improved principal component monitoring of large-scale processes , 2004 .

[9]  Pedro M. Saraiva,et al.  Heteroscedastic latent variable modelling with applications to multivariate statistical process control , 2006 .

[10]  Manabu Kano,et al.  Comparison of statistical process monitoring methods: application to the Eastman challenge problem , 2000 .

[11]  Jose A. Romagnoli,et al.  A robust strategy for real-time process monitoring , 2001 .

[12]  Richard D. Braatz,et al.  Fault Detection and Diagnosis in Industrial Systems , 2001 .

[13]  Huei-Shyang You,et al.  Real-time monitoring and detecting of after-burning hazards of continuous catalyst regenerators , 1998 .

[14]  Uwe Kruger,et al.  Synthesis of T2 and Q statistics for process monitoring , 2004 .

[15]  Theodora Kourti,et al.  Analysis, monitoring and fault diagnosis of batch processes using multiblock and multiway PLS , 1995 .

[16]  Joseph L. Zinnes,et al.  Theory and Methods of Scaling. , 1958 .

[17]  Dae Sung Lee,et al.  Nonlinear dynamic partial least squares modeling of a full-scale biological wastewater treatment plant , 2006 .

[18]  Bernhard Schölkopf,et al.  Nonlinear Component Analysis as a Kernel Eigenvalue Problem , 1998, Neural Computation.

[19]  J. E. Jackson,et al.  Control Procedures for Residuals Associated With Principal Component Analysis , 1979 .

[20]  Vincent G. Gomes,et al.  Computer-aided knowledge-based monitoring and diagnostic system for emulsion polymerization , 2007 .

[21]  Age K. Smilde,et al.  Improved monitoring of batch processes by incorporating external information , 2002 .

[22]  Jie Zhang,et al.  Multivariate Process Monitoring Using Classical Multidimensional Scaling and Procrustes Analysis , 2010 .

[23]  Michael S. Dudzic,et al.  An industrial perspective on implementing on-line applications of multivariate statistics , 2004 .

[24]  Yoshio Takane,et al.  Matrices with special reference to applications in psychometrics , 2004 .

[25]  John F. MacGregor,et al.  Process monitoring and diagnosis by multiblock PLS methods , 1994 .

[26]  Julian Morris,et al.  On-line monitoring of a sugar crystallization process , 2005, Comput. Chem. Eng..

[27]  Jie Zhang,et al.  Process performance monitoring using multivariate statistical process control , 1996 .

[28]  Paul E. Green,et al.  Mathematical Tools for Applied Multivariate Analysis , 1976 .

[29]  Ali Cinar,et al.  Statistical process monitoring and disturbance diagnosis in multivariable continuous processes , 1996 .

[30]  Richard E. DeVor,et al.  Statistical Quality Design and Control: Contemporary Concepts and Methods , 1992 .

[31]  Manabu Kano,et al.  A new multivariate statistical process monitoring method using principal component analysis , 2001 .

[32]  Carl-Fredrik Mandenius,et al.  Integration of distributed multi-analyzer monitoring and control in bioprocessing based on a real-time expert system. , 2003, Journal of biotechnology.

[33]  Stelios Psarakis,et al.  Multivariate statistical process control charts: an overview , 2007, Qual. Reliab. Eng. Int..

[34]  ChangKyoo Yoo,et al.  Statistical process monitoring with independent component analysis , 2004 .

[35]  John C. Young,et al.  Multivariate statistical process control with industrial applications , 2002, ASA-SIAM series on statistics and applied probability.

[36]  A. J. Morris,et al.  Performance monitoring of a multi-product semi-batch process , 2001 .

[37]  Dale E. Seborg,et al.  Evaluation of a pattern matching method for the Tennessee Eastman challenge process , 2006 .

[38]  José Manuel Amigo,et al.  On-line parallel factor analysis. A step forward in the monitoring of bioprocesses in real time , 2008 .

[39]  P. Bishnoi,et al.  Fault diagnosis of multivariate systems using pattern recognition and multisensor data analysis technique , 2001 .

[40]  Michael C. Hout,et al.  Multidimensional Scaling , 2003, Encyclopedic Dictionary of Archaeology.

[41]  Seongkyu Yoon,et al.  Fault diagnosis with multivariate statistical models part I: using steady state fault signatures , 2001 .

[42]  S. Zhao,et al.  Monitoring of Processes with Multiple Operating Modes through Multiple Principle Component Analysis Models , 2004 .

[43]  José C. Menezes,et al.  Multivariate monitoring of fermentation processes with non-linear modelling methods , 2004 .

[44]  Jie Zhang Improved on-line process fault diagnosis through information fusion in multiple neural networks , 2006, Comput. Chem. Eng..

[45]  T. Cox Multidimensional scaling used in multivariate statistical process control , 2001 .

[46]  Christos Georgakis,et al.  Disturbance detection and isolation by dynamic principal component analysis , 1995 .

[47]  Charles W. Champ Multivariate Statistical Process Control with Industrial Applications , 2004 .

[48]  Jie Zhang,et al.  Process monitoring using non-linear statistical techniques , 1997 .

[49]  A. J. Morris,et al.  Statistical performance monitoring of dynamic multivariate processes using state space modelling , 2002 .

[50]  Richard G Brereton,et al.  On-line HPLC combined with multivariate statistical process control for the monitoring of reactions. , 2007, Analytica chimica acta.

[51]  Age K. Smilde,et al.  Single channel event (SCE) for managing sensor failures in MSPC , 2006, Comput. Chem. Eng..

[52]  In-Beum Lee,et al.  Nonlinear dynamic process monitoring based on dynamic kernel PCA , 2004 .

[53]  Manabu Kano,et al.  Evolution of multivariate statistical process control: application of independent component analysis and external analysis , 2004, Comput. Chem. Eng..

[54]  Jie Zhang,et al.  Performance monitoring of processes with multiple operating modes through multiple PLS models , 2006 .

[55]  Carl-Fredrik Mandenius,et al.  Applying process monitoring with multivariate analysis through a knowledge-based systems approach to a paperboard machine , 2005, Comput. Ind..

[56]  S. Joe Qin,et al.  Reconstruction-Based Fault Identification Using a Combined Index , 2001 .

[57]  Age K. Smilde,et al.  Generalized contribution plots in multivariate statistical process monitoring , 2000 .

[58]  Raghunathan Rengaswamy,et al.  A review of process fault detection and diagnosis: Part III: Process history based methods , 2003, Comput. Chem. Eng..

[59]  Seongkyu Yoon,et al.  Statistical and causal model‐based approaches to fault detection and isolation , 2000 .

[60]  Jesús Picó,et al.  Online monitoring of batch processes using multi-phase principal component analysis , 2006 .

[61]  ChangKyoo Yoo,et al.  Fault detection of batch processes using multiway kernel principal component analysis , 2004, Comput. Chem. Eng..

[62]  J. Macgregor,et al.  Experiences with industrial applications of projection methods for multivariate statistical process control , 1996 .

[63]  Ali Cinar,et al.  Intelligent real-time performance monitoring and quality prediction for batch/fed-batch cultivations. , 2004, Journal of biotechnology.

[64]  Rajagopalan Srinivasan,et al.  Online monitoring of multi-phase batch processes using phase-based multivariate statistical process control , 2008, Comput. Chem. Eng..

[65]  Xue Z. Wang,et al.  Multidimensional visualisation for process historical data analysis: a comparative study with multivariate statistical process control , 2005 .

[66]  In-Beum Lee,et al.  Adaptive multivariate statistical process control for monitoring time-varying processes , 2006 .

[67]  J. Edward Jackson,et al.  A User's Guide to Principal Components. , 1991 .

[68]  Ali Cinar,et al.  Real-time batch process supervision by integrated knowledge-based systems and multivariate statistical methods , 2003 .

[69]  ChangKyoo Yoo,et al.  On-line monitoring of batch processes using multiway independent component analysis , 2004 .

[70]  B. Bakshi Multiscale PCA with application to multivariate statistical process monitoring , 1998 .

[71]  Barry M. Wise,et al.  The process chemometrics approach to process monitoring and fault detection , 1995 .

[72]  M. Goldstein,et al.  Multivariate Analysis: Methods and Applications , 1984 .

[73]  S. Joe Qin,et al.  Statistical process monitoring: basics and beyond , 2003 .

[74]  Salvador García Muñoz,et al.  Data-based latent variable methods for process analysis, monitoring and control , 2005, Comput. Chem. Eng..

[75]  Raghunathan Rengaswamy,et al.  A review of process fault detection and diagnosis: Part II: Qualitative models and search strategies , 2003, Comput. Chem. Eng..

[76]  Moamar Sayed Mouchaweh,et al.  A process monitoring module based on fuzzy logic and pattern recognition , 2004, Int. J. Approx. Reason..

[77]  ChangKyoo Yoo,et al.  Statistical monitoring of dynamic processes based on dynamic independent component analysis , 2004 .

[78]  Theodora Kourti,et al.  Process analysis, monitoring and diagnosis, using multivariate projection methods , 1995 .

[79]  Gang Chen,et al.  Predictive on-line monitoring of continuous processes , 1998 .

[80]  Ramanathan Gnanadesikan,et al.  Methods for statistical data analysis of multivariate observations , 1977, A Wiley publication in applied statistics.

[81]  P. Groenen,et al.  Modern Multidimensional Scaling: Theory and Applications , 1999 .

[82]  Jonathan E. Cooper,et al.  Dynamic Multivariate Statistical Process Control using Subspace Identification , 2004 .

[83]  Alberto Ferrer,et al.  Multivariate SPC of a sequencing batch reactor for wastewater treatment , 2007 .

[84]  Ali Cinar,et al.  Intelligent process monitoring by interfacing knowledge-based systems and multivariate statistical monitoring , 2000 .

[85]  Paul E. Green,et al.  Multidimensional Scaling: Concepts and Applications , 1989 .

[86]  Young-Hak Lee,et al.  Process improvement methodology based on multivariate statistical analysis methods , 2004 .

[87]  H. Hotelling The Generalization of Student’s Ratio , 1931 .

[88]  T. McAvoy,et al.  Nonlinear principal component analysis—Based on principal curves and neural networks , 1996 .

[89]  Janos Gertler,et al.  Fault detection and diagnosis in engineering systems , 1998 .

[90]  W. Woodall,et al.  Multivariate CUSUM Quality- Control Procedures , 1985 .

[91]  Raghunathan Rengaswamy,et al.  A review of process fault detection and diagnosis: Part I: Quantitative model-based methods , 2003, Comput. Chem. Eng..