Degradation modeling and monitoring of machines using operation-specific hidden Markov models

In this article, a novel data-driven approach to monitoring of systems operating under variable operating conditions is described. The method is based on characterizing the degradation process via a set of operation-specific hidden Markov models (HMMs), whose hidden states represent the unobservable degradation states of the monitored system while its observable symbols represent the sensor readings. Using the HMM framework, modeling, identification, and monitoring methods are detailed that allow one to identify an HMM of degradation for each operation from mixed-operation data and perform operation-specific monitoring of the system. Using a large data set provided by a major manufacturer, the new methods are applied to a semiconductor manufacturing process running multiple operations in a production environment.

[1]  Cheol Hoon Park,et al.  Training Hidden Markov Models by Hybrid Simulated Annealing for Visual Speech Recognition , 2006, 2006 IEEE International Conference on Systems, Man and Cybernetics.

[2]  Carey Bunks,et al.  CONDITION-BASED MAINTENANCE OF MACHINES USING HIDDEN MARKOV MODELS , 2000 .

[3]  Jin-Hyung Kim,et al.  An HMM-Based Threshold Model Approach for Gesture Recognition , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Larry P. Heck,et al.  Mechanical system monitoring using hidden Markov models , 1991, [Proceedings] ICASSP 91: 1991 International Conference on Acoustics, Speech, and Signal Processing.

[5]  M. V. Velzen,et al.  Self-organizing maps , 2007 .

[6]  K. Loparo,et al.  HMM-Based Fault Detection and Diagnosis Scheme for Rolling Element Bearings , 2005 .

[7]  Chu,et al.  Direct observation of Coulomb crystals and liquids in strongly coupled rf dusty plasmas. , 1994, Physical review letters.

[8]  Daming Lin,et al.  A review on machinery diagnostics and prognostics implementing condition-based maintenance , 2006 .

[9]  Dragan Djurdjanovic,et al.  Operation-dependent maintenance scheduling in flexible manufacturing systems , 2012 .

[10]  Cuneyt Oysu,et al.  Drill wear monitoring using cutting force signals , 2004 .

[11]  Padhraic J. Smyth,et al.  Hidden Markov models for fault detection in dynamic systems , 1993 .

[12]  J. George Shanthikumar,et al.  COMBINED PRODUCTION AND MAINTENANCE SCHEDULING FOR A MULTIPLE‐PRODUCT, SINGLE‐ MACHINE PRODUCTION SYSTEM , 2009 .

[13]  Bill Keller,et al.  Improved Learning for Hidden Markov Models Using Penalized Training , 2002, AICS.

[14]  D. B. Paul.  Training of HMM recognizers by simulated annealing , 1985, ICASSP '85. IEEE International Conference on Acoustics, Speech, and Signal Processing.

[15]  John J. Grefenstette,et al.  Optimization of Control Parameters for Genetic Algorithms , 1986, IEEE Transactions on Systems, Man, and Cybernetics.

[16]  Seungchul Lee,et al.  Joint decision making for maintenance and production scheduling of production systems , 2013 .

[17]  N. Thatphithakkul,et al.  HMM parameter optimization using tabu search [speech recognition] , 2004, IEEE International Symposium on Communications and Information Technology, 2004. ISCIT 2004..

[18]  Haiying Tu,et al.  Detecting, tracking, and counteracting terrorist networks via hidden Markov models , 2004, 2004 IEEE Aerospace Conference Proceedings (IEEE Cat. No.04TH8720).

[19]  Joseph Mathew,et al.  Rotating machinery prognostics. State of the art, challenges and opportunities , 2009 .

[20]  Elijah Kannatey-Asibu,et al.  Hidden Markov model-based tool wear monitoring in turning , 2002 .

[21]  Mark J. F. Gales,et al.  The Application of Hidden Markov Models in Speech Recognition , 2007, Found. Trends Signal Process..

[22]  Yongyong He,et al.  Hidden Markov model-based fault diagnostics method in speed-up and speed-down process for rotating machinery , 2005 .

[23]  Héctor Pomares,et al.  Statistical analysis of the main parameters involved in the design of a genetic algorithm , 2002, IEEE Trans. Syst. Man Cybern. Part C.

[24]  Lawrence R. Rabiner,et al.  A tutorial on hidden Markov models and selected applications in speech recognition , 1989, Proc. IEEE.

[25]  Dragan Djurdjanovic,et al.  Dynamic feature monitoring technique applied to thin film deposition processes in an industrial pecvd tool , 2011 .

[26]  Dorothea Heiss-Czedik,et al.  An Introduction to Genetic Algorithms. , 1997, Artificial Life.

[27]  John Yearwood,et al.  A Constraint-Based Evolutionary Learning Approach to the Expectation Maximization for Optimal Estimation of the Hidden Markov Model for Speech Signal Modeling , 2009, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[28]  Kim-Fung Man,et al.  Optimisation of HMM topology and its model parameters by genetic algorithms , 2001, Pattern Recognit..

[29]  Lalit M. Patnaik,et al.  Genetic algorithms: a survey , 1994, Computer.

[30]  Adam G. Rehorn,et al.  State-of-the-art methods and results in tool condition monitoring: a review , 2005 .

[31]  John Yearwood,et al.  A stochastic version of Expectation Maximization algorithm for better estimation of Hidden Markov Model , 2009, Pattern Recognit. Lett..

[32]  Monson H. Hayes,et al.  Hidden Markov models for face recognition , 1998, Proceedings of the 1998 IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP '98 (Cat. No.98CH36181).

[33]  L. R. Rabiner,et al.  Some properties of continuous hidden Markov model representations , 1985, AT&T Technical Journal.

[34]  Jeng-Shyang Pan,et al.  Optimization of HMM by the Tabu Search Algorithm , 2004, J. Inf. Sci. Eng..

[35]  S.D.J. McArthur,et al.  Learning Models of Plant Behavior for Anomaly Detection and Condition Monitoring , 2007, 2007 International Conference on Intelligent Systems Applications to Power Systems.

[36]  Les E. Atlas,et al.  Hidden Markov models for monitoring machining tool-wear , 2000, 2000 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings (Cat. No.00CH37100).

[37]  Ge Bai,et al.  A Novel Genetic Algorithm Based on Tabu Search for HMM Optimization , 2008, 2008 Fourth International Conference on Natural Computation.

[38]  Jr. G. Forney,et al.  Viterbi Algorithm , 1973, Encyclopedia of Machine Learning.

[39]  Chiman Kwan,et al.  An integrated approach to bearing fault diagnostics and prognostics , 2005, Proceedings of the 2005, American Control Conference, 2005..

[40]  Mohamed Slimane,et al.  Optimizing Hidden Markov Models with a Genetic Algorithm , 1995, Artificial Evolution.

[41]  V. Purushotham,et al.  Multi-fault diagnosis of rolling bearing elements using wavelet analysis and hidden Markov model based fault recognition , 2005 .

[42]  David He,et al.  A segmental hidden semi-Markov model (HSMM)-based diagnostics and prognostics framework and methodology , 2007 .