Adaptive Multi-scale Prognostics and Health Management for Smart Manufacturing Systems

The Adaptive Multi-scale Prognostics and Health Management (AM-PHM) is a methodology designed to enable PHM in smart manufacturing systems. In application, PHM information is not yet fully utilized in higher-level decision-making in manufacturing systems. AM-PHM leverages and integrates lower-level PHM information such as from a machine or component with hierarchical relationships across the component, machine, work cell, and assembly line levels in a manufacturing system. The AM-PHM methodology enables the creation of actionable prognostic and diagnostic intelligence up and down the manufacturing process hierarchy. Decisions are then made with the knowledge of the current and projected health state of the system at decision points along the nodes of the hierarchical structure. To overcome the issue of exponential explosion of complexity associated with describing a large manufacturing system, the AM-PHM methodology takes a hierarchical Markov Decision Process (MDP) approach into describing the system and solving for an optimized policy. A description of the AM-PHM methodology is followed by a simulated industry-inspired example to demonstrate the effectiveness of AM-PHM.

[1]  A. Anderson.  Report to the President on Ensuring American Leadership in Advanced Manufacturing. , 2011 .

[2]  Sohrab Asgarpoor,et al.  Optimum Maintenance Policy Using Semi-Markov Decision Processes , 2006 .

[3]  Kishor S. Trivedi,et al.  Optimization for condition-based maintenance with semi-Markov decision process , 2005, Reliab. Eng. Syst. Saf..

[4]  Benjamin Y. Choo,et al.  Adaptive Multi-scale PHM for Robotic Assembly Processes , 2015, Proceedings of the Annual Conference of the Prognostics and Health Management Society. Prognostics and Health Management Society. Conference.

[5]  Ying Peng,et al.  Current status of machine prognostics in condition-based maintenance: a review , 2010 .

[6]  Antoine Grall,et al.  Multi-level predictive maintenance for multi-component systems , 2015, Reliab. Eng. Syst. Saf..

[7]  Samer Madanat,et al.  History-Dependent Bridge Deck Maintenance and Replacement Optimization with Markov Decision Processes , 2007 .

[8]  Lisa M. Maillart,et al.  Maintenance policies for systems with condition monitoring and obvious failures , 2006 .

[9]  Salih O. Duffuaa,et al.  Optimal joint maintenance and operation policies to maximise overall systems effectiveness , 2013 .

[10]  Thomas G. Dietterich.  Hierarchical Reinforcement Learning with the MAXQ Value Function Decomposition , 1999, J. Artif. Intell. Res..

[11]  Doina Precup,et al.  Between MDPs and Semi-MDPs: A Framework for Temporal Abstraction in Reinforcement Learning , 1999, Artif. Intell..

[12]  L. McLaughlin,et al.  Cost-effective condition-based maintenance using markov decision processes , 2006, RAMS '06. Annual Reliability and Maintainability Symposium, 2006..

[13]  Christophe Bérenguer,et al.  Condition-based dynamic maintenance operations planning & grouping. Application to commercial heavy vehicles , 2011, Reliab. Eng. Syst. Saf..

[14]  Antoine Grall,et al.  A condition-based maintenance policy for stochastically deteriorating systems , 2002, Reliab. Eng. Syst. Saf..

[15]  Liliane Pintelon,et al.  A dynamic predictive maintenance policy for complex multi-component systems , 2013, Reliab. Eng. Syst. Saf..

[16]  Yu Ding,et al.  Season-Dependent Condition-Based Maintenance for a Wind Turbine Using a Partially Observed Markov Decision Process , 2010, IEEE Transactions on Power Systems.

[17]  G. Chana,et al.  Optimum maintenance policy with Markov processes , 2006 .

[18]  Jeremy A. Marvel.  Collaborative Robotics: A Gateway into Factory Automation , 2014 .

[19]  Jay Lee,et al.  Prognostics and health management design for rotary machinery systems—Reviews, methodology and applications , 2014 .

[20]  Richard C.M. Yam,et al.  Intelligent Predictive Decision Support System for Condition-Based Maintenance , 2001 .

[21]  Tiedo Tinga,et al.  Reducing costs by clustering maintenance activities for multiple critical units , 2016, Reliab. Eng. Syst. Saf..

[22]  Sung-Hoon Ahn,et al.  Condition monitoring and fault detection of wind turbines and related algorithms: A review , 2009 .

[23]  Brian A. Weiss,et al.  Standards for Prognostics and Health Management (PHM) Techniques within Manufacturing Operations , 2014 .

[24]  Donghua Zhou,et al.  Remaining useful life estimation - A review on the statistical data driven approaches , 2011, Eur. J. Oper. Res..

[25]  Zhigang Tian,et al.  Condition‐based Maintenance Optimization Using Neural Network‐based Health Condition Prediction , 2013, Qual. Reliab. Eng. Int..

[26]  Khac Tuan Huynh,et al.  Multi-Level Decision-Making for The Predictive Maintenance of $k$ -Out-of-$n$ :F Deteriorating Systems , 2015, IEEE Transactions on Reliability.

[27]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[28]  Yu Ding,et al.  Supplement to : Optimal Maintenance Strategies for Wind Turbine Systems Under Stochastic Weather Conditions , 2010 .

[29]  Stuart J. Russell,et al.  Reinforcement Learning with Hierarchies of Machines , 1997, NIPS.

[30]  Richard P. Lippmann,et al.  Proceedings of the 1997 conference on Advances in neural information processing systems 10 , 1990 .

[31]  N. Montgomery,et al.  Reliability functions and optimal decisions using condition data for EDF primary pumps , 2006, 2006 International Conference on Probabilistic Methods Applied to Power Systems.

[32]  Jay Lee,et al.  A review on prognostics and health monitoring of Li-ion battery , 2011 .

[33]  Ruey Huei Yeh.  Optimal maintenance policies for deteriorating systems. , 1993 .

[34]  S. Asgarpoor,et al.  Optimum Maintenance Policy Using Semi-Markov Decision Processes , 2006, 2006 38th North American Power Symposium.

[35]  C. T. Lam,et al.  Optimal maintenance policies for deteriorating systems under various maintenance strategies C. Teresa Lam and R.H. Yeh. , 1993 .

[36]  Yaoyu Li,et al.  A review of recent advances in wind turbine condition monitoring and fault diagnosis , 2009, 2009 IEEE Power Electronics and Machines in Wind Applications.

[37]  Thomas F. Edgar,et al.  Smart manufacturing, manufacturing intelligence and demand-dynamic performance , 2012, Comput. Chem. Eng..

[38]  Lin Ma,et al.  Prognostic modelling options for remaining useful life estimation by industry , 2011 .

[39]  Daming Lin,et al.  A review on machinery diagnostics and prognostics implementing condition-based maintenance , 2006 .

[40]  Maxim Finkelstein,et al.  An optimal age-based group maintenance policy for multi-unit degrading systems , 2015, Reliab. Eng. Syst. Saf..