Integrated maintenance and operations decision making with imperfect degradation state observations

Abstract In highly flexible and integrated manufacturing systems, such as semiconductor fabs, strong interactions between the equipment condition, operations executed on the various machines and the outgoing product quality necessitate integrated decision making in the domains of maintenance scheduling and production operations. Furthermore, in highly complex manufacturing equipment, the underlying condition is not directly observable and can only be inferred probabilistically from the available sensor readings. In order to deal with interactions between maintenance and production operations in Flexible Manufacturing Systems (FMSs) in which equipment conditions are not perfectly observable, we propose in this paper a decision-making method based on a Partially Observable Markov Decision Processes (POMDP's), yielding an integrated policy in the realms of maintenance scheduling and production sequencing. Optimization was pursued using a metaheuristic method that used the results of discrete-event simulations of the underlying manufacturing system. The new approach is demonstrated in simulations of a generic semiconductor manufacturing cluster tool. The results showed that, regardless of uncertainties in the knowledge of actual equipment conditions, jointly making maintenance and production sequencing decisions consistently outperforms the current practice of making these decisions separately.

[1]  Karen Willcox,et al.  Methodology for Path Planning with Dynamic Data-Driven Flight Capability Estimation , 2017 .

[2]  Edward J. Sondik,et al.  The Optimal Control of Partially Observable Markov Processes over a Finite Horizon , 1973, Oper. Res..

[3]  Karim Atashgar,et al.  A Joint Reliability and Imperfect Opportunistic Maintenance Optimization for a Multi-State Weighted k-out-of-n System Considering Economic Dependence and Periodic Inspection , 2017, Qual. Reliab. Eng. Int..

[4]  Lisa M. Maillart,et al.  Structured Replacement Policies for Components with Complex Degradation Processes and Dedicated Sensors , 2011, Oper. Res..

[5]  Laurent El Ghaoui,et al.  Robust Control of Markov Decision Processes with Uncertain Transition Matrices , 2005, Oper. Res..

[6]  Deyi Zhang,et al.  A Hidden Markov Model Based Approach to Modeling and Monitoring of Processes with Imperfect Maintenance , 2019, Proceedings of the 4th International Conference on the Industry 4.0 Model for Advanced Manufacturing.

[7]  Ronald A. Howard,et al.  Dynamic Programming and Markov Processes , 1960 .

[8]  S. Ross Quality Control under Markovian Deterioration , 1971 .

[9]  Manuel Laguna,et al.  Tabu Search , 1997 .

[10]  Deyi Zhang,et al.  Bayesian Identification of Hidden Markov Models and Their Use for Condition-Based Monitoring , 2016, IEEE Transactions on Reliability.

[11]  M. A. Girshick,et al.  A BAYES APPROACH TO A QUALITY CONTROL MODEL , 1952 .

[12]  Jing Zhou,et al.  Integrated load-allocation and condition-based maintenance policy in a multi-unit load-sharing deteriorating system , 2007 .

[13]  G. Iyengar,et al.  A Near-Optimal Maintenance Policy for Automated DR Devices , 2016 .

[14]  Qing Chang,et al.  Imperfect corrective maintenance scheduling for energy efficient manufacturing systems through online task allocation method , 2019, Journal of Manufacturing Systems.

[15]  Frank Rudzicz,et al.  Identifying and Avoiding Confusion in Dialogue with People with Alzheimer’s Disease , 2017, CL.

[16]  Mahmoud El Chamie,et al.  Robust Action Selection in Partially Observable Markov Decision Processes with Model Uncertainty , 2018, 2018 IEEE Conference on Decision and Control (CDC).

[17]  Ismail Hakki Cedimoglu,et al.  The strategies and parameters of tabu search for job-shop scheduling , 2004, J. Intell. Manuf..

[18]  George E. Monahan,et al.  A Survey of Partially Observable Markov Decision Processes: Theory, Models, and Algorithms , 2007 .

[19]  Dragan Djurdjanovic,et al.  Integrated Maintenance Decision-Making and Product Sequencing in Flexible Manufacturing Systems , 2015 .

[20]  Harriet Black Nembhard,et al.  A Modeling Approach to Maintenance Decisions Using Statistical Quality Control and Optimization , 2005 .

[21]  C. White Optimal control-limit strategies for a partially observed replacement problem† , 1979 .

[22]  Mustapha Nourelfath,et al.  Integrated preventive maintenance and production decisions for imperfect processes , 2016, Reliab. Eng. Syst. Saf..

[23]  Lisa M. Maillart,et al.  Maintenance policies for systems with condition monitoring and obvious failures , 2006 .

[24]  Lin Li,et al.  Cost-Effective Updated Sequential Predictive Maintenance Policy for Continuously Monitored Degrading Systems , 2010, IEEE Transactions on Automation Science and Engineering.

[25]  El-Houssaine Aghezzaf,et al.  Selective maintenance optimization for systems operating missions and scheduled breaks with stochastic durations , 2017 .

[26]  Alaa Chateauneuf,et al.  Imperfect Preventive Maintenance Policy for Complex Systems Based on Bayesian Networks , 2017, Qual. Reliab. Eng. Int..

[27]  Yu Ding,et al.  Supplement to : Optimal Maintenance Strategies for Wind Turbine Systems Under Stochastic Weather Conditions , 2010 .

[28]  Fred W. Glover,et al.  A user's guide to tabu search , 1993, Ann. Oper. Res..

[29]  William S. Lovejoy,et al.  Some Monotonicity Results for Partially Observed Markov Decision Processes , 1987, Oper. Res..

[30]  Christian Goerick,et al.  Online adaptation of uncertain models using neural network priors and partially observable planning , 2019, 2019 International Conference on Robotics and Automation (ICRA).

[31]  Morteza Pourgharibshahi,et al.  An optimal maintenance policy for machine replacement problem using dynamic programming , 2017 .

[32]  Daniel Straub,et al.  Long-term adaption decisions via fully and partially observable Markov decision processes , 2017 .

[33]  Tianyi Wu,et al.  Proactive maintenance scheduling in consideration of imperfect repairs and production wait time , 2019, Journal of Manufacturing Systems.

[34]  Shahrul Kamaruddin,et al.  Maintenance policy optimization—literature review and directions , 2015 .

[35]  Ji Hwan Cha,et al.  New stochastic models for preventive maintenance and maintenance optimization , 2016, Eur. J. Oper. Res..

[36]  Dragan Djurdjanovic,et al.  Operation-dependent maintenance scheduling in flexible manufacturing systems , 2012 .

[37]  Dragan Djurdjanovic,et al.  Joint Maintenance and Production Operations Decision Making in Flexible Manufacturing Systems , 2012 .

[38]  J.P. How,et al.  Robust Markov Decision Processes using Sigma Point sampling , 2008, 2008 American Control Conference.

[39]  H. M. Taylor Markovian sequential replacement processes , 1965 .