Power system maintenance planning using value function approximation

Power system maintenance planning is vital for conducting maintenance of power system equipment in an optimal manner. A maintenance model of a system with number of equipment has several states. Solving such a system model would be computationally intractable. This paper investigates the possibility of conducting system level maintenance planning by using a component specific Markov decision process (MDP) model developed for maintenance of equipment. In order to find optimal actions for the system, a value function is approximated using component specific MDP models. In a case study, the optimal actions obtained using the value function approximation (VFA) method are verified by comparing them with the optimal actions obtained using an MDP model developed for the full system.

[1]  S. Asgarpoor,et al.  Optimum Maintenance Policy Using Semi-Markov Decision Processes , 2006, 2006 38th North American Power Symposium.

[2]  P. Jirutitijaroen,et al.  New State Diagrams for Probabilistic Maintenance Models , 2011, IEEE Transactions on Power Systems.

[3]  Martin L. Puterman,et al.  Markov Decision Processes: Discrete Stochastic Dynamic Programming , 1994 .

[4]  C.S. Chang,et al.  Multiobjective Evolutionary Optimization of Maintenance Schedules and Extents for Composite Power Systems , 2009, IEEE Transactions on Power Systems.

[5]  Sohrab Asgarpoor,et al.  Optimum Maintenance Policy Using Semi-Markov Decision Processes , 2006 .

[6]  Ahmed Syed Irshad,et al.  Markov Decision Process , 2011 .

[7]  Panida Jirutitijaroen,et al.  Application of Probabilistic Maintenance Models for Selecting Optimal Inspection Rates Considering Reliability and Cost Tradeoff , 2014, IEEE Transactions on Power Delivery.

[8]  G. J. Anders,et al.  Application of a semi-Markov model and a simulated annealing algorithm for the selection of an optimal maintenance policy for power equipment , 2008 .

[9]  George J. Anders,et al.  Probabilistic evaluation of the effect of maintenance on reliability. An application [to power systems] , 1998 .

[10]  Huan Xu,et al.  Adaptive Maintenance Policies for Aging Devices Using a Markov Decision Process , 2013, IEEE Transactions on Power Systems.

[11]  Habib Rajabi Mashhadi,et al.  Circuit breakers maintenance planning for composite power systems , 2013 .

[12]  Warren B. Powell,et al.  Approximate Dynamic Programming I: Modeling , 2011 .