Efficient Stochastic Approximation Monte Carlo Sampling for Heterogeneous Redundancy Allocation Problem

Existing optimization methods to heterogeneous redundancy allocation problem often suffer from the local-trap problem in optimization, due to the rugged energy landscapes. In this paper, a new optimization paradigm based on the Markov chain Monte Carlo sampling is proposed for solving the heterogeneous redundancy allocation for multi-state systems. We address this in an optimization-by-sampling framework, and propose to sample the intricate distribution over the combinatorial space by a doubly adaptive sampling approach, where the target adaptation favors free random walk on the rugged energy landscape to substantially alleviate the local-trap problem by updating the target distribution on-the-fly, while the proposal adaptation helps improve the sampling efficiency by learning the proposal distribution based on chain history in optimization. Experimental results performed on a range of benchmark instances demonstrated the superiority of the proposed optimization approach compared with the state-of-the-art alternatives in terms of the solution quality or computational efficiency.

[1]  Galit Levitin,et al.  Structure optimization of power system with different redundant elements , 1997 .

[2]  Maw-Sheng Chern,et al.  On the computational complexity of reliability redundancy allocation in a series system , 1992, Oper. Res. Lett..

[3]  D. Elmakis,et al.  Power system structure optimization subject to reliability constraints , 1996 .

[4]  D. Elmakis,et al.  Redundancy optimization for series-parallel multi-state systems , 1998 .

[5]  David W. Coit,et al.  A heuristic for solving the redundancy allocation problem for multi-state series-parallel systems , 2004, Reliab. Eng. Syst. Saf..

[6]  Igor Ushakov Universal Generating Functions , 2013 .

[7]  D. Landau,et al.  Efficient, multiple-range random walk algorithm to calculate the density of states. , 2000, Physical review letters.

[8]  David W. Coit,et al.  Reliability optimization of series-parallel systems using a genetic algorithm , 1996, IEEE Trans. Reliab..

[9]  Jiwen Lu,et al.  Abrupt Motion Tracking Via Intensively Adaptive Markov-Chain Monte Carlo Sampling , 2012, IEEE Transactions on Image Processing.

[10]  Yong Wang,et al.  Heterogeneous Redundancy Allocation for Series-Parallel Multi-State Systems Using Hybrid Particle Swarm Optimization and Local Search , 2012, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[11]  Sung Chang Sup,et al.  Branch-and-bound redundancy optimization for a series system with multiple-choice constraints , 1999 .

[12]  Yuan-Shun Dai,et al.  Availability Modeling and Cost Optimization for the Grid Resource Management System , 2008, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[13]  Wei-Chang Yeh,et al.  A Simple Universal Generating Function Method to Search for All Minimal Paths in Networks , 2009, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[14]  Gregory Levitin,et al.  MSS Reliability Optimization , 2003 .

[15]  Yao Lu,et al.  Polygonal approximation of digital curves using adaptive MCMC sampling , 2010, 2010 IEEE International Conference on Image Processing.

[16]  Way Kuo,et al.  An annotated overview of system-reliability optimization , 2000, IEEE Trans. Reliab..

[17]  R. Carroll,et al.  Stochastic Approximation in Monte Carlo Computation , 2007 .

[18]  C. Hwang,et al.  Optimization Techniques for System Reliability with RedundancyߞA Review , 1977, IEEE Transactions on Reliability.

[19]  Yao Lu,et al.  Abrupt motion tracking via adaptive stochastic approximation Monte Carlo sampling , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[20]  Jin Xu,et al.  On the Convergence of Chemical Reaction Optimization for Combinatorial Optimization , 2013, IEEE Transactions on Evolutionary Computation.

[21]  C. D. Gelatt,et al.  Optimization by Simulated Annealing , 1983, Science.

[22]  Way Kuo,et al.  Recent Advances in Optimal Reliability Allocation , 2007, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[23]  Donald Geman,et al.  Stochastic relaxation, Gibbs distributions, and the Bayesian restoration of images , 1984 .

[24]  Gregory Levitin,et al.  A new approach to solving problems of multi‐state system reliability optimization , 2001 .

[25]  M. Agarwal,et al.  Homogeneous redundancy optimization in multi-state series-parallel systems: A heuristic approach , 2007 .

[26]  W. K. Hastings,et al.  Monte Carlo Sampling Methods Using Markov Chains and Their Applications , 1970 .

[27]  Michel Gendreau,et al.  Tabu search for the redundancy allocation problem of homogenous series-parallel multi-state systems , 2008, Reliab. Eng. Syst. Saf..

[28]  J. Rosenthal,et al.  Coupling and Ergodicity of Adaptive Markov Chain Monte Carlo Algorithms , 2007, Journal of Applied Probability.

[29]  Y. Massim,et al.  Optimal Design and Reliability Evaluation of Multi-State Series-Parallel Power Systems , 2005 .