Stochastic optimisation with inequality constraints using simultaneous perturbations and penalty functions

We present a stochastic approximation algorithm based on penalty function method and a simultaneous perturbation gradient estimate for solving stochastic optimisation problems with general inequality constraints. We present a general convergence result that applies to a class of penalty functions including the quadratic penalty function, the augmented Lagrangian, and the absolute penalty function. We also establish an asymptotic normality result for the algorithm with smooth penalty functions under minor assumptions. Numerical results are given to compare the performance of the proposed algorithm with different penalty functions.

[1]  P. Dupuis,et al.  Asymptotic behavior of constrained stochastic approximations via the theory of large deviations , 1987 .

[2]  Hans-Paul Schwefel,et al.  Evolution and optimum seeking , 1995, Sixth-generation computer technology series.

[3]  Michael C. Fu,et al.  Convergence of simultaneous perturbation stochastic approximation for nondifferentiable optimization , 2003, IEEE Trans. Autom. Control..

[4]  O. Nelles,et al.  An Introduction to Optimization , 1996, IEEE Antennas and Propagation Magazine.

[5]  J. Spall.  Implementation of the simultaneous perturbation algorithm for stochastic optimization , 1998 .

[6]  Payman Sadegh,et al.  Constrained optimization via stochastic approximation with a simultaneous perturbation gradient approximation , 1997, Autom..

[7]  J. Kiefer,et al.  Stochastic Estimation of the Maximum of a Regression Function , 1952 .

[8]  J. Spall,et al.  Model-free control of nonlinear stochastic systems with discrete-time measurements , 1998, IEEE Trans. Autom. Control..

[9]  Harold J. Kushner,et al.  Stochastic Approximation Algorithms and Applications , 1997, Applications of Mathematics.

[10]  Dimitri P. Bertsekas,et al.  Constrained Optimization and Lagrange Multiplier Methods , 1982 .

[11]  Georg Ch. Pflug.  On the Convergence of a Penalty-Type Stochastic Optimization Procedure , 1981 .

[12]  K. Schittkowski,et al.  NONLINEAR PROGRAMMING , 2022 .

[13]  V. Fabian.  On Asymptotic Normality in Stochastic Approximation , 1968 .

[14]  Edwin K. P. Chong,et al.  Analysis of stochastic approximation and related algorithms , 1996 .

[15]  B. Achiriloaie,et al.  VI REFERENCES , 1961 .

[16]  Harold J. Kushner,et al.  wchastic. approximation methods for constrained and unconstrained systems , 1978 .

[17]  I-Jeng Wang,et al.  A constrained simultaneous perturbation stochastic approximation algorithm based on penalty functions , 1998, Proceedings of the 1998 IEEE International Symposium on Intelligent Control (ISIC) held jointly with IEEE International Symposium on Computational Intelligence in Robotics and Automation (CIRA) Intell.

[18]  J. Spall.  Multivariate stochastic approximation using a simultaneous perturbation gradient approximation , 1992 .