论文信息 - Improved Hessian estimation for adaptive random directions stochastic approximation

Improved Hessian estimation for adaptive random directions stochastic approximation

We propose an improved Hessian estimation scheme for the second-order random directions stochastic approximation (2RDSA) algorithm [1]. The proposed scheme, inspired by [2], reduces the error in the Hessian estimate by (i) incorporating a zero-mean feedback term; and (ii) optimizing the step-sizes used in the Hessian recursion of 2RDSA.We prove that 2RDSA with our Hessian improvement scheme (2RDSA-IH) converges asymptotically to the true Hessian. The advantage with 2RDSA-IH is that it requires only 75% of the simulation cost per-iteration for 2SPSA with improved Hessian estimation (2SPSA-IH) [2]. Numerical experiments show that 2RDSA-IH outperforms both 2SPSA-IH and 2RDSA without the improved Hessian estimation scheme.

Shalabh Bhatnagar | A. PrashanthL. | Sai Koti Reddy Danda | S. Bhatnagar | A. PrashanthL.

[1] G. Pflug. Stochastic Approximation Methods for Constrained and Unconstrained Systems - Kushner, HJ.; Clark, D.S. , 1980 .

[2] J. Spall. Multivariate stochastic approximation using a simultaneous perturbation gradient approximation , 1992 .

[3] Dimitri P. Bertsekas,et al. Nonlinear Programming , 1997 .

[4] D. C. Chin,et al. Comparative study of stochastic algorithms for system optimization based on gradient approximations , 1997, IEEE Trans. Syst. Man Cybern. Part B.

[5] J. Spall. Adaptive stochastic approximation by the simultaneous perturbation method , 1998, Proceedings of the 37th IEEE Conference on Decision and Control (Cat. No.98CH36171).

[6] James C. Spall. Feedback and Weighting Mechanisms for Improving Jacobian Estimates in the Adaptive Simultaneous Perturbation Algorithm , 2009, IEEE Trans. Autom. Control..

[7] Phillipp Meister,et al. Stochastic Recursive Algorithms For Optimization Simultaneous Perturbation Methods , 2016 .

[8] Abubakr Gafar Abdalla,et al. Probability Theory , 2017, Encyclopedia of GIS.

[9] Shalabh Bhatnagar,et al. Adaptive System Optimization Using Random Directions Stochastic Approximation , 2015, IEEE Transactions on Automatic Control.