Prediction-Correction Algorithms for Time-Varying Constrained Optimization

This paper develops online algorithms to track solutions of time-varying constrained optimization problems. Particularly, resembling workhorse Kalman filtering-based approaches for dynamical systems, the proposed methods involve prediction-correction steps to provably track the trajectory of the optimal solutions of time-varying convex problems. The merits of existing prediction-correction methods have been shown for unconstrained problems and for setups where computing the inverse of the Hessian of the cost function is computationally affordable. This paper addresses the limitations of existing methods by tackling constrained problems and by designing first-order prediction steps that rely on the Hessian of the cost function (and do not require the computation of its inverse). In addition, the proposed methods are shown to improve the convergence speed of existing prediction-correction methods when applied to unconstrained problems. Numerical simulations corroborate the analytical results and showcase performance and benefits of the proposed algorithms. A realistic application of the proposed method to real-time control of energy resources is presented.

[1]  Ufuk Topcu,et al.  Design and Stability of Load-Side Primary Frequency Control in Power Systems , 2013, IEEE Transactions on Automatic Control.

[2]  Jan Swevers,et al.  Time-Optimal Path Tracking for Robots: A Convex Optimization Approach , 2009, IEEE Transactions on Automatic Control.

[3]  Emiliano Dall'Anese,et al.  A First-order Prediction-Correction Algorithm for Time-varying (Constrained) Optimization , 2017 .

[4]  Aryan Mokhtari,et al.  A Class of Prediction-Correction Methods for Time-Varying Convex Optimization , 2015, IEEE Transactions on Signal Processing.

[5]  Justin K. Romberg,et al.  Discrete and Continuous-Time Soft-Thresholding for Dynamic Signal Recovery , 2014, IEEE Transactions on Signal Processing.

[6]  J. Löfberg,et al.  Convex Optimization approach for Time-Optimal Path Tracking of Robots with Speed Dependent Constraints , 2011 .

[7]  Adrien B. Taylor,et al.  Convex interpolation and performance estimation of first-order methods for convex optimization , 2017 .

[8]  Wei Ren,et al.  Distributed Continuous-Time Convex Optimization With Time-Varying Cost Functions , 2017, IEEE Transactions on Automatic Control.

[9]  Eugene L. Allgower,et al.  Numerical continuation methods - an introduction , 1990, Springer series in computational mathematics.

[10]  A. Yu. Popkov,et al.  Gradient Methods for Nonstationary Unconstrained Optimization Problems , 2005 .

[11]  O. Nelles,et al.  An Introduction to Optimization , 1996, IEEE Antennas and Propagation Magazine.

[12]  Manfred Morari,et al.  Embedded Online Optimization for Model Predictive Control at Megahertz Rates , 2013, IEEE Transactions on Automatic Control.

[13]  Steven H. Low,et al.  An Online Gradient Algorithm for Optimal Power Flow on Radial Networks , 2016, IEEE Journal on Selected Areas in Communications.

[14]  Jens Frahm,et al.  Real-time MRI: recent advances using radial FLASH. , 2012 .

[15]  Pantelis Sopasakis,et al.  Accelerated reconstruction of a compressively sampled data stream , 2016, 2016 24th European Signal Processing Conference (EUSIPCO).

[16]  Geert Leus,et al.  On non-differentiable time-varying optimization , 2015, 2015 IEEE 6th International Workshop on Computational Advances in Multi-Sensor Adaptive Processing (CAMSAP).

[17]  A. Nagurney,et al.  Projected Dynamical Systems and Evolutionary Variational Inequalities via Hilbert Spaces with Applications1 , 2005 .

[18]  Georgios B. Giannakis,et al.  Joint Community and Anomaly Tracking in Dynamic Networks , 2015, IEEE Transactions on Signal Processing.

[19]  Fei Chen,et al.  Time-varying convex optimization for double-integrator dynamics over a directed network , 2016, 2016 35th Chinese Control Conference (CCC).

[20]  Victor M. Zavala,et al.  Real-Time Nonlinear Optimization as a Generalized Equation , 2010, SIAM J. Control. Optim..

[21]  Wei Ren,et al.  Distributed Continuous-Time Convex Optimization With Time-Varying Cost Functions , 2015, IEEE Transactions on Automatic Control.

[22]  Marius Pesavento,et al.  An Online Parallel and Distributed Algorithm for Recursive Estimation of Sparse Signals , 2015 .

[23]  Florian Dörfler,et al.  Fast power system analysis via implicit linearization of the power flow manifold , 2015, 2015 53rd Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[24]  R. Tyrrell Rockafellar,et al.  An Euler-Newton Continuation Method for Tracking Solution Trajectories of Parametric Variational Inequalities , 2013, SIAM J. Control. Optim..

[25]  Wei Ren,et al.  Distributed convex optimization of time-varying cost functions for double-integrator systems using nonsmooth algorithms , 2015, 2015 American Control Conference (ACC).

[26]  Yang Yang,et al.  An Online Parallel Algorithm for Recursive Estimation of Sparse Signals , 2015, IEEE Transactions on Signal and Information Processing over Networks.

[27]  Stephen P. Boyd,et al.  A Primer on Monotone Operator Methods , 2015 .

[28]  Qing Ling,et al.  Decentralized Dynamic Optimization Through the Alternating Direction Method of Multipliers , 2013, IEEE Transactions on Signal Processing.

[29]  R. Rockafellar,et al.  Implicit Functions and Solution Mappings , 2009 .

[30]  Yurii Nesterov,et al.  Towards non-symmetric conic optimization , 2012, Optim. Methods Softw..

[31]  Sairaj V. Dhople,et al.  Design of distributed controllers seeking optimal power flow solutions under communication constraints , 2016, 2016 IEEE 55th Conference on Decision and Control (CDC).

[32]  Namrata Vaswani,et al.  Recursive Recovery of Sparse Signal Sequences From Compressive Measurements: A Review , 2016, IEEE Transactions on Signal Processing.

[33]  Emiliano Dall'Anese,et al.  Optimal power flow pursuit , 2016, 2016 American Control Conference (ACC).

[34]  J. Bank,et al.  Development of a High Resolution, Real Time, Distribution-Level Metering System and Associated Visualization, Modeling, and Data Analysis Functions , 2013 .

[35]  Lutz Gröll,et al.  Lateral Vehicle Trajectory Optimization Using Constrained Linear Time-Varying MPC , 2017, IEEE Transactions on Intelligent Transportation Systems.

[36]  Maojiao Ye,et al.  Distributed optimization for systems with time-varying quadratic objective functions , 2015, 2015 54th IEEE Conference on Decision and Control (CDC).

[37]  Colin Neil Jones,et al.  A Parametric Nonconvex Decomposition Algorithm for Real-Time and Distributed NMPC , 2016, IEEE Transactions on Automatic Control.

[38]  Alejandro Ribeiro,et al.  Prediction-Correction Interior-Point Method for Time-Varying Convex Optimization , 2016, IEEE Transactions on Automatic Control.

[39]  Justin K. Romberg,et al.  Sparse Recovery of Streaming Signals Using $\ell_1$-Homotopy , 2013, IEEE Transactions on Signal Processing.

[40]  Andrey Bernstein,et al.  Design of Resource Agents with Guaranteed Tracking Properties for Real-Time Control of Electrical Grids , 2015, ArXiv.

[41]  Aryan Mokhtari,et al.  Decentralized Prediction-Correction Methods for Networked Time-Varying Convex Optimization , 2016, IEEE Transactions on Automatic Control.

[42]  Anna Nagurney,et al.  Evolution variational inequalities and projected dynamical systems with application to human migration , 2006, Math. Comput. Model..

[43]  Alejandro Ribeiro,et al.  D4L: Decentralized dynamic discriminative dictionary learning , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[44]  Alejandro Ribeiro,et al.  Self-triggered time-varying convex optimization , 2016, 2016 IEEE 55th Conference on Decision and Control (CDC).

[45]  Alejandro Ribeiro,et al.  Interior point method for dynamic constrained optimization in continuous time , 2015, 2016 American Control Conference (ACC).

[46]  Yurii Nesterov,et al.  Double Smoothing Technique for Large-Scale Linearly Constrained Convex Optimization , 2012, SIAM J. Optim..

[47]  Stephen M. Robinson,et al.  Strongly Regular Generalized Equations , 1980, Math. Oper. Res..

[48]  Alejandro Ribeiro,et al.  D-MAP: Distributed Maximum a Posteriori Probability Estimation of Dynamic Systems , 2013, IEEE Transactions on Signal Processing.

[49]  Stephen P. Boyd,et al.  Convex Optimization , 2004, Algorithms and Theory of Computation Handbook.