A Proximal Atomic Coordination Algorithm for Distributed Optimization

We present a unified framework for distributed convex optimization using an algorithm called proximal atomic coordination (PAC). PAC is based on the prox-linear approach and we prove that it achieves convergence in both objective values and distance to feasibility with rate o(1/τ), where τ is the number of algorithmic iterations. We further prove that linear convergence is achieved when the objective functions are strongly convex and strongly smooth with condition number κ f , with the number of iterations on the order of square-root of κ f . This convergence rate matches the best known convergence results for distributed algorithms based on the popular alternating direction method of multipliers (ADMM) method. We also demonstrate how various decomposition strategies and coordination graphs relate to the convergence rate of PAC. We then discuss the advantages of PAC using the notions of privacy and algorithmic complexity, the latter of which involves complexities in iteration, computation, communication and storage. The theoretical results are validated using a power distribution grid in the context of optimization of power flow.

[1]  Maria Prandini,et al.  Distributed Constrained Optimization and Consensus in Uncertain Networks via Proximal Minimization , 2016, IEEE Transactions on Automatic Control.

[2]  W. Xu,et al.  Extended transmission line loadability curve by including voltage stability constrains , 2008, 2008 IEEE Canada Electric Power Conference.

[3]  K. Karthikeyan,et al.  Automatic tap changing in transformers for power quality enhancement in a smart grid distribution system , 2016, 2016 International Conference on Electrical, Electronics, and Optimization Techniques (ICEEOT).

[4]  Anuradha M. Annaswamy,et al.  A practical integration of automatic generation control and Demand Response , 2016, 2016 American Control Conference (ACC).

[5]  Frances Bell,et al.  Secondary voltage and reactive power support via smart inverters on a high-penetration distributed photovoltaic circuit , 2016, 2016 IEEE Power & Energy Society Innovative Smart Grid Technologies Conference (ISGT).

[6]  K. Mani Chandy,et al.  Equivalence of branch flow and bus injection models , 2012, 2012 50th Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[7]  A. V. Meier Electric power systems : a conceptual introduction , 2006 .

[8]  Francisco de Leon,et al.  Conservation Voltage Reduction , 2016 .

[9]  Tom Fleischer Handbook Of Optimization In Complex Networks Theory And Applications , 2016 .

[10]  Dimitri P. Bertsekas,et al.  Incremental Gradient, Subgradient, and Proximal Methods for Convex Optimization: A Survey , 2015, ArXiv.

[11]  Ιωαννησ Τσιτσικλησ,et al.  PROBLEMS IN DECENTRALIZED DECISION MAKING AND COMPUTATION , 1984 .

[12]  Stephen P. Boyd,et al.  Distributed Optimization and Statistical Learning via the Alternating Direction Method of Multipliers , 2011, Found. Trends Mach. Learn..

[13]  Gene H. Golub,et al.  Tikhonov Regularization and Total Least Squares , 1999, SIAM J. Matrix Anal. Appl..

[14]  H. Hermes,et al.  Foundations of optimal control theory , 1968 .

[15]  Yoshikazu Fukuyama,et al.  A particle swarm optimization for reactive power and voltage control considering voltage security assessment , 2000 .

[16]  Saba Akram,et al.  Newton Raphson Method , 2015 .

[17]  Tomaso Erseghe,et al.  Distributed Optimal Power Flow Using ADMM , 2014, IEEE Transactions on Power Systems.

[18]  H.-A. Loeliger,et al.  An introduction to factor graphs , 2004, IEEE Signal Process. Mag..

[19]  J. Swinburne Electromagnetic Theory , 1894, Nature.

[20]  Javad Lavaei,et al.  Geometry of Power Flows and Optimization in Distribution Networks , 2012, IEEE Transactions on Power Systems.

[21]  Shengwei Mei,et al.  Optimal Power Flow of Radial Networks and Its Variations: A Sequential Convex Optimization Approach , 2017, IEEE Transactions on Smart Grid.

[22]  Wotao Yin,et al.  On the Global and Linear Convergence of the Generalized Alternating Direction Method of Multipliers , 2016, J. Sci. Comput..

[23]  Aryan Mokhtari,et al.  DQM: Decentralized Quadratically Approximated Alternating Direction Method of Multipliers , 2015, IEEE Transactions on Signal Processing.

[24]  Ufuk Topcu,et al.  Exact Convex Relaxation of Optimal Power Flow in Radial Networks , 2013, IEEE Transactions on Automatic Control.

[25]  M. E. Baran,et al.  Optimal sizing of capacitors placed on a radial distribution system , 1989 .

[26]  Wotao Yin,et al.  Parallel Multi-Block ADMM with o(1 / k) Convergence , 2013, Journal of Scientific Computing.

[27]  R. Tyrrell Rockafellar,et al.  Augmented Lagrangians and Applications of the Proximal Point Algorithm in Convex Programming , 1976, Math. Oper. Res..

[28]  Dimitri P. Bertsekas,et al.  Multiplier methods: A survey , 1975, at - Automatisierungstechnik.

[29]  Juan Pablo Leiva,et al.  Automobile body reinforcement by finite element optimization , 2004 .

[30]  Jean-Yves Audibert Optimization for Machine Learning , 1995 .

[31]  Pascal Bianchi,et al.  Explicit Convergence Rate of a Distributed Alternating Direction Method of Multipliers , 2013, IEEE Transactions on Automatic Control.

[32]  Sean R. Harnett,et al.  Optimization methods for power grid reliability , 2016 .

[33]  Mingbo Liu,et al.  Fully Decentralized Optimal Power Flow of Multi-Area Interconnected Power Systems Based on Distributed Interior Point Method , 2018, IEEE Transactions on Power Systems.

[34]  Felix F. Wu,et al.  Network Reconfiguration in Distribution Systems for Loss Reduction and Load Balancing , 1989, IEEE Power Engineering Review.

[35]  M. E. Baran,et al.  Optimal capacitor placement on radial distribution systems , 1989 .

[36]  Marc Teboulle,et al.  A proximal-based decomposition method for convex minimization problems , 1994, Math. Program..

[37]  Albert Y. S. Lam,et al.  An Optimal and Distributed Method for Voltage Regulation in Power Distribution Systems , 2012, IEEE Transactions on Power Systems.

[38]  Na Li,et al.  Accelerated Distributed Nesterov Gradient Descent , 2017, IEEE Transactions on Automatic Control.

[39]  Henrik Sandberg,et al.  A Survey of Distributed Optimization and Control Algorithms for Electric Power Systems , 2017, IEEE Transactions on Smart Grid.

[40]  Mohammed Odeh,et al.  A Survey of Distributed Query Optimization , 2005, Int. Arab J. Inf. Technol..

[41]  Carlos Guestrin,et al.  Distributed GraphLab : A Framework for Machine Learning and Data Mining in the Cloud , 2012 .

[42]  K. Mani Chandy,et al.  Inverter VAR control for distribution systems with renewables , 2011, 2011 IEEE International Conference on Smart Grid Communications (SmartGridComm).

[43]  Carlo Fischione,et al.  A distributed approach for the optimal power flow problem , 2014, 2016 European Control Conference (ECC).

[44]  Asuman E. Ozdaglar,et al.  Convergence Rate of Distributed ADMM Over Networks , 2016, IEEE Transactions on Automatic Control.

[45]  David Tse,et al.  Geometry of injection regions of power networks , 2011, IEEE Transactions on Power Systems.

[46]  Maria Prandini,et al.  Dual decomposition for multi-agent distributed optimization with coupling constraints , 2016, Autom..

[47]  M. Sydulu,et al.  A detailed literature review on wind forecasting , 2013, 2013 International Conference on Power, Energy and Control (ICPEC).

[48]  Yurii Nesterov,et al.  Introductory Lectures on Convex Optimization - A Basic Course , 2014, Applied Optimization.

[49]  J. Frame Locational marginal pricing , 2001, 2001 IEEE Power Engineering Society Winter Meeting. Conference Proceedings (Cat. No.01CH37194).

[50]  Anuradha M. Annaswamy,et al.  An Integrated Dynamic Market Mechanism for Real-Time Markets and Frequency Regulation , 2016, IEEE Transactions on Sustainable Energy.

[51]  G. Cohen Auxiliary problem principle and decomposition of optimization problems , 1980 .

[52]  Luonan Chen,et al.  Mean field theory for optimal power flow , 1997 .

[53]  Stephen P. Boyd,et al.  Dynamic Network Energy Management via Proximal Message Passing , 2013, Found. Trends Optim..

[54]  John N. Tsitsiklis,et al.  Parallel and distributed computation , 1989 .

[55]  Toshihisa Funabashi,et al.  Analysis on Back-Flow Surge in Wind Farms , 2007 .

[56]  Na Li,et al.  An optimization-based demand response in radial distribution networks , 2012, 2012 IEEE Globecom Workshops.

[57]  Stephen P. Boyd,et al.  A Primer on Monotone Operator Methods , 2015 .

[58]  Jonathan M. Borwein,et al.  Fifty years of maximal monotonicity , 2010, Optim. Lett..

[59]  Fang Yang,et al.  Distributed automation for back-feed network power restoration , 2009, 2009 62nd Annual Conference for Protective Relay Engineers.

[60]  Qing Ling,et al.  On the Linear Convergence of the ADMM in Decentralized Consensus Optimization , 2013, IEEE Transactions on Signal Processing.

[61]  William F. Tinney,et al.  Optimal Power Flow Solutions , 1968 .

[62]  K. Fujisawa,et al.  Semidefinite programming for optimal power flow problems , 2008 .

[63]  Steven H. Low,et al.  Optimal inverter VAR control in distribution systems with high PV penetration , 2011, 2012 IEEE Power and Energy Society General Meeting.

[64]  Brian Everitt Introduction to Optimization Methods and Their Application in Statistics. , 1989 .

[65]  G. Minty Monotone (nonlinear) operators in Hilbert space , 1962 .

[66]  G. Stephanopoulos,et al.  The use of Hestenes' method of multipliers to resolve dual gaps in engineering system optimization , 1975 .

[67]  Xiaorong Xie,et al.  Distributed Optimal Energy Management in Microgrids , 2015, IEEE Transactions on Smart Grid.

[68]  Stephen P. Boyd,et al.  Proximal Algorithms , 2013, Found. Trends Optim..

[69]  Steven H. Low,et al.  Branch Flow Model: Relaxations and Convexification—Part I , 2012, IEEE Transactions on Power Systems.

[70]  Boris Rohal’-Ilkiv,et al.  Model Predictive Vibration Control: Efficient Constrained MPC Vibration Control for Lightly Damped Mechanical Structures , 2012 .

[71]  Anders Hansson,et al.  Distributed Primal-dual Interior-point Methods for Solving Loosely Coupled Problems Using Message Passing , 2015, 1502.06384.

[72]  C. Schauder Advanced Inverter Technology for High Penetration Levels of PV Generation in Distribution Systems , 2014 .

[73]  F. S. Hover,et al.  Convex Models of Distribution System Reconfiguration , 2012, IEEE Transactions on Power Systems.

[74]  Farrokh Albuyeh,et al.  Grid of the future , 2009, IEEE Power and Energy Magazine.

[75]  Erik Ela,et al.  Impacts of Variability and Uncertainty in Solar Photovoltaic Generation at Multiple Timescales , 2013 .

[76]  Eyal Kushilevitz,et al.  Communication Complexity , 1997, Adv. Comput..

[77]  James L. Kirtley Electric Power Principles: Sources, Conversion, Distribution and Use , 2010 .