Passivity-Based Generalization of Primal-Dual Dynamics for Non-Strictly Convex Cost Functions

In this paper, we revisit primal-dual dynamics for convex optimization and present a generalization of the dynamics based on the concept of passivity. It is then proved that supplying a stable zero to one of the integrators in the dynamics allows one to eliminate the assumption of strict convexity on the cost function based on the passivity paradigm together with the invariance principle for Caratheodory systems. We then show that the present algorithm is also a generalization of existing augmented Lagrangian-based primal-dual dynamics, and discuss the benefit of the present generalization in terms of noise reduction and convergence speed.

[1]  Bala Kameshwar Poolla,et al.  Input–Output Performance of Linear–Quadratic Saddle-Point Algorithms With Application to Distributed Resource Allocation Problems , 2020, IEEE Transactions on Automatic Control.

[2]  Masayuki Fujita,et al.  Passivity-Based Control and Estimation in Networked Robotics , 2015 .

[3]  Stephen P. Boyd,et al.  Distributed Optimization and Statistical Learning via the Alternating Direction Method of Multipliers , 2011, Found. Trends Mach. Learn..

[4]  Takayuki Ishizaki,et al.  Passivity-Based Distributed Optimization With Communication Delays Using PI Consensus Algorithm , 2016, IEEE Transactions on Automatic Control.

[5]  Jorge Cortés,et al.  Robust Distributed Linear Programming , 2014, IEEE Transactions on Automatic Control.

[6]  Hassan K. Khalil,et al.  Nonlinear Systems Third Edition , 2008 .

[7]  Ziyang Meng,et al.  A survey of distributed optimization , 2019, Annu. Rev. Control..

[8]  Tsuyoshi Murata,et al.  {m , 1934, ACML.

[9]  Enrique Mallada,et al.  Asymptotic convergence of constrained primal-dual dynamics , 2015, Syst. Control. Lett..

[10]  Jing Wang,et al.  A control perspective for centralized and distributed convex optimization , 2011, IEEE Conference on Decision and Control and European Control Conference.

[11]  P ? ? ? ? ? ? ? % ? ? ? ? , 1991 .

[12]  Ashish Pandharipande,et al.  Sensor-Driven Lighting Control With Illumination and Dimming Constraints , 2015, IEEE Sensors Journal.

[13]  Stephen P. Boyd,et al.  Convex Optimization , 2004, Algorithms and Theory of Computation Handbook.

[14]  Koji Tsumura,et al.  MATHEMATICAL ENGINEERING TECHNICAL REPORTS Control of Smart Grids Based on Price Mechanism and Network Structure , 2012 .

[15]  Mircea Lazar,et al.  Optimal LED-based illumination control via distributed convex optimization , 2014 .

[16]  B. V. Dean,et al.  Studies in Linear and Non-Linear Programming. , 1959 .

[17]  Qingshan Liu,et al.  A Multi-Agent System With a Proportional-Integral Protocol for Distributed Constrained Optimization , 2017, IEEE Transactions on Automatic Control.

[18]  Ashish Pandharipande,et al.  Daylight integrated illumination control of LED systems based on enhanced presence sensing , 2011 .

[19]  Andrea Bacciotti,et al.  Nonpathological Lyapunov functions and discontinuous Carathéodory systems , 2006, Autom..

[20]  Arjan van der Schaft,et al.  A Unifying Energy-Based Approach to Stability of Power Grids With Market Dynamics , 2016, IEEE Transactions on Automatic Control.

[21]  John T. Wen,et al.  A unifying passivity framework for network flow control , 2003, IEEE INFOCOM 2003. Twenty-second Annual Joint Conference of the IEEE Computer and Communications Societies (IEEE Cat. No.03CH37428).

[22]  Na Li,et al.  On the Exponential Stability of Primal-Dual Gradient Dynamics , 2018, IEEE Control Systems Letters.

[23]  Lihua Xie,et al.  Continuous-time Distributed Convex Optimization with Set Constraints , 2014 .

[24]  Xiaoming Hu,et al.  Projected primal-dual gradient flow of augmented Lagrangian with application to distributed maximization of the algebraic connectivity of a network , 2017, Autom..