Global Optimization: A Distributed Compensation Algorithm and its Convergence Analysis

This paper introduces a distributed compensation approach for the global optimization with separable objective functions and coupled constraints. By employing compensation variables, the global optimization problem can be solved without the information exchange of coupled constraints. The convergence analysis of the proposed algorithm is presented with the convergence condition through which a diminishing step-size with an upper bound can be determined. The convergence rate can be achieved at $O({lnT}/{\sqrt {T}})$ . Moreover, the equilibrium of this algorithm is proved to converge at the optimal solution of the global optimization problem. The effectiveness and the practicability of the proposed algorithm is demonstrated by the parameter optimization problem in smart building.

[1]  D. Kinderlehrer,et al.  An introduction to variational inequalities and their applications , 1980 .

[2]  O. Nelles,et al.  An Introduction to Optimization , 1996, IEEE Antennas and Propagation Magazine.

[3]  Robert Nowak,et al.  Distributed optimization in sensor networks , 2004, Third International Symposium on Information Processing in Sensor Networks, 2004. IPSN 2004.

[4]  Richard R. Brooks,et al.  Distributed Sensor Networks: A Multiagent Perspective , 2008 .

[5]  Asuman E. Ozdaglar,et al.  Approximate Primal Solutions and Rate Analysis for Dual Subgradient Methods , 2008, SIAM J. Optim..

[6]  Stephen P. Boyd,et al.  Distributed Optimization and Statistical Learning via the Alternating Direction Method of Multipliers , 2011, Found. Trends Mach. Learn..

[7]  Angelia Nedic,et al.  A new class of distributed optimization algorithms: application to regression of distributed data , 2012, Optim. Methods Softw..

[8]  Angelia Nedic,et al.  Distributed Random Projection Algorithm for Convex Optimization , 2012, IEEE Journal of Selected Topics in Signal Processing.

[9]  Qingshan Liu,et al.  A One-Layer Projection Neural Network for Nonsmooth Optimization Subject to Linear Equalities and Bound Constraints , 2013, IEEE Transactions on Neural Networks and Learning Systems.

[10]  Anna Scaglione,et al.  Distributed Constrained Optimization by Consensus-Based Primal-Dual Perturbation Method , 2013, IEEE Transactions on Automatic Control.

[11]  Koushik Kar,et al.  Collaborative Energy and Thermal Comfort Management Through Distributed Consensus Algorithms , 2015, IEEE Transactions on Automation Science and Engineering.

[12]  Tingwen Huang,et al.  Cooperative Distributed Optimization in Multiagent Networks With Delays , 2015, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[13]  Qingshan Liu,et al.  A Second-Order Multi-Agent Network for Bound-Constrained Distributed Optimization , 2015, IEEE Transactions on Automatic Control.

[14]  Ruggero Carli,et al.  Distributed Reactive Power Feedback Control for Voltage Regulation and Loss Minimization , 2013, IEEE Transactions on Automatic Control.

[15]  Koushik Kar,et al.  BEES: Real-time occupant feedback and environmental learning framework for collaborative thermal management in multi-zone, multi-occupant buildings , 2016 .

[16]  Xinghuo Yu,et al.  Distributed Event-Triggered Scheme for Economic Dispatch in Smart Grids , 2016, IEEE Transactions on Industrial Informatics.

[17]  Andrea Simonetto,et al.  Primal Recovery from Consensus-Based Dual Decomposition for Distributed Convex Optimization , 2015, J. Optim. Theory Appl..

[18]  Georgios B. Giannakis,et al.  Distributed Stochastic Market Clearing With High-Penetration Wind Power , 2015, IEEE Transactions on Power Systems.

[19]  Asuman E. Ozdaglar,et al.  Convergence Rate of Distributed ADMM Over Networks , 2016, IEEE Transactions on Automatic Control.

[20]  Qingshan Liu,et al.  Distributed Optimization Based on a Multiagent System in the Presence of Communication Delays , 2017, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[21]  Zhihai Rong,et al.  Extortion provides alternative routes to the evolution of cooperation in structured populations. , 2017, Physical review. E.

[22]  Qingshan Liu,et al.  A Multi-Agent System With a Proportional-Integral Protocol for Distributed Constrained Optimization , 2017, IEEE Transactions on Automatic Control.

[23]  Usman A. Khan,et al.  Distributed Subgradient Projection Algorithm Over Directed Graphs , 2016, IEEE Transactions on Automatic Control.

[24]  Maria Prandini,et al.  Dual decomposition for multi-agent distributed optimization with coupling constraints , 2016, Autom..

[25]  Zhi-Quan Luo,et al.  On the linear convergence of the alternating direction method of multipliers , 2012, Mathematical Programming.

[26]  Yiguang Hong,et al.  Constrained Consensus Algorithms With Fixed Step Size for Distributed Convex Optimization Over Multiagent Networks , 2017, IEEE Transactions on Automatic Control.

[27]  Qingshan Liu,et al.  A Collective Neurodynamic Approach to Distributed Constrained Optimization , 2017, IEEE Transactions on Neural Networks and Learning Systems.

[28]  Qingshan Liu,et al.  A Collaborative Neurodynamic Approach to Multiple-Objective Distributed Optimization , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[29]  Nuo Yang,et al.  Unexpected thermal conductivity enhancement in pillared graphene nanoribbon with isotopic resonance , 2018, Physical Review B.

[30]  Zhihai Rong,et al.  The emergence of cooperation-extortion alliance on scale-free networks with normalized payoff , 2018, EPL (Europhysics Letters).

[31]  Lei Wang,et al.  Chance Constrained Optimization in a Home Energy Management System , 2018, IEEE Transactions on Smart Grid.

[32]  J. Shiomi,et al.  Quantifying phonon particle and wave transport in silicon nanophononic metamaterial with cross junction , 2019, Materials Today Physics.