On Distributed Optimization in Networked Systems

Numerous control and decision problems in networked systems can be posed as optimization problems. Examples include the framework of network utility maximization for resource allocation in communic ...

[1]  Frank Harary,et al.  Graph Theory , 2016 .

[2]  Pablo Soldati,et al.  Proportionally fair allocation of end-to-end bandwidth in STDMA wireless networks , 2006, MobiHoc '06.

[3]  Michael Stingl,et al.  PENNON: A code for convex nonlinear and semidefinite programming , 2003, Optim. Methods Softw..

[4]  Carlo Fischione,et al.  Adaptive distributed estimation over wireless sensor networks with packet losses , 2007, 2007 46th IEEE Conference on Decision and Control.

[5]  John N. Tsitsiklis,et al.  Parallel and distributed computation , 1989 .

[6]  Frank Kelly,et al.  Rate control for communication networks: shadow prices, proportional fairness and stability , 1998, J. Oper. Res. Soc..

[7]  M.G. Rabbat,et al.  Generalized consensus computation in networked systems with erasure links , 2005, IEEE 6th Workshop on Signal Processing Advances in Wireless Communications, 2005..

[8]  D. Vere-Jones.  Markov Chains , 1972, Nature.

[9]  S. Muthukrishnan,et al.  First- and Second-Order Diffusive Methods for Rapid, Coarse, Distributed Load Balancing , 1996, Theory of Computing Systems.

[10]  Charles R. Johnson,et al.  Matrix analysis , 1985, Statistical Inference for Engineers and Data Scientists.

[11]  Michael Patriksson,et al.  Ergodic, primal convergence in dual subgradient schemes for convex programming , 1999, Mathematical programming.

[12]  Pablo Soldati,et al.  Mathematical decomposition techniques for distributed cross-layer optimization of data networks , 2006, IEEE Journal on Selected Areas in Communications.

[13]  A. Robert Calderbank,et al.  Layering as Optimization Decomposition: A Mathematical Theory of Network Architectures , 2007, Proceedings of the IEEE.

[14]  David M. Young,et al.  Second-degree iterative methods for the solution of large linear systems , 1972 .

[15]  丸山 徹.  Convex Analysisの二,三の進展について , 1977 .

[16]  M. F.,et al.  Bibliography , 1985, Experimental Gerontology.

[17]  Pablo Soldati,et al.  WLC22-6: Distributed Optimization of End-to-End Rates and Radio Resources in WiMax Single-Carrier Networks , 2006, IEEE Globecom 2006.

[18]  Michael A. Padlipsky.  A Perspective on the ARPANET Reference Model , 1983, INFOCOM.

[19]  George Cybenko,et al.  Dynamic Load Balancing for Distributed Memory Multiprocessors , 1989, J. Parallel Distributed Comput..

[20]  Björn Johansson,et al.  PRIMAL AND DUAL APPROACHES TO DISTRIBUTED CROSS-LAYER OPTIMIZATION , 2005 .

[21]  Leon S. Lasdon,et al.  Optimization Theory of Large Systems , 1970 .

[22]  R. Varga,et al.  Chebyshev semi-iterative methods, successive overrelaxation iterative methods, and second order Richardson iterative methods , 1961 .

[23]  Sándor Molnár,et al.  Performance study of distributed channel allocation techniques for a fast circuit switched network , 1998, Comput. Commun..

[24]  Stephen P. Boyd,et al.  Fast linear iterations for distributed averaging , 2003, 42nd IEEE International Conference on Decision and Control (IEEE Cat. No.03CH37475).

[25]  V. F. Dem'yanov,et al.  Subdifferentials of functions on sets , 1980 .

[26]  Alexander H. G. Rinnooy Kan,et al.  Decomposition in general mathematical programming , 1993, Math. Program..

[27]  David E. Culler,et al.  Practical asynchronous neighbor discovery and rendezvous for mobile sensing applications , 2008, SenSys '08.

[28]  Karl Henrik Johansson,et al.  A Study On Distributed Model Predictive Consensus , 2008, ArXiv.

[29]  Bernardo Arede Amaro Maciel,et al.  Development of a Detection System using a Wireless Sensor Network , 2008 .

[30]  Derong Liu.  The Mathematics of Internet Congestion Control , 2005, IEEE Transactions on Automatic Control.

[31]  Jimmi Grönkvist,et al.  Interference-based scheduling in spatial reuse TDMA , 2005 .

[32]  B. V. Dean,et al.  Studies in Linear and Non-Linear Programming. , 1959 .

[33]  Jeffrey C. Lagarias,et al.  Convergence Properties of the Nelder-Mead Simplex Method in Low Dimensions , 1998, SIAM J. Optim..

[34]  B. Johansson,et al.  Untripped SUV rollover detection and prevention , 2004, 2004 43rd IEEE Conference on Decision and Control (CDC) (IEEE Cat. No.04CH37601).

[35]  B. V. Dean,et al.  Studies in Linear and Non-Linear Programming. , 1959 .

[36]  Karl Henrik Johansson,et al.  Subgradient methods and consensus algorithms for solving convex optimization problems , 2008, 2008 47th IEEE Conference on Decision and Control.

[37]  Ian F. Akyildiz,et al.  Sensor Networks , 2002, Encyclopedia of GIS.

[38]  Yu-Chi Ho,et al.  A Class of Center-Free Resource Allocation Algorithms 1 , 1980 .

[39]  Ness B. Shroff,et al.  The impact of imperfect scheduling on cross-layer rate control in wireless networks , 2005, Proceedings IEEE 24th Annual Joint Conference of the IEEE Computer and Communications Societies..

[40]  Adi Ben-Israel,et al.  Generalized inverses: theory and applications , 1974 .

[41]  Injong Rhee,et al.  DiffQ: Differential Backlog Congestion Control for Wireless Multi-hop Networks , 2008, 2008 5th Annual IEEE Communications Society Conference on Sensor, Mesh and Ad Hoc Communications and Networks.

[42]  Daniel A. Spielman,et al.  Accelerated Gossip Algorithms for Distributed Computation , 2006 .

[43]  Pablo Soldati,et al.  Distributed cross-layer coordination of congestion control and resource allocation in S-TDMA wireless networks , 2008, Wirel. Networks.

[44]  Angelia NediÄ,et al.  Subgradient methods for convex minimization , 2002 .

[45]  Asuman E. Ozdaglar,et al.  Distributed Subgradient Methods for Multi-Agent Optimization , 2009, IEEE Transactions on Automatic Control.

[46]  J.E. Mazo,et al.  Digital communications , 1985, Proceedings of the IEEE.

[47]  A. Banerjee.  Convex Analysis and Optimization , 2006 .

[48]  Y. Ho,et al.  Simple Explanation of the No-Free-Lunch Theorem and Its Implications , 2002 .

[49]  Raphael Rom,et al.  Multiple Access Protocols: Performance and Analysis , 1990, SIGMETRICS Perform. Evaluation Rev..

[50]  Gregory J. Pottie,et al.  Channel access algorithms with active link protection for wireless communication networks with power control , 2000, TNET.

[51]  Sonia Martínez,et al.  Robust rendezvous for mobile autonomous agents via proximity graphs in arbitrary dimensions , 2006, IEEE Transactions on Automatic Control.

[52]  J.N. Tsitsiklis,et al.  Convergence Rates in Distributed Consensus and Averaging , 2006, Proceedings of the 45th IEEE Conference on Decision and Control.

[53]  J. Gillis,et al.  Matrix Iterative Analysis , 1961 .

[54]  William B. Dunbar,et al.  Distributed Receding Horizon Control With Application to Multi-Vehicle Formation Stabilization , 2004 .

[55]  Mikael Johansson,et al.  A Randomized Incremental Subgradient Method for Distributed Optimization in Networked Systems , 2009, SIAM J. Optim..

[56]  Enrique Alba,et al.  A survey of parallel distributed genetic algorithms , 1999, Complex..

[57]  Steven H. Low,et al.  A duality model of TCP and queue management algorithms , 2003, TNET.

[58]  K. Holmberg.  Primal and Dual Decomposition as Organizational Design: Price and/or Resource Directive Decomposition , 1995 .

[59]  T. Manteuffel.  The Tchebychev iteration for nonsymmetric linear systems , 1977 .

[60]  Panganamala Ramana Kumar,et al.  A cautionary perspective on cross-layer design , 2005, IEEE Wireless Communications.

[61]  Steven H. Low,et al.  Optimization flow control—I: basic algorithm and convergence , 1999, TNET.

[62]  Stephen P. Boyd,et al.  Distributed optimization for cooperative agents: application to formation flight , 2004, 2004 43rd IEEE Conference on Decision and Control (CDC) (IEEE Cat. No.04CH37601).

[63]  Michael Patriksson,et al.  A survey on the continuous nonlinear resource allocation problem , 2008, Eur. J. Oper. Res..

[64]  Gerard J. Foschini,et al.  A simple distributed autonomous power control algorithm and its convergence , 1993 .

[65]  Xiaojun Lin,et al.  The Impact of Imperfect Scheduling on Cross-Layer Rate Control in Multihop Wireless Networks , 2022 .

[66]  K. Jacobsson,et al.  Dynamic modeling of Internet congestion control , 2008 .

[67]  Daniel Pérez Palomar,et al.  A tutorial on decomposition methods for network utility maximization , 2006, IEEE Journal on Selected Areas in Communications.

[68]  A. Propoi.  On the Theory of Max-Min , 1977 .

[69]  Seif Haridi,et al.  Distributed Algorithms , 1992, Lecture Notes in Computer Science.

[70]  Niels Möller,et al.  Window-based congestion control : Modeling, analysis and design , 2008 .

[71]  Dimitri P. Bertsekas,et al.  Incremental Subgradient Methods for Nondifferentiable Optimization , 2001, SIAM J. Optim..

[72]  Mung Chiang,et al.  Balancing transport and physical Layers in wireless multihop networks: jointly optimal congestion control and power control , 2005, IEEE Journal on Selected Areas in Communications.

[73]  Kaj Holmberg,et al.  Mean value cross decomposition for nonlinear convex problems , 2006, Optim. Methods Softw..

[74]  John Odentrantz,et al.  Markov Chains: Gibbs Fields, Monte Carlo Simulation, and Queues , 2000, Technometrics.

[75]  C. D. Meyer,et al.  Convergent Powers of a Matrix With Applications to Iterative Methods for Singular Linear Systems , 1975 .

[76]  M. Degroot.  Reaching a Consensus , 1974 .

[77]  Angelia Nedic,et al.  On the rate of convergence of distributed subgradient methods for multi-agent optimization , 2007, 2007 46th IEEE Conference on Decision and Control.

[78]  Karl Henrik Johansson,et al.  On decentralized negotiation of optimal consensus , 2008, Autom..

[79]  Mikael Johansson,et al.  A simple peer-to-peer algorithm for distributed optimization in sensor networks , 2007, 2007 46th IEEE Conference on Decision and Control.

[80]  Angelia Nedic,et al.  Subgradient methods for convex minimization , 2002 .

[81]  T. A. Manteuffel.  Optimal parameters for linear second-degree stationary iterative methods , 1982 .

[82]  Randy Bush,et al.  Some Internet Architectural Guidelines and Philosophy , 2002, RFC.

[83]  Kai Lai Chung,et al.  A Course in Probability Theory , 1949 .

[84]  Krzysztof C. Kiwiel,et al.  Convergence of Approximate and Incremental Subgradient Methods for Convex Optimization , 2003, SIAM J. Optim..

[85]  Elyes Ben Hamida,et al.  Neighbor discovery analysis in wireless sensor networks , 2006, CoNEXT '06.

[86]  Angelia Nedic,et al.  Incremental Stochastic Subgradient Algorithms for Convex Optimization , 2008, SIAM J. Optim..

[87]  Myung J. Lee,et al.  A Comprehensive Performance Study of IEEE 802 . 15 . 4 , 2004 .

[88]  Bo Wang,et al.  Distributed resource allocation and performance optimization for video communication over mesh networks based on swarm intelligence , 2007 .

[89]  Cesare Maria Carretti,et al.  Comparison of Distributed Optimization Algorithms in Sensor Networks : Simulations and results , 2008 .

[90]  Pablo Soldati,et al.  Fast Power Control for Cross-Layer Optimal Resource Allocation in DS-CDMA Wireless Networks , 2009, 2009 IEEE International Conference on Communications.

[91]  Sergio Barbarossa,et al.  Decentralized Maximum-Likelihood Estimation for Sensor Networks Composed of Nonlinearly Coupled Dynamical Systems , 2006, IEEE Transactions on Signal Processing.

[92]  Jan M. Maciejowski,et al.  Predictive control : with constraints , 2002 .

[93]  Alfred O. Hero,et al.  A Convergent Incremental Gradient Method with a Constant Step Size , 2007, SIAM J. Optim..

[94]  M. Johansson,et al.  Faster Linear Iterations for Distributed Averaging , 2008 .

[95]  Stephen P. Boyd,et al.  Fastest Mixing Markov Chain on a Graph , 2004, SIAM Rev..

[96]  J. Dunn,et al.  Conditional gradient algorithms with open loop step size rules , 1978 .

[97]  Francesco Borrelli,et al.  Decentralized receding horizon control for large scale dynamically decoupled systems , 2009, Autom..

[98]  Karl Henrik Johansson,et al.  Distributed Model Predictive Consensus , 2006 .

[99]  Alejandro Ribeiro,et al.  Consensus-Based Distributed Parameter Estimation in Ad Hoc Wireless Sensor Networks with Noisy Links , 2007, 2007 IEEE International Conference on Acoustics, Speech and Signal Processing - ICASSP '07.

[100]  Stephen P. Boyd,et al.  Optimal Scaling of a Gradient Method for Distributed Resource Allocation , 2006 .

[101]  Lun Li,et al.  Cross-layer optimization in TCP/IP networks , 2005, IEEE/ACM Transactions on Networking.

[102]  B. Obel.  A note on mixed procedures for decomposing linear programming problems , 1978 .

[103]  John N. Tsitsiklis,et al.  Problems in decentralized decision making and computation , 1984 .

[104]  H. Kushner,et al.  Stochastic Approximation and Recursive Algorithms and Applications , 2003 .

[105]  Yu Sun,et al.  Distributed Rate Allocation and Performance Optimization for Video Communication Over Mesh Networks , 2007, 2007 IEEE International Conference on Image Processing.

[106]  Mung Chiang,et al.  The value of clustering in distributed estimation for sensor networks , 2005, 2005 International Conference on Wireless Networks, Communications and Mobile Computing.

[107]  D. Luenberger.  Optimization by Vector Space Methods , 1968 .

[108]  P. Levis,et al.  RSSI is Under Appreciated , 2006 .

[109]  Naoki Katoh,et al.  Resource Allocation Problems , 1998 .

[110]  Desmond P. Taylor,et al.  OSI Reference Model - The ISO Model of Architecture for Open Systems Interconnection , 2007 .

[111]  Kim-Chuan Toh,et al.  Solving semidefinite-quadratic-linear programs using SDPT3 , 2003, Math. Program..

[112]  K. Schittkowski,et al.  NONLINEAR PROGRAMMING , 2022 .

[113]  Bart De Schutter,et al.  Particle Swarms in Optimization and Control , 2008 .

[114]  Riccardo Scattolini,et al.  A model predictive control scheme for consensus in multi-agent systems with single-integrator dynamics and input constraints , 2007, 2007 46th IEEE Conference on Decision and Control.

[115]  Samir Elhedhli,et al.  Nondifferentiable Optimization: Cutting Plane Methods , 2009, Encyclopedia of Optimization.

[116]  D. Cushing,et al.  Why do Fish School? , 1968, Nature.

[117]  John G. Kemeny,et al.  Finite Markov Chains. , 1960 .

[118]  Lin Xiao,et al.  Cross-layer optimization of wireless networks using nonlinear column generation , 2006, IEEE Transactions on Wireless Communications.

[119]  Mikael Johansson,et al.  On Distributed Optimization Using Peer-to-Peer Communications in Wireless Sensor Networks , 2008, 2008 5th Annual IEEE Communications Society Conference on Sensor, Mesh and Ad Hoc Communications and Networks.

[120]  John G. Kemeny,et al.  Finite Markov chains , 1960 .

[121]  W. K. Hastings,et al.  Monte Carlo Sampling Methods Using Markov Chains and Their Applications , 1970 .

[122]  Gordon F. Royle,et al.  Algebraic Graph Theory , 2001, Graduate texts in mathematics.

[123]  Seyyed Jamaaloddin Golestaani,et al.  A unified theory of flow control and routing in data communication networks , 1980 .

[124]  J. Lofberg,et al.  YALMIP : a toolbox for modeling and optimization in MATLAB , 2004, 2004 IEEE International Conference on Robotics and Automation (IEEE Cat. No.04CH37508).

[125]  Connections between cooperative control and potential games illustrated on the consensus problem , 2007, 2007 European Control Conference (ECC).

[126]  Boaz Patt-Shamir,et al.  Distributed approximate matching , 2007, PODC '07.

[127]  A. Barrett.  Network Flows and Monotropic Optimization. , 1984 .

[128]  Reza Olfati-Saber,et al.  Consensus and Cooperation in Networked Multi-Agent Systems , 2007, Proceedings of the IEEE.

[129]  W. Rudin.  Principles of mathematical analysis , 1964 .

[130]  Stephen P. Boyd,et al.  Simultaneous routing and resource allocation via dual decomposition , 2004, IEEE Transactions on Communications.

[131]  Cheng Jin,et al.  FAST TCP: Motivation, Architecture, Algorithms, Performance , 2006, IEEE/ACM Transactions on Networking.

[132]  Stephen P. Boyd,et al.  Convex Optimization , 2004, Algorithms and Theory of Computation Handbook.

[133]  N. David Mermin,et al.  What's Wrong With This Lagrangean? , 1988 .

[134]  Robert Nowak,et al.  Distributed optimization in sensor networks , 2004, Third International Symposium on Information Processing in Sensor Networks, 2004. IPSN 2004.

[135]  Yu. M. Ermol’ev.  Methods of solution of nonlinear extremal problems , 1966 .

[136]  Deborah Estrin,et al.  Guest Editors' Introduction: Overview of Sensor Networks , 2004, Computer.

[137]  S. Dey,et al.  Optimal and Distributed Protocols for Cross-Layer Design of Physical and Transport Layers in MANETs , 2008, IEEE/ACM Transactions on Networking.

[138]  John N. Tsitsiklis,et al.  Distributed Asynchronous Deterministic and Stochastic Gradient Optimization Algorithms , 1984, 1984 American Control Conference.