Distributed optimization for systems design : an augmented Lagrangian coordination method

This thesis presents a coordination method for the distributed design optimization of engineering systems. The design of advanced engineering systems such as aircrafts, automated distribution centers, and microelectromechanical systems (MEMS) involves multiple components that together realize the desired functionality. The design requires detailed knowledge of the various physics that play a role in each component. Since a single designer is no longer able to oversee all relevant aspects of the complete system, the design process is distributed over a number of design teams. Each team autonomously operates on a single component or aspect of the system, and uses dedicated analysis and design tools to solve the specific problems encountered for this subsystem. Consequently, one team is often not familiar with the design considerations of other teams, and does not know how its decisions affect the system as a whole. An additional challenge in systems design is introduced by market competitiveness and increasing consumer requirements, which pushes systems towards the limits of performance and cost. Since each subsystem contributes to the system performance, the interaction between these subsystems, and thus design teams, becomes critical and needs to be controlled. Design optimization is an effective and powerful approach to finding optimal designs when parametric models are available to describe the relevant system behavior. To fully exploit the available design expertise, a coordination approach for distributed system optimization is required that respects the organization of design teams and their tools. The augmented Lagrangian coordination (ALC) method presented in this thesis is a coordination approach for distributed optimization that a) provides disciplinary design autonomy, b) offers the designer a large degree flexibility in setting up the coordination structure, c) maintains mathematical rigor, and d) is efficient in obtaining optimal and consistent designs. ALC is based on a combination of augmented Lagrangian relaxation and block-coordinate descent, two techniques from mathematical programming. What distinguishes ALC from other coordination methods for distributed system design is its flexibility in combination with its mathematical rigor. The flexibility relates both to the structure of the coordination process, and to the type of coupling that is allowed. Most coordination methods with convergence proof follow a hierarchical structure in which a single master problem is in charge of coordination. The master problem is superimposed over the disciplinary subproblems that communicate only with this master problem. ALC allows a more general, non-hierarchical coordination structure in which coordination may also be performed between disciplinary subproblems directly. Furthermore, ALC can coordinate not only linking variables, but also coupling functions. The mathematical rigor assures that, under suitable assumptions, the solutions obtained with ALC algorithms are optimal and consistent. Specialized ALC algorithms based on the efficient alternating direction method of multipliers are developed for problems that have only linking variables and/or block-separable coupling constraints. Furthermore, we demonstrate that the well-known analytical target cascading method is a subclass of ALC. ALC algorithms can be proven to converge to locally optimal and consistent designs under smoothness assumptions, provided that subproblem solutions are globally optimal. Global optimality is however difficult, if not impossible, to guarantee in practice since many engineering design problems are non-convex. When only local optimality can be obtained, ALC methods can no longer be proven to yield optimal or consistent solutions. Experiments with several non-convex problems show however that ALC with locally optimal solutions to subproblems often still converges to a local or global system optimum; however, occasionally inconsistent designs are encountered. Performing a global search at subproblems improves the convergence behavior, and globally optimal solutions are frequently obtained. The work in this thesis is part of MicroNed, a national research programme on microsystem technology. In the emerging field of microsystem technology, optimization of cost, size, and performance are very relevant since these factors determine whether microsystems can be successful alternatives for existing "macro" systems. Proper functioning of the microdevice may increasingly depend on model-based optimization during the design. To illustrate how coordination methods can be used in microsystem optimal design, a micro-accelerometer design problem has been developed, inspired on a commercially available device. The goal of the design problem is to find the dimensions of the accelerometer such that its area is minimized subject to performance requirements on sensitivity, noise, and bandwidth, while considering mechanical, electrostatic, dynamic, and electrical constraints. The behavioral models are analytical, providing a reproducible benchmark problem for performance assessments of coordination methods in distributed optimization.

[1]  Tamal Mukherjee,et al.  Optimization-based synthesis of microresonators , 1998 .

[2]  Jaroslaw Sobieszczanski-Sobieski,et al.  Optimization by decomposition: A step from hierarchic to non-hierarchic systems , 1989 .

[3]  Philip E. Gill,et al.  Practical optimization , 1981 .

[4]  Panos Y. Papalambros,et al.  Design Optimization of Hierarchically Decomposed Multilevel Systems Under Uncertainty , 2006, DAC 2004.

[5]  Jeremy J. Michalek,et al.  BB-ATC: Analytical Target Cascading Using Branch and Bound for Mixed-Integer Nonlinear Programming , 2006, DAC 2006.

[6]  R. Haftka,et al.  On options for interdisciplinary analysis and design optimization , 1992 .

[7]  Panos Y. Papalambros,et al.  General framework for decomposition analysis in optimal design , 1993 .

[8]  Dimitri P. Bertsekas,et al.  Constrained Optimization and Lagrange Multiplier Methods , 1982 .

[9]  M. Sheplak,et al.  Piezoresistive Microphone Design Pareto Optimization: Tradeoff Between Sensitivity and Noise Floor , 2003, Journal of Microelectromechanical Systems.

[10]  Ilan Kroo,et al.  Collaborative optimization using response surface estimation , 1998 .

[11]  V. Braibant,et al.  Structural optimization: A new dual method using mixed variables , 1986 .

[12]  Natalia Alexandrov,et al.  Editorial—Multidisciplinary Design Optimization , 2005 .

[13]  Nikolaos V. Sahinidis,et al.  Global optimization of mixed-integer nonlinear programs: A theoretical and computational study , 2004, Math. Program..

[14]  A. Ruszczynski Augmented Lagrangian Decomposition for Sparse Convex Optimization , 1992 .

[15]  Panos Y. Papalambros,et al.  A Hypergraph Framework for Optimal Model-Based Decomposition of Design Problems , 1997, Comput. Optim. Appl..

[16]  Panos Y. Papalambros,et al.  Convergence Criteria for Hierarchical Overlapping Coordination of Linearly Constrained Convex Design Problems , 2001, Comput. Optim. Appl..

[17]  Natalia Alexandrov,et al.  Analytical and Computational Aspects of Collaborative Optimization for Multidisciplinary Design , 2002 .

[18]  J. Pan,et al.  Some results in optimization of non-hierarchic systems , 1990 .

[19]  T Haftka Raphael,et al.  Multidisciplinary aerospace design optimization: survey of recent developments , 1996 .

[20]  Jeremy J. Michalek,et al.  AN EFFICIENT WEIGHTING UPDATE METHOD TO ACHIEVE ACCEPTABLE CONSISTENCY DEVIATION IN ANALYTICAL TARGET CASCADING , 2005 .

[21]  Gyung-Jin Park,et al.  Multidisciplinary design optimization based on independent subspaces , 2005 .

[22]  Terrance Carl Wagner,et al.  A general decomposition methodology for optimal system design. , 1993 .

[23]  Natalia Alexandrov,et al.  Reconfigurability in MDO Problem Synthesis, Part 2 , 2004 .

[24]  G. Vanderplaats,et al.  Efficient calculation of optimum design sensitivity , 1984 .

[25]  M. Wiecek,et al.  Lagrangian Coordination and Analytical Target Cascading: Solving ATC-Decomposed Problems with Lagrangian Duality , 2005 .

[26]  ALI H. NAYFEH,et al.  Reduced-Order Models for MEMS Applications , 2005 .

[27]  L. Watson,et al.  Decomposition theory for multidisciplinary design optimization problems with mixed integer quasiseparable subsystems , 2006 .

[28]  J. Arora,et al.  Multiplier methods for engineering optimization , 1991 .

[29]  Claudia A. Sagastizábal,et al.  Parallel Variable Distribution for Constrained Optimization , 2002, Comput. Optim. Appl..

[30]  Panos Y. Papalambros,et al.  Digital Object Identifier (DOI) 10.1007/s00158-002-0240-0 , 2022 .

[31]  Wpmh Maurice Heemels,et al.  5.3.2 On the Systematic Use of Budget‐Based Design , 2006 .

[32]  Ilan Kroo,et al.  Collaborative Approach to Launch Vehicle Design , 1997 .

[33]  Jaroslaw Sobieszczanskisobieski,et al.  On the sensitivity of complex, internally coupled systems , 1988 .

[34]  B. Grossman,et al.  Variable-complexity response surface approximations for wing structural weight in HSCT design , 1996 .

[35]  James C. Bezdek,et al.  Some Notes on Alternating Optimization , 2002, AFSS.

[36]  L Padula Sharon,et al.  MDO Test Suite at NASA Langley Research Center , 1996 .

[37]  Honglong Chang,et al.  Application of an optimization methodology for multidisciplinary system design of microgyroscopes , 2006 .

[38]  Timo Veijola,et al.  Extending the validity of squeezed-film damper models with elongations of surface dimensions , 2005 .

[39]  Panos Y. Papalambros,et al.  Simulation-based optimal design of heavy trucks by model-based decomposition: an extensive analytical target cascading case study , 2004 .

[40]  Panos Y. Papalambros,et al.  Convergence properties of analytical target cascading , 2002 .

[41]  Robert D. Braun,et al.  Collaborative optimization: an architecture for large-scale distributed design , 1996 .

[42]  Robert Michael Lewis,et al.  Reconfigurability in MDO Problem Synthesis. Part 1 , 2004 .

[43]  Jeremy J. Michalek,et al.  Weights, Norms, and Notation in Analytical Target Cascading , 2005 .

[44]  Jaroslaw Sobieszczanski-Sobieski,et al.  An algorithm for solving the system-level problem in multilevel optimization , 1994 .

[45]  L. Watson,et al.  Global-local structural optimization using response surfaces of local optimization margins , 2004 .

[46]  J. Sobieszczanski-Sobieski,et al.  Structural optimization by multilevel decomposition , 1983 .

[47]  J. Renaud,et al.  Approximation in nonhierarchic system optimization , 1994 .

[48]  Luigi Grippo,et al.  On the convergence of the block nonlinear Gauss-Seidel method under convex constraints , 2000, Oper. Res. Lett..

[49]  Panos Y. Papalambros Optimal Design of Mechanical Engineering Systems , 1995 .

[50]  Walter Murray,et al.  A local convergence analysis of bilevel decomposition algorithms , 2006 .

[51]  John E. Dennis,et al.  Problem Formulation for Multidisciplinary Optimization , 1994, SIAM J. Optim..

[52]  Tamal Mukherjee,et al.  MEMS Design And Verification , 2003, ITC.

[53]  K. Svanberg The method of moving asymptotes—a new method for structural optimization , 1987 .

[54]  K. Deb An Efficient Constraint Handling Method for Genetic Algorithms , 2000 .

[55]  Jasbir S. Arora,et al.  Introduction to Optimum Design , 1988 .

[56]  J. Sobieszczanski-Sobieski,et al.  Bilevel Integrated System Synthesis for Concurrent and Distributed Processing , 2002 .

[57]  Jan Golinski,et al.  Optimal synthesis problems solved by means of nonlinear programming and random methods , 1970 .

[58]  Panos Y. Papalambros,et al.  An empirical local convergence study of alternative coordination schemes in analytical target cascading , 2003 .

[59]  Panos Y. Papalambros,et al.  A SYSTEM PARTITIONING AND OPTIMIZATION APPROACH TO TARGET CASCADING , 1999 .

[60]  R. Howe,et al.  Viscous damping model for laterally oscillating microstructures , 1994 .

[61]  Simon Li,et al.  Model-Based Decomposition Using Non-Binary Dependency Analysis and Heuristic Partitioning Analysis , 2006, DAC 2006.

[62]  Angel-Victor DeMiguel,et al.  An analysis of collaborative optimization methods , 2000 .

[63]  Jaroslaw Sobieszczanski-Sobieski,et al.  OPTIMIZATION OF COUPLED SYSTEMS: A CRITICAL OVERVIEW OF APPROACHES , 1994 .

[64]  R. Haftka,et al.  Elements of Structural Optimization , 1984 .

[65]  L. Watson,et al.  Decomposition and Two-level Optimization of Structures with Discrete Sizing Variables , 2004 .

[66]  Wei Chen,et al.  Lagrangian coordination for enhancing the convergence of analytical target cascading , 2006 .

[67]  Prabhat Hajela,et al.  Counterpropagation neural networks in decomposition based optimal design , 1997 .

[68]  Leon S. Lasdon,et al.  Optimization Theory of Large Systems , 1970 .

[69]  Kemper Lewis,et al.  Collaborative, sequential, and isolated decisions in design , 1997 .

[70]  M K Shin,et al.  Application of the multidisciplinary design optimization algorithm to the design of a belt-integrated seat while considering crashworthiness , 2005 .

[71]  Jaroslaw Sobieszczanski-Sobieski,et al.  Supersonic Business Jet Design Through Bi-Level Integrated System Synthesis , 1999 .

[72]  G.K. Fedder,et al.  Automated optimal synthesis of microaccelerometers , 1999, Technical Digest. IEEE International MEMS 99 Conference. Twelfth IEEE International Conference on Micro Electro Mechanical Systems (Cat. No.99CH36291).

[73]  Kemper Lewis,et al.  Equilibrium stability in decentralized design systems , 2005, Int. J. Syst. Sci..

[74]  Roger T. Howe,et al.  Surface micromachined accelerometers , 1996 .

[75]  C. Beltran,et al.  Unit Commitment by Augmented Lagrangian Relaxation: Testing Two Decomposition Approaches , 2002 .

[76]  John N. Tsitsiklis,et al.  Parallel and distributed computation , 1989 .

[77]  JiGuan G. Lin Analysis and Enhancement of Collaborative Optimization for Multidisciplinary Design , 2004 .

[78]  Christina Bloebaum An intelligent decomposition approach for coupled engineering systems , 1992 .

[79]  Ekkehard Ramm,et al.  Multi-level optimization of material and structural layout , 2006 .

[80]  Andrzej Ruszczynski,et al.  Decomposition methods in stochastic programming , 1997, Math. Program..

[81]  S. Senturia Microsystem Design , 2000 .

[82]  Layne T. Watson,et al.  Multidisciplinary Design Optimization with Quasiseparable Subsystems , 2005 .

[83]  Panos Y. Papalambros,et al.  Coordination specification in distributed optimal design of multilevel systems using the χ language , 2005 .

[84]  Jan G. Korvink,et al.  Efficient optimization of transient dynamic problems in MEMS devices using model order reduction , 2005 .

[85]  Jeremy S. Agte,et al.  Bi-Level Integrated System Synthesis , 1998 .

[86]  Ashwin A. Seshia,et al.  On the optimization of compliant force amplifier mechanisms for surface micromachined resonant accelerometers , 2004 .

[87]  M. Wiecek,et al.  Augmented Lagrangian Coordination for Decomposed Design Problems , 2005 .

[88]  Andrzej Stachurski,et al.  Parallel Optimization: Theory, Algorithms and Applications , 2000, Parallel Distributed Comput. Pract..

[89]  Jacques F. Benders,et al.  Partitioning procedures for solving mixed-variables programming problems , 2005, Comput. Manag. Sci..

[90]  A. Galip Ulsoy,et al.  Quantification and Use of System Coupling in Decomposed Design Optimization Problems , 2005 .

[91]  Michael C. Ferris,et al.  Parallel Variable Distribution , 1994, SIAM J. Optim..

[92]  Layne T. Watson,et al.  Computational study of a nonhierarchical decomposition algorithm , 1993, Comput. Optim. Appl..

[93]  Andrea Toselli,et al.  Domain decomposition methods : algorithms and theory , 2005 .

[94]  M. Fortin,et al.  Augmented Lagrangian methods : applications to the numerical solution of boundary-value problems , 1983 .

[95]  Paul H. Calamai,et al.  Bilevel and multilevel programming: A bibliography review , 1994, J. Glob. Optim..

[96]  Natalia Alexandrov,et al.  Comparative properties of collaborative optimization and other approaches to MDO , 1999 .

[97]  K. Schittkowski,et al.  NONLINEAR PROGRAMMING , 2022 .

[98]  Tao Jiang,et al.  Target Cascading in Optimal System Design , 2003, DAC 2000.

[99]  John M. Mulvey,et al.  Applying the progressive hedging algorithm to stochastic generalized networks , 1991, Ann. Oper. Res..

[100]  C. Leondes MEMS/NEMS : handbook techniques and applications , 2006 .

[101]  G. N. Vanderplaats,et al.  Sequential linearization method for multilevel optimization , 1990 .

[102]  Joseph Giesing,et al.  A summary of industry MDO applications and needs , 1998 .

[103]  Panos Y. Papalambros,et al.  On the Use of Analytical Target Cascading and Collaborative Optimization for Complex System Design , 2005 .