Automated structure detection for distributed process optimization

Abstract The design and control of large-scale engineering systems, consisting of a number of interacting subsystems, is a heavily researched topic with relevance both for industry and academia. This paper presents two methodologies for optimal model-based decomposition, where an optimization problem is decomposed into several smaller sub-problems and subsequently solved by augmented Lagrangian decomposition methods. Large-scale and highly nonlinear problems commonly arise in process optimization, and could greatly benefit from these approaches, as they reduce the storage requirements and computational costs for global optimization. The strategy presented translates the problem into a constraint graph. The first approach uses a heuristic community detection algorithm to identify highly connected clusters in the optimization problem graph representation. The second approach uses a multilevel graph bisection algorithm to find the optimal partition, given a desired number of sub-problems. The partitioned graphs are translated back into decomposed sets of sub-problems with a minimal number of coupling constraints. Results show both of these methods can be used as efficient frameworks to decompose optimization problems in linear time, in comparison to traditional methods which require polynomial time.

[1]  N. Watanabe,et al.  Decomposition in large system optimization using the method of multipliers , 1978 .

[2]  M E J Newman,et al.  Modularity and community structure in networks. , 2006, Proceedings of the National Academy of Sciences of the United States of America.

[3]  Layne T. Watson,et al.  Multidisciplinary Design Optimization with Quasiseparable Subsystems , 2005 .

[4]  Philippe Mahey,et al.  Accelerating convergence of a Separable Augmented Lagrangian Algorithm , 2007 .

[5]  Claudia A. Sagastizábal,et al.  Divide to conquer: decomposition methods for energy optimization , 2012, Mathematical Programming.

[6]  Seyed Mostafa Safdarnejad,et al.  Initialization strategies for optimization of dynamic systems , 2015, Comput. Chem. Eng..

[7]  Carlos A. Coello Coello,et al.  A simple multimembered evolution strategy to solve constrained optimization problems , 2005, IEEE Transactions on Evolutionary Computation.

[8]  John S. Gero,et al.  Design Optimization Problem Reformulation Using Singular Value Decomposition , 2009 .

[9]  Ulrich Elsner,et al.  Graph partitioning - a survey , 2005 .

[10]  Andrew B. Kahng,et al.  A new approach to effective circuit clustering , 1992, ICCAD.

[11]  R. Haftka,et al.  On options for interdisciplinary analysis and design optimization , 1992 .

[12]  Peter Richtárik,et al.  Separable approximations and decomposition methods for the augmented Lagrangian , 2013, Optim. Methods Softw..

[13]  C. Floudas,et al.  Global optimum search for nonconvex NLP and MINLP problems , 1989 .

[14]  A. Flores‐Tlacuahuac,et al.  Multiobjective Dynamic Optimization of the Cell-Cast Process for Poly(methyl methacrylate) , 2014 .

[15]  Hans Jürgen Prömel,et al.  Finding clusters in VLSI circuits , 1990, 1990 IEEE International Conference on Computer-Aided Design. Digest of Technical Papers.

[16]  Abdelouahed Hamdi,et al.  Two-level primal-dual proximal decomposition technique to solve large scale optimization problems , 2005, Appl. Math. Comput..

[17]  Lorenz T. Biegler,et al.  On the implementation of an interior-point filter line-search algorithm for large-scale nonlinear programming , 2006, Math. Program..

[18]  Ugo Montanari,et al.  Networks of constraints: Fundamental properties and applications to picture processing , 1974, Inf. Sci..

[19]  Bernard P. Zeigler,et al.  Hierarchical, modular discrete-event modelling in an object-oriented environment , 1987 .

[20]  George Karypis,et al.  Multi-threaded Graph Partitioning , 2013, 2013 IEEE 27th International Symposium on Parallel and Distributed Processing.

[21]  Jing Chen,et al.  An object-oriented framework for modular chemical process simulation with semiconductor processing applications , 2006, Comput. Chem. Eng..

[22]  M E J Newman,et al.  Finding and evaluating community structure in networks. , 2003, Physical review. E, Statistical, nonlinear, and soft matter physics.

[23]  Alex Pothen,et al.  PARTITIONING SPARSE MATRICES WITH EIGENVECTORS OF GRAPHS* , 1990 .

[24]  Abdelouahed Hamdi,et al.  A re-scaled twin augmented Lagrangian algorithm for saddle point seeking , 2008 .

[25]  Howard F. Rase,et al.  Chemical Reactor Design for Process Plants , 1977 .

[26]  Michael Pidd,et al.  Hierarchical modular modelling in discrete simulation , 1998, 1998 Winter Simulation Conference. Proceedings (Cat. No.98CH36274).

[27]  Gary L. Miller,et al.  A unified geometric approach to graph separators , 1991, [1991] Proceedings 32nd Annual Symposium of Foundations of Computer Science.

[28]  John Scott What is social network analysis , 2010 .

[29]  Jean-Loup Guillaume,et al.  Fast unfolding of communities in large networks , 2008, 0803.0476.

[30]  Mark Newman,et al.  Detecting community structure in networks , 2004 .

[31]  Andrew B. Kahng,et al.  New spectral methods for ratio cut partitioning and clustering , 1991, IEEE Trans. Comput. Aided Des. Integr. Circuits Syst..

[32]  Brice Carnahan,et al.  THE SEQUENTIAL-CLUSTERED METHOD FOR DYNAMIC CHEMICAL PLANT SIMULATION , 1990 .

[33]  Gary L. Miller,et al.  Automatic Mesh Partitioning , 1992 .

[34]  Jacobus E. Rooda,et al.  A classification of methods for distributed system optimization based on formulation structure , 2009 .

[35]  M. J. D. Powell,et al.  A method for nonlinear constraints in minimization problems , 1969 .

[36]  Bruce Hendrickson,et al.  An Improved Spectral Graph Partitioning Algorithm for Mapping Parallel Computations , 1995, SIAM J. Sci. Comput..

[37]  Lie Wang,et al.  Towards a fast implementation of spectral nested dissection , 1992, Proceedings Supercomputing '92.

[38]  U. Brandes,et al.  Maximizing Modularity is hard , 2006, physics/0608255.

[39]  Stanley Wasserman,et al.  Social Network Analysis: Social Network Analysis in the Social and Behavioral Sciences , 1994 .

[40]  Gintaras V. Reklaitis,et al.  Process systems engineering: From Solvay to modern bio- and nanotechnology.: A history of development, successes and prospects for the future , 2011 .

[41]  M. Rais-Rohani,et al.  Exponential penalty function formulation for multilevel optimization using the analytical target cascading framework , 2013 .

[42]  Alan M. Frieze,et al.  Clustering Large Graphs via the Singular Value Decomposition , 2004, Machine Learning.

[43]  J. E. Rooda,et al.  Multi-modality in augmented Lagrangian coordination for distributed optimal design , 2009 .

[44]  Natalia Alexandrov,et al.  Comparative properties of collaborative optimization and other approaches to MDO , 1999 .

[45]  Chung-Kuan Cheng,et al.  An improved two-way partitioning algorithm with stable performance [VLSI] , 1991, IEEE Trans. Comput. Aided Des. Integr. Circuits Syst..

[46]  S. Boorman,et al.  Social Structure from Multiple Networks. I. Blockmodels of Roles and Positions , 1976, American Journal of Sociology.

[47]  David L. Woodruff,et al.  Pyomo — Optimization Modeling in Python , 2012, Springer Optimization and Its Applications.

[48]  Panos Y. Papalambros,et al.  Optimal Partitioning and Coordination Decisions in Decomposition-Based Design , 2007, DAC 2007.

[49]  Michael T. Heath,et al.  A Cartesian Parallel Nested Dissection Algorithm , 1992, SIAM J. Matrix Anal. Appl..

[50]  Magne Hillestad,et al.  Dynamic Simulation of Chemical Engineering Systems by the Sequential Modular Approach , 1986 .

[51]  Terje Hertzberg,et al.  Convergence and stability of the sequential modular approach to dynamic process simulation , 1988 .

[52]  Béla Bollobás,et al.  Modern Graph Theory , 2002, Graduate Texts in Mathematics.

[53]  A. Kahng,et al.  A new approach to effective circuit clustering , 1992, 1992 IEEE/ACM International Conference on Computer-Aided Design.

[54]  J. Dussault,et al.  A New Decomposition Method in Nonconvex Programming Via a Separable Augmented Lagrangian , 1997 .