Design of problem-specific evolutionary algorithm/mixed-integer programming hybrids: two-stage stochastic integer programming applied to chemical batch scheduling

Engineering optimization often deals with large, mixed-integer search spaces with a rigid structure due to the presence of a large number of constraints. Metaheuristics, such as evolutionary algorithms (EAs), are frequently suggested as solution algorithms in such cases. In order to exploit the full potential of these algorithms, it is important to choose an adequate representation of the search space and to integrate expert-knowledge into the stochastic search operators, without adding unnecessary bias to the search. Moreover, hybridisation with mathematical programming techniques such as mixed-integer programming (MIP) based on a problem decomposition can be considered for improving algorithmic performance. In order to design problem-specific EAs it is desirable to have a set of design guidelines that specify properties of search operators and representations. Recently, a set of guidelines has been proposed that gives rise to so-called Metric-based EAs (MBEAs). Extended by the minimal moves mutation they allow for a generalization of EA with self-adaptive mutation strength in discrete search spaces. In this article, a problem-specific EA for process engineering task is designed, following the MBEA guidelines and minimal moves mutation. On the background of the application, the usefulness of the design framework is discussed, and further extensions and corrections proposed. As a case-study, a two-stage stochastic programming problem in chemical batch process scheduling is considered. The algorithm design problem can be viewed as the choice of a hierarchical decision structure, where on different layers of the decision process symmetries and similarities can be exploited for the design of minimal moves. After a discussion of the design approach and its instantiation for the case-study, the resulting problem-specific EA/MIP is compared to a straightforward application of a canonical EA/MIP and to a monolithic mathematical programming algorithm. In view of the results the benefits of customising the EA are discussed.

[1]  Sebastian Engell,et al.  A hybrid evolutionary algorithm for solving two-stage stochastic integer programs in chemical batch scheduling , 2007, Comput. Chem. Eng..

[2]  Sebastian Engell,et al.  Sequencing of batch operations for a highly coupled production process: Genetic algorithms versus mathematical programming , 1998 .

[3]  Ingo Rechenberg,et al.  Evolutionsstrategie : Optimierung technischer Systeme nach Prinzipien der biologischen Evolution , 1973 .

[4]  Antonio Alonso Ayuso,et al.  Introduction to Stochastic Programming , 2009 .

[5]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[6]  Zbigniew Michalewicz,et al.  Genetic Algorithms + Data Structures = Evolution Programs , 2000, Springer Berlin Heidelberg.

[7]  Peter F. Stadler,et al.  The Topology of Evolutionary Biology , 2004 .

[8]  Ian C. Parmee,et al.  Dual mutation strategies for mixed-integer optimisation in power station design , 1997, Proceedings of 1997 IEEE International Conference on Evolutionary Computation (ICEC '97).

[9]  W. Vent,et al.  Rechenberg, Ingo, Evolutionsstrategie — Optimierung technischer Systeme nach Prinzipien der biologischen Evolution. 170 S. mit 36 Abb. Frommann‐Holzboog‐Verlag. Stuttgart 1973. Broschiert , 1975 .

[10]  Jeffrey Horn,et al.  Handbook of evolutionary computation , 1997 .

[11]  Hans-Paul Schwefel,et al.  Evolution strategies – A comprehensive introduction , 2002, Natural Computing.

[12]  Dirk Wiesmann,et al.  From Syntactical to Semantical Mutation Operators for Structure Optimization , 2002, PPSN.

[13]  Dirk Wiesmann,et al.  Metric Based Evolutionary Algorithms , 2000, EuroGP.

[14]  Sebastian Engell,et al.  Modeling and solving real-time scheduling problems by stochastic integer programming , 2004, Comput. Chem. Eng..

[15]  Frank Hoffmeister,et al.  Problem-Independent Handling of Constraints by Use of Metric Penalty Functions , 1996, Evolutionary Programming.

[16]  Lawrence J. Fogel,et al.  Artificial Intelligence through Simulated Evolution , 1966 .

[17]  Carlos Artemio Coello-Coello,et al.  Theoretical and numerical constraint-handling techniques used with evolutionary algorithms: a survey of the state of the art , 2002 .

[18]  Sebastian Engell,et al.  A hybrid algorithm for solving two-stage stochastic integer problems by combining evolutionary algorithms and mathematical programming methods , 2005 .

[19]  H. P. Schwefel,et al.  Numerische Optimierung von Computermodellen mittels der Evo-lutionsstrategie , 1977 .

[20]  Michael Emmerich,et al.  Mixed-Integer Evolution Strategy for Chemical Plant Optimization with Simulators , 2000 .

[21]  Jean-François Puget,et al.  Program Does Not Equal Program: Constraint Programming and Its Relationship to Mathematical Programming , 2001, Interfaces.

[22]  Zbigniew Michalewicz,et al.  Genetic Algorithms Plus Data Structures Equals Evolution Programs , 1994 .

[23]  Goldberg,et al.  Genetic algorithms , 1993, Robust Control Systems with Genetic Algorithms.

[24]  Mitsuo Gen,et al.  Genetic algorithm for non-linear mixed integer programming problems and its applications , 1996 .

[25]  Michael T. M. Emmerich,et al.  Design of Graph-Based Evolutionary Algorithms: A Case Study for Chemical Process Networks , 2001, Evolutionary Computation.

[26]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[27]  Dirk Wiesmann Anwendungsorientierter Entwurf evolutionärer Algorithmen , 2001 .

[28]  Sebastian Engell,et al.  A genetic algorithm for online-scheduling of a multiproduct polymer batch plant , 2000 .

[29]  Günter Rudolph,et al.  An Evolutionary Algorithm for Integer Programming , 1994, PPSN.

[30]  S. Engell,et al.  Intelligent scheduling of chemical plants: a constraint programming approach , 1999, Proceedings of the 1999 IEEE International Symposium on Intelligent Control Intelligent Systems and Semiotics (Cat. No.99CH37014).

[31]  David W. Corne,et al.  Predicting Stochastic Search Algorithm Performance using Landscape State Machines , 2006, 2006 IEEE International Conference on Evolutionary Computation.