Helper-objective optimization strategies for the Job-Shop Scheduling Problem

Multiple Objective Evolutionary Algorithms (MOEAs) applied to the Job-Shop Scheduling Problem have been shown to perform better than single objective Genetic Algorithms (GAs). Helper-objectives, representing portions of the main objective, help guide MOEAs in their search process. This paper provides additional understanding of helper-objective methods. The sequence in which helper-objectives are used is examined and we show that problem-specific knowledge can be incorporated to determine a good helper-objective sequence. Computational results demonstrate how carefully sequenced helper-objectives can improve search quality. This dismisses the established practice of picking helper sequence based upon a random order due to lack of knowledge about optimal sequencing. Explanations are provided for how helpers accelerate the search process by distinguishing between otherwise similar solutions and by partial removal of epistasis in one or more dimensions of the solution space. Helper-objective size was also explored to determine if maximal helper divisions are best for the set of problems studied. Helper-objective size appears to be important to the optimization and larger helpers are not necessarily better which implies that methods such as Multi-Objectivization via Segmentation (MOS) may benefit from smaller problem divisions. Lastly, an examination of the non-dominated front size was performed to determine if tuning front size makes sense for this type of algorithm since previous works have established tuning front size as important. No evidence was found to support tuning and the correlation between small front size and effectiveness appears to be a natural part of how helper-objective algorithms work rather than a reason for reducing front size.

[1]  Xiaodong Li,et al.  Evolutionary algorithms and multi-objectivization for the travelling salesman problem , 2009, GECCO.

[2]  Ingo Wegener,et al.  Can Single-Objective Optimization Profit from Multiobjective Optimization? , 2008, Multiobjective Problem Solving from Nature.

[3]  A. Verschoren,et al.  HIGHER EPISTASIS IN GENETIC ALGORITHMS , 2008, Bulletin of the Australian Mathematical Society.

[4]  E. L. Lawler,et al.  Branch-and-Bound Methods: A Survey , 1966, Oper. Res..

[5]  Yasuhiro Tsujimura,et al.  A tutorial survey of job-shop scheduling problems using genetic algorithms, part II: hybrid genetic search strategies , 1999 .

[6]  John E. Beasley,et al.  OR-Library: Distributing Test Problems by Electronic Mail , 1990 .

[7]  L. Booker Foundations of genetic algorithms. 2: L. Darrell Whitley (Ed.), Morgan Kaufmann, San Mateo, CA, 1993, ISBN 1-55860-263-1, 322 pp., US$45.95 , 1994 .

[8]  John J. Grefenstette,et al.  Deception Considered Harmful , 1992, FOGA.

[9]  J. Galletly An Overview of Genetic Algorithms , 1992 .

[10]  C. Bierwirth A generalized permutation approach to job shop scheduling with genetic algorithms , 1995 .

[11]  G. Thompson,et al.  Algorithms for Solving Production-Scheduling Problems , 1960 .

[12]  Gary B. Lamont,et al.  Evolutionary Algorithms for Solving Multi-Objective Problems , 2002, Genetic Algorithms and Evolutionary Computation.

[13]  Richard A. Watson,et al.  Reducing Local Optima in Single-Objective Problems by Multi-objectivization , 2001, EMO.

[14]  David Beasley,et al.  An overview of genetic algorithms: Part 1 , 1993 .

[15]  Mitsuo Gen,et al.  A tutorial survey of job-shop scheduling problems using genetic algorithms—I: representation , 1996 .

[16]  Mikkel T. Jensen,et al.  Guiding Single-Objective Optimization Using Multi-objective Methods , 2003, EvoWorkshops.

[17]  Frank W. Ciarallo,et al.  Deterministic helper-objective sequences applied to job-shop scheduling , 2010, GECCO '10.

[18]  Ravi Sethi,et al.  The Complexity of Flowshop and Jobshop Scheduling , 1976, Math. Oper. Res..

[19]  A. E. Eiben,et al.  Introduction to Evolutionary Computing , 2003, Natural Computing Series.

[20]  Colin R. Reeves,et al.  Epistasis in Genetic Algorithms: An Experimental Design Perspective , 1995, ICGA.

[21]  Kalyanmoy Deb,et al.  Multiobjective Problem Solving from Nature: From Concepts to Applications (Natural Computing Series) , 2008 .

[22]  John N. Hooker,et al.  Needed: An Empirical Science of Algorithms , 1994, Oper. Res..

[23]  Hussein A. Abbass,et al.  Searching under Multi-evolutionary Pressures , 2003, EMO.

[24]  Frank Neumann,et al.  Do additional objectives make a problem harder? , 2007, GECCO '07.

[25]  M. Jensen Helper-Objectives: Using Multi-Objective Evolutionary Algorithms for Single-Objective Optimisation , 2004 .

[26]  Kurt Geihs,et al.  A tunable model for multi-objective, epistatic, rugged, and neutral fitness landscapes , 2008, GECCO '08.

[27]  David Corne,et al.  The Pareto archived evolution strategy: a new baseline algorithm for Pareto multiobjective optimisation , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[28]  Bart Naudts,et al.  Generalized Royal Road Functions and Their Epistasis , 2000, Comput. Artif. Intell..

[29]  Joshua D. Knowles,et al.  Multiobjectivization by Decomposition of Scalar Cost Functions , 2008, PPSN.

[30]  Gary B. Lamont,et al.  Evolutionary Algorithms for Solving Multi-Objective Problems (Genetic and Evolutionary Computation) , 2006 .

[31]  Martin J. Oates,et al.  PESA-II: region-based selection in evolutionary multiobjective optimization , 2001 .

[32]  Marco Laumanns,et al.  SPEA2: Improving the strength pareto evolutionary algorithm , 2001 .

[33]  Kalyanmoy Deb,et al.  A fast and elitist multiobjective genetic algorithm: NSGA-II , 2002, IEEE Trans. Evol. Comput..

[34]  David Greiner,et al.  Improving Computational Mechanics Optimum Design Using Helper Objectives: An Application in Frame Bar Structures , 2007, EMO.

[35]  R. Storer,et al.  New search spaces for sequencing problems with application to job shop scheduling , 1992 .

[36]  Jan Karel Lenstra,et al.  Job Shop Scheduling by Local Search , 1996, INFORMS J. Comput..

[37]  Mike Wright,et al.  Subcost-Guided Search—Experiments with Timetabling Problems , 2001, J. Heuristics.

[38]  David E. Goldberg,et al.  Genetic Algorithms and Walsh Functions: Part I, A Gentle Introduction , 1989, Complex Syst..

[39]  Larry J. Eshelman,et al.  Proceedings of the 6th International Conference on Genetic Algorithms , 1995 .

[40]  Yuval Davidor,et al.  Epistasis Variance: A Viewpoint on GA-Hardness , 1990, FOGA.