Design of vehicle routing problem domains for a hyper-heuristic framework

The branch of algorithms that uses adaptive methods to select or tune heuristics, known as hyper-heuristics, is one that has seen a large amount of interest and development in recent years. With an aim to develop techniques that can deliver results on multiple problem domains and multiple instances, this work is getting ever closer to mirroring the complex situations that arise in the corporate world. However, the capability of a hyper-heuristic is closely tied to the representation of the problem it is trying to solve and the tools that are available to do so. This thesis considers the design of such problem domains for hyper-heuristics. In particular, this work proposes that through the provision of high-quality data and tools to a hyper-heuristic, improved results can be achieved. A definition is given which describes the components of a problem domain for hyper-heuristics. Building on this definition, a domain for the Vehicle Routing Problem with Time Windows is presented. Through this domain, examples are given of how a hyper- heuristic can be provided extra information with which to make intelligent search decisions. One of these pieces of information is a measure of distance between solution which, when used to aid selection of mutation heuristics, is shown to improve results of an Iterative Local Search hyper-heuristic. A further example of the advantages of providing extra information is given in the form of the provision of a set of tools for the Vehicle Routing Problem domain to promote and measure ’fairness’ between routes. By offering these extra features at a domain level, it is shown how a hyper-heuristic can drive toward a fairer solution while maintaining a high level of performance.

[1]  Jörg Homberger,et al.  Two Evolutionary Metaheuristics For The Vehicle Routing Problem With Time Windows , 1999 .

[2]  Paolo Toth,et al.  The Vehicle Routing Problem , 2002, SIAM monographs on discrete mathematics and applications.

[3]  Thomas Stützle,et al.  An Iterated Greedy heuristic for the sequence dependent setup times flowshop problem with makespan and weighted tardiness objectives , 2008, Eur. J. Oper. Res..

[4]  Li-Chen Fu,et al.  A VNS-based hyper-heuristic with adaptive computational budget of local search , 2012, 2012 IEEE Congress on Evolutionary Computation.

[5]  Dirk Thierens Adaptive Operator Selection for Iterated Local Search , 2009, SLS.

[6]  Keld Helsgaun,et al.  An effective implementation of the Lin-Kernighan traveling salesman heuristic , 2000, Eur. J. Oper. Res..

[7]  Matthias Fuchs,et al.  High Performance ATP Systems by Combining Several AI Methods , 1997, IJCAI.

[8]  Barrie M. Baker,et al.  A genetic algorithm for the vehicle routing problem , 2003, Comput. Oper. Res..

[9]  G. Clarke,et al.  Scheduling of Vehicles from a Central Depot to a Number of Delivery Points , 1964 .

[10]  Dirk Thierens,et al.  An Adaptive Pursuit Strategy for Allocating Operator Probabilities , 2005, BNAIC.

[11]  Edmund K. Burke,et al.  A scatter search methodology for the nurse rostering problem , 2010, J. Oper. Res. Soc..

[12]  Jean-Yves Potvin,et al.  A parallel route building algorithm for the vehicle routing and scheduling problem with time windows , 1993 .

[13]  Kevin Kok Wai Wong,et al.  Classification of adaptive memetic algorithms: a comparative study , 2006, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[14]  Gerhard Reinelt,et al.  TSPLIB - A Traveling Salesman Problem Library , 1991, INFORMS J. Comput..

[15]  Richard F. Hartl,et al.  Applying the ANT System to the Vehicle Routing Problem , 1999 .

[16]  Richard F. Hartl,et al.  An improved Ant System algorithm for theVehicle Routing Problem , 1999, Ann. Oper. Res..

[17]  Thomas Stützle,et al.  A simple and effective iterated greedy algorithm for the permutation flowshop scheduling problem , 2007, Eur. J. Oper. Res..

[18]  Michel Gendreau,et al.  A Tabu Search Heuristic for the Vehicle Routing Problem with Soft Time Windows , 1997, Transp. Sci..

[19]  Éric D. Taillard,et al.  Parallel iterative search methods for vehicle routing problems , 1993, Networks.

[20]  Teodor Gabriel Crainic,et al.  A cooperative parallel meta-heuristic for the vehicle routing problem with time windows , 2005, Comput. Oper. Res..

[21]  Patrick Prosser,et al.  Study of Greedy Search with Multiple Improvement Heuristics for Vehicle Routing Problems , 1996 .

[22]  Richard A. Watson,et al.  Reducing Local Optima in Single-Objective Problems by Multi-objectivization , 2001, EMO.

[23]  Paul Shaw,et al.  Using Constraint Programming and Local Search Methods to Solve Vehicle Routing Problems , 1998, CP.

[24]  Hermann Gehring,et al.  A Parallel Hybrid Evolutionary Metaheuristic for the Vehicle Routing Problem with Time Windows , 1999 .

[25]  Gilbert Laporte,et al.  An Improved Petal Heuristic for the Vehicle Routeing Problem , 1996 .

[26]  Olli Bräysy,et al.  Active-guided evolution strategies for large-scale capacitated vehicle routing problems , 2007, Comput. Oper. Res..

[27]  Michel Gendreau,et al.  Vehicle Routing Problem with Time Windows, Part I: Route Construction and Local Search Algorithms , 2005, Transp. Sci..

[28]  Kenneth D. Boese,et al.  Cost Versus Distance In the Traveling Salesman Problem , 1995 .

[29]  Barry McCollum,et al.  Initial Results on Fairness in Examination Timetabling , 2013 .

[30]  Marko Privosnik The scalability of evolved on line bin packing heuristics , 2007, 2007 IEEE Congress on Evolutionary Computation.

[31]  Richard F. Hartl,et al.  A Variable Neighborhood Search for the Multi Depot Vehicle Routing Problem with Time Windows , 2004, J. Heuristics.

[32]  Kalyanmoy Deb,et al.  Messy Genetic Algorithms: Motivation, Analysis, and First Results , 1989, Complex Syst..

[33]  Luca Maria Gambardella,et al.  A Multiple Ant Colony System for Vehicle Routing Problems with Time Windows , 1999 .

[34]  Nottingham Ng,et al.  A Hybrid Heuristic Ordering and Variable Neighbourhood Search for the Nurse Rostering Problem , 2005 .

[35]  Edward P. K. Tsang,et al.  Guided local search and its application to the traveling salesman problem , 1999, Eur. J. Oper. Res..

[36]  Anthony Wren,et al.  Computer Scheduling of Vehicles from One or More Depots to a Number of Delivery Points , 1972 .

[37]  Chi Fai Cheung,et al.  A Hyper-Heuristic Inspired by Pearl Hunting , 2012, LION.

[38]  J. K. Lenstra,et al.  Complexity of vehicle routing and scheduling problems , 1981, Networks.

[39]  Billy E. Gillett,et al.  A Heuristic Algorithm for the Vehicle-Dispatch Problem , 1974, Oper. Res..

[40]  Peter I. Cowling,et al.  A Memetic Approach to the Nurse Rostering Problem , 2001, Applied Intelligence.

[41]  Toby Walsh,et al.  Towards an Understanding of Hill-Climbing Procedures for SAT , 1993, AAAI.

[42]  Patrick De Causmaecker,et al.  A hyperheuristic approach to examination timetabling problems: benchmarks and a new problem from practice , 2012, J. Sched..

[43]  Graham Kendall,et al.  A Hyperheuristic Approach to Scheduling a Sales Summit , 2000, PATAT.

[44]  David Meignan,et al.  Coalition-based metaheuristic: a self-adaptive metaheuristic using reinforcement learning and mimetism , 2010, J. Heuristics.

[45]  Bart Selman,et al.  Noise Strategies for Improving Local Search , 1994, AAAI.

[46]  Gilbert Laporte,et al.  A unified tabu search heuristic for vehicle routing problems with time windows , 2001, J. Oper. Res. Soc..

[47]  G. Dueck New optimization heuristics , 1993 .

[48]  Jürgen Schulze,et al.  A parallel algorithm for the vehicle routing problem with time window constraints , 1999, Ann. Oper. Res..

[49]  Jörg Homberger,et al.  Parallelization of a Two-Phase Metaheuristic for Routing Problems with Time Windows , 2002, J. Heuristics.

[50]  David Pisinger,et al.  A general heuristic for vehicle routing problems , 2007, Comput. Oper. Res..

[51]  Gabriela Ochoa,et al.  Adaptive Evolutionary Algorithms and Extensions to the HyFlex Hyper-heuristic Framework , 2012, PPSN.

[52]  T. J. Gaskell,et al.  Bases for Vehicle Fleet Scheduling , 1967 .

[53]  H. Paessens,et al.  The savings algorithm for the vehicle routing problem , 1988 .

[54]  George B. Dantzig,et al.  Solution of a Large-Scale Traveling-Salesman Problem , 1954, Oper. Res..

[55]  Jean-Yves Potvin,et al.  A parallel implementation of the Tabu search heuristic for vehicle routing problems with time window constraints , 1994, Comput. Oper. Res..

[56]  Michel Gendreau,et al.  A PARALLEL TABU SEARCH HEURISTIC FOR THE VEHICLE ROUTING PROBLEM WITH TIME WINDOWS , 1997 .

[57]  Gilbert Laporte,et al.  Solving a Family of Multi-Depot Vehicle Routing and Location-Routing Problems , 1988, Transp. Sci..

[58]  Nicolas Jozefowiez,et al.  Multi-objective vehicle routing problems , 2008, Eur. J. Oper. Res..

[59]  Luca Maria Gambardella,et al.  Ant Algorithms for Discrete Optimization , 1999, Artificial Life.

[60]  Ibrahim H. Osman,et al.  Metastrategy simulated annealing and tabu search algorithms for the vehicle routing problem , 1993, Ann. Oper. Res..

[61]  Gilbert Laporte,et al.  A Tabu Search Heuristic for the Vehicle Routing Problem , 1991 .

[62]  Gerhart F King,et al.  EXCESS TRAVEL: CAUSES, EXTENT, AND CONSEQUENCES , 1987 .

[63]  Inyong Ham,et al.  A heuristic algorithm for the m-machine, n-job flow-shop sequencing problem , 1983 .

[64]  Rajeev Motwani,et al.  On syntactic versus computational views of approximability , 1994, Proceedings 35th Annual Symposium on Foundations of Computer Science.

[65]  K. Verbeeck,et al.  A selection hyper-heuristic for scheduling deliveries of ready-mixed concrete , 2011 .

[66]  Graham Kendall,et al.  An Ant Based Hyper-heuristic for the Travelling Tournament Problem , 2007, 2007 IEEE Symposium on Computational Intelligence in Scheduling.

[67]  Frédéric Saubion,et al.  A Compass to Guide Genetic Algorithms , 2008, PPSN.

[68]  Paul M. Thompson,et al.  Cyclic Transfer Algorithm for Multivehicle Routing and Scheduling Problems , 1993, Oper. Res..

[69]  Jun Zhang,et al.  Ant Colony System for Optimizing Vehicle Routing Problem with Time Windows , 2005, International Conference on Computational Intelligence for Modelling, Control and Automation and International Conference on Intelligent Agents, Web Technologies and Internet Commerce (CIMCA-IAWTIC'06).

[70]  Fred W. Glover,et al.  Ejection Chains, Reference Structures and Alternating Path Methods for Traveling Salesman Problems , 1996, Discret. Appl. Math..

[71]  Hector J. Levesque,et al.  A New Method for Solving Hard Satisfiability Problems , 1992, AAAI.

[72]  Bruce L. Golden,et al.  Routing Vehicles in the Real World: Applications in the Solid Waste, Beverage, Food, Dairy, and Newspaper Industries , 2002, The Vehicle Routing Problem.

[73]  Michel Gendreau,et al.  Adaptive iterated local search for cross-domain optimisation , 2011, GECCO '11.

[74]  Enrique Alba,et al.  A Hybrid Cellular Genetic Algorithm for the Capacitated Vehicle Routing Problem , 2008, Engineering Evolutionary Intelligent Systems.

[75]  G. Dueck,et al.  Record Breaking Optimization Results Using the Ruin and Recreate Principle , 2000 .

[76]  Jean-Yves Potvin,et al.  An Exchange Heuristic for Routeing Problems with Time Windows , 1995 .

[77]  Alex Van Breedam,et al.  An analysis of the behavior of heuristics for the vehicle routing problem for a selection of problems with vehicle-relatezd, customer-related, and time-related constraints , 1994 .

[78]  Sanja Petrovic,et al.  HyFlex: A Benchmark Framework for Cross-Domain Heuristic Search , 2011, EvoCOP.

[79]  Wout Dullaert,et al.  A multi-parametric evolution strategies algorithm for vehicle routing problems , 2007, Expert Syst. Appl..

[80]  Graham Kendall,et al.  A Tabu-Search Hyperheuristic for Timetabling and Rostering , 2003, J. Heuristics.

[81]  Michel Gendreau,et al.  A guide to vehicle routing heuristics , 2002, J. Oper. Res. Soc..

[82]  Fred Glover,et al.  Extensions of the Petal Method for Vehicle Routeing , 1993 .

[83]  Edmund K. Burke,et al.  A Time Predefined Variable Depth Search for Nurse Rostering , 2013, INFORMS J. Comput..

[84]  Marvin D. Nelson,et al.  Implementation techniques for the vehicle routing problem , 1985, Comput. Oper. Res..

[85]  P. C. Yellow,et al.  A Computational Modification to the Savings Method of Vehicle Scheduling , 1970 .

[86]  Ender Özcan,et al.  A Hyper-Heuristic Based on Random Gradient, Greedy and Dominance , 2011, ISCIS.

[87]  Christian Prins,et al.  A simple and effective evolutionary algorithm for the vehicle routing problem , 2004, Comput. Oper. Res..

[88]  A. Schrijver On the History of Combinatorial Optimization (Till 1960) , 2005 .

[89]  Jean Berger,et al.  A new hybrid genetic algorithm for the capacitated vehicle routing problem , 2003, J. Oper. Res. Soc..

[90]  George Ioannou,et al.  A greedy look-ahead heuristic for the vehicle routing problem with time windows , 2001, J. Oper. Res. Soc..

[91]  R. Hartl,et al.  A parallel version of the DAnt algorithm for the Vehicle Routing Problem , 2005 .

[92]  M. Dorigo,et al.  1 Positive Feedback as a Search Strategy , 1991 .

[93]  Graham Kendall,et al.  Hyper-Heuristics: An Emerging Direction in Modern Search Technology , 2003, Handbook of Metaheuristics.

[94]  George B. Dantzig,et al.  The Truck Dispatching Problem , 1959 .

[95]  Peter I. Cowling,et al.  Hyperheuristics for managing a large collection of low level heuristics to schedule personnel , 2003, The 2003 Congress on Evolutionary Computation, 2003. CEC '03..

[96]  Thomas L. Magnanti,et al.  Implementing vehicle routing algorithms , 1977, Networks.

[97]  Weixiong Zhang,et al.  Backbone Guided Local Search for Maximum Satisfiability , 2003, IJCAI.

[98]  David Simchi-Levi,et al.  A New Generation of Vehicle Routing Research: Robust Algorithms, Addressing Uncertainty , 1996, Oper. Res..

[99]  Jean Berger,et al.  A Hybrid Genetic Algorithm for the Vehicle Routing Problem with Time Windows , 1998, Canadian Conference on AI.

[100]  Ender Özcan,et al.  An Experimental Study on Hyper-heuristics and Exam Timetabling , 2006, PATAT.

[101]  Gilbert Laporte,et al.  New Insertion and Postoptimization Procedures for the Traveling Salesman Problem , 1992, Oper. Res..

[102]  Kendall E. Nygard,et al.  GIDEON: a genetic algorithm system for vehicle routing with time windows , 1991, [1991] Proceedings. The Seventh IEEE Conference on Artificial Intelligence Application.

[103]  Éric D. Taillard,et al.  Parallel Taboo Search Techniques for the Job Shop Scheduling Problem , 1994, INFORMS J. Comput..

[104]  Loo Hay Lee,et al.  Heuristic methods for vehicle routing problem with time windows , 2001, Artif. Intell. Eng..

[105]  Russell Bent,et al.  A two-stage hybrid algorithm for pickup and delivery vehicle routing problems with time windows , 2006, Comput. Oper. Res..

[106]  Michèle Sebag,et al.  Extreme Value Based Adaptive Operator Selection , 2008, PPSN.

[107]  Gilbert Laporte,et al.  A tabu search heuristic for the multi-depot vehicle routing problem , 1996, Comput. Oper. Res..

[108]  Jörg Homberger,et al.  A two-phase hybrid metaheuristic for the vehicle routing problem with time windows , 2005, Eur. J. Oper. Res..

[109]  Jan Karel Lenstra,et al.  A classification scheme for vehicle routing and scheduling problems , 1990 .

[110]  Gabriela Ochoa,et al.  A HyFlex Module for the Permutation Flow Shop Problem , 2010 .

[111]  Patrick De Causmaecker,et al.  Hyper-heuristics with a dynamic heuristic set for the home care scheduling problem , 2010, IEEE Congress on Evolutionary Computation.

[112]  Dale Schuurmans,et al.  Local search characteristics of incomplete SAT procedures , 2000, Artif. Intell..

[113]  Nicos Christofides,et al.  Algorithms for Large-scale Travelling Salesman Problems , 1972 .

[114]  Marek Kubiak,et al.  Distance Measures and Fitness-Distance Analysis for the Capacitated Vehicle Routing Problem , 2007, Metaheuristics.

[115]  Andrew Lim,et al.  A Hybrid Search Algorithm for the Vehicle Routing Problem with Time Windows , 2001, Int. J. Artif. Intell. Tools.

[116]  G. Laporte,et al.  A tabu search heuristic for periodic and multi-depot vehicle routing problems , 1997, Networks.

[117]  Éric D. Taillard,et al.  Benchmarks for basic scheduling problems , 1993 .

[118]  Patrick R. McMullen,et al.  Ant colony optimization techniques for the vehicle routing problem , 2004, Adv. Eng. Informatics.

[119]  Marshall L. Fisher,et al.  A generalized assignment heuristic for vehicle routing , 1981, Networks.

[120]  Richard F. Hartl,et al.  D-Ants: Savings Based Ants divide and conquer the vehicle routing problem , 2004, Comput. Oper. Res..

[121]  Karl F. Doerner,et al.  A Savings Based Ant System For The Vehicle Routing Problem , 2002, GECCO.

[122]  Gleb Belov,et al.  A cutting plane algorithm for the one-dimensional cutting stock problem with multiple stock lengths , 2002, Eur. J. Oper. Res..

[123]  Edmund K. Burke,et al.  An Improved Choice Function Heuristic Selection for Cross Domain Heuristic Search , 2012, PPSN.

[124]  Wout Dullaert,et al.  Routing relatively few customers per route , 2003 .

[125]  El-Ghazali Talbi,et al.  Metaheuristics - From Design to Implementation , 2009 .

[126]  David H. Wolpert,et al.  No free lunch theorems for optimization , 1997, IEEE Trans. Evol. Comput..

[127]  Lawrence Davis,et al.  Adapting Operator Probabilities in Genetic Algorithms , 1989, ICGA.

[128]  Sanja Petrovic,et al.  Iterated local search vs. hyper-heuristics: Towards general-purpose search algorithms , 2010, IEEE Congress on Evolutionary Computation.

[129]  Jeffrey D. Ullman,et al.  L worst-case performance bounds for rumple one-dimensional packing algorithms siam j , 1974 .

[130]  Emanuel Falkenauer,et al.  A hybrid grouping genetic algorithm for bin packing , 1996, J. Heuristics.

[131]  Edmund K. Burke,et al.  Examination timetabling using late acceptance hyper-heuristics , 2009, 2009 IEEE Congress on Evolutionary Computation.

[132]  Patrick De Causmaecker,et al.  An Intelligent Hyper-Heuristic Framework for CHeSC 2011 , 2012, LION.

[133]  David Simchi-Levi,et al.  A Probabilistic Analysis of Tour Partitioning Heuristics for the Capacitated Vehicle Routing Problem with Unsplit Demands , 1993, Math. Oper. Res..

[134]  Andrea Lodi,et al.  Two-dimensional packing problems: A survey , 2002, Eur. J. Oper. Res..

[135]  Graham Kendall,et al.  A Classification of Hyper-heuristic Approaches , 2010 .

[136]  Graham Kendall,et al.  Guided Operators for a Hyper-Heuristic Genetic Algorithm , 2003, Australian Conference on Artificial Intelligence.

[137]  Edmund K. Burke,et al.  A Reinforcement Learning - Great-Deluge Hyper-Heuristic for Examination Timetabling , 2010, Int. J. Appl. Metaheuristic Comput..

[138]  E. Burke,et al.  A Late Acceptance Strategy in Hill-Climbing for Exam Timetabling Problems , 2008 .

[139]  Marek Kubiak,et al.  Systematic construction of recombination operators for the vehicle routing problem , 2004 .

[140]  Loo Hay Lee,et al.  A messy genetic algorithm for the vehicle routing problem with time window constraints , 2001, Proceedings of the 2001 Congress on Evolutionary Computation (IEEE Cat. No.01TH8546).

[141]  Edmund K. Burke,et al.  An ant algorithm hyperheuristic for the project presentation scheduling problem , 2005, 2005 IEEE Congress on Evolutionary Computation.

[142]  Peter I. Cowling,et al.  Hyperheuristics: Recent Developments , 2008, Adaptive and Multilevel Metaheuristics.

[143]  Fred W. Glover,et al.  Future paths for integer programming and links to artificial intelligence , 1986, Comput. Oper. Res..

[144]  Frédéric Saubion,et al.  Towards a generic control strategy for Evolutionary Algorithms: an adaptive fuzzy-learning approach , 2007, 2007 IEEE Congress on Evolutionary Computation.

[145]  Brian W. Kernighan,et al.  An Effective Heuristic Algorithm for the Traveling-Salesman Problem , 1973, Oper. Res..

[146]  Wen-Chyuan Chiang,et al.  A Reactive Tabu Search Metaheuristic for the Vehicle Routing Problem with Time Windows , 1997, INFORMS J. Comput..

[147]  Yves Rochat,et al.  Probabilistic diversification and intensification in local search for vehicle routing , 1995, J. Heuristics.

[148]  Graham Kendall,et al.  An adaptive Length chromosome Hyper-Heuristic Genetic Algorithm for a Trainer Scheduling Problem , 2002, SEAL.

[149]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[150]  Thomas Stützle,et al.  SATLIB: An Online Resource for Research on SAT , 2000 .

[151]  Mauro Brunato,et al.  Reactive Search and Intelligent Optimization , 2008 .

[152]  Marie-Claude Portmann,et al.  Performances's study on crossover operators keeping good schemata for some scheduling problems , 2000, GECCO.

[153]  G. Croes A Method for Solving Traveling-Salesman Problems , 1958 .

[154]  Tong Zhen,et al.  A Hybrid Intelligent Algorithm for the Vehicle Routing with Time Windows , 2008, ICIC.

[155]  Martin W. P. Savelsbergh,et al.  The Vehicle Routing Problem with Time Windows: Minimizing Route Duration , 1992, INFORMS J. Comput..

[156]  Marius M. Solomon,et al.  Algorithms for the Vehicle Routing and Scheduling Problems with Time Window Constraints , 1987, Oper. Res..

[157]  Shen Lin Computer solutions of the traveling salesman problem , 1965 .