Biased randomization of heuristics using skewed probability distributions: A survey and some applications

Abstract Randomized heuristics are widely used to solve large scale combinatorial optimization problems. Among the plethora of randomized heuristics, this paper reviews those that contain biased-randomized procedures (BRPs). A BRP is a procedure to select the next constructive ‘movement’ from a list of candidates in which their elements have different probabilities based on some criteria (e.g., ranking, priority rule, heuristic value, etc.). The main idea behind biased randomization is the introduction of a slight modification in the greedy constructive behavior that provides a certain degree of randomness while maintaining the logic behind the heuristic. BRPs can be categorized into two main groups according to how choice probabilities are computed: (i) BRPs using an empirical bias function; and (ii) BRPs using a skewed theoretical probability distribution. This paper analyzes the second group and illustrates, throughout a series of numerical experiments, how these BRPs can benefit from parallel computing in order to significantly outperform heuristics and even simple metaheuristic approaches, thus providing reasonably good solutions in ‘real time’ to different problems in the areas of transportation, logistics, and scheduling.

[1]  G. Clarke,et al.  Scheduling of Vehicles from a Central Depot to a Number of Delivery Points , 1964 .

[2]  Barry B. Barrios,et al.  MIRHA: multi-start biased randomization of heuristics with adaptive local search for solving non-smooth routing problems , 2013 .

[3]  Andreas Drexl,et al.  Scheduling of Project Networks by Job Assignment , 1991 .

[4]  Robert E. Tarjan,et al.  Performance Bounds for Level-Oriented Two-Dimensional Packing Algorithms , 1980, SIAM J. Comput..

[5]  Lijun Wei,et al.  A Binary Search Heuristic Algorithm Based on Randomized Local Search for the Rectangular Strip-Packing Problem , 2013, INFORMS J. Comput..

[6]  J. K. Lenstra,et al.  Local Search in Combinatorial Optimisation. , 1997 .

[7]  Éric D. Taillard,et al.  Benchmarks for basic scheduling problems , 1993 .

[8]  A. L. Arcus,et al.  COMSOAL: a computer method of sequencing operations for assembly lines , 1965 .

[9]  Dale F. Cooper,et al.  Heuristics for Scheduling Resource-Constrained Projects: An Experimental Investigation , 1976 .

[10]  Yupo Chan,et al.  Location Theory and Decision Analysis: Analytics of Spatial Information Technology , 2011 .

[11]  Jan H. van Vuuren,et al.  A survey and comparison of guillotine heuristics for the 2D oriented offline strip packing problem , 2009, Discret. Optim..

[12]  X. Chao,et al.  Operations scheduling with applications in manufacturing and services , 1999 .

[13]  Mauricio G. C. Resende,et al.  Biased random-key genetic algorithms for combinatorial optimization , 2011, J. Heuristics.

[14]  Fred Glover,et al.  Probabilistic Move Selection in Tabu Search for Zero-One Mixed Integer Programming Problems , 1996 .

[15]  Celso C. Ribeiro,et al.  Greedy Randomized Adaptive Search Procedures: Advances, Hybridizations, and Applications , 2010 .

[16]  R. Kolisch,et al.  Heuristic algorithms for the resource-constrained project scheduling problem: classification and computational analysis , 1999 .

[17]  Stephen F. Smith,et al.  Enhancing Stochastic Search Performance by Value-Biased Randomization of Heuristics , 2005, J. Heuristics.

[18]  John L. Bresina,et al.  Automated Management and Scheduling of Remote Automatic Telescopes , 1994 .

[19]  Vincent A. Mabert,et al.  SAMPLING AS A SOLUTION METHODOLOGY , 1977 .

[20]  Angel A. Juan,et al.  An ILS-biased randomization algorithm for the two-dimensional loading HFVRP with sequential loading and items rotation , 2016, J. Oper. Res. Soc..

[21]  Marco Dorigo,et al.  Ant system: optimization by a colony of cooperating agents , 1996, IEEE Trans. Syst. Man Cybern. Part B.

[22]  James P. Kelly,et al.  The Impact of Metaheuristics on Solving the Vehicle Routing Problem: Algorithms, Problem Sets, and Computational Results , 1998 .

[23]  Celso C. Ribeiro,et al.  Multi-start methods for combinatorial optimization , 2013, Eur. J. Oper. Res..

[24]  Angel A. Juan,et al.  Solving the deterministic and stochastic uncapacitated facility location problem: from a heuristic to a simheuristic , 2017, J. Oper. Res. Soc..

[25]  Stephen C. H. Leung,et al.  A fast layer-based heuristic for non-guillotine strip packing , 2011, Expert Syst. Appl..

[26]  Francisco Ballestín,et al.  Resource-constrained project scheduling: A critical activity reordering heuristic , 2003, Eur. J. Oper. Res..

[27]  John L. Bresina,et al.  Heuristic-Biased Stochastic Sampling , 1996, AAAI/IAAI, Vol. 1.

[28]  Andreas Schirmer,et al.  Parameterized heuristics for project scheduling: Biased random sampling methods , 1997 .

[29]  Angel A. Juan,et al.  Combining biased randomization with iterated local search for solving the multidepot vehicle routing problem , 2015, Int. Trans. Oper. Res..

[30]  Angel A. Juan,et al.  A multi-start randomized heuristic for real-life crew rostering problems in airlines with work-balancing goals , 2017, Ann. Oper. Res..

[31]  Gilbert Laporte,et al.  Arc Routing: Problems, Methods, and Applications , 2015 .

[32]  Thomas E. Vollmann,et al.  An Experimental Comparison of Techniques for the Assignment of Facilities to Locations , 1968, Oper. Res..

[33]  Fred Glover,et al.  Tabu Search - Part II , 1989, INFORMS J. Comput..

[34]  Jean-Philippe Rennard,et al.  Stochastic Optimization Algorithms , 2007, ArXiv.

[35]  Angel A. Juan,et al.  A review of simheuristics: Extending metaheuristics to deal with stochastic combinatorial optimization problems , 2015 .

[36]  Angel A. Juan,et al.  Using biased randomization for solving the two-dimensional loading vehicle routing problem with heterogeneous fleet , 2016, Ann. Oper. Res..

[37]  Eugene L. Lawler,et al.  Traveling Salesman Problem , 2016 .

[38]  Celso C. Ribeiro,et al.  Greedy Randomized Adaptive Search Procedures , 2003, Handbook of Metaheuristics.

[39]  Angel A. Juan,et al.  The ALGACEA-1 method for the capacitated vehicle routing problem , 2008, Int. Trans. Oper. Res..

[40]  Paolo Toth,et al.  Vehicle Routing , 2014, Vehicle Routing.

[41]  Daniele Tarchi,et al.  Supporting Mobile Cloud Computing in Smart Cities via Randomized Algorithms , 2018, IEEE Systems Journal.

[42]  Angel A. Juan,et al.  Decision Making in Service Industries : A Practical Approach , 2012 .

[43]  Angel A. Juan,et al.  Using iterated local search for solving the flow-shop problem: Parallelization, parametrization, and randomization issues , 2014, Int. Trans. Oper. Res..

[44]  J. Reese,et al.  Solution methods for the p-median problem: An annotated bibliography , 2006 .

[45]  Inyong Ham,et al.  A heuristic algorithm for the m-machine, n-job flow-shop sequencing problem , 1983 .

[46]  Yuri Kochetov,et al.  Computationally Difficult Instances for the Uncapacitated Facility Location Problem , 2005 .

[47]  Angel A. Juan,et al.  Biased Randomization of Classical Heuristics , 2014 .

[48]  Angel A. Juan,et al.  Combining biased random sampling with metaheuristics for the facility location problem in distributed computer systems , 2014, Proceedings of the Winter Simulation Conference 2014.

[49]  Pearl Y. Wang,et al.  Heuristics for Large Strip Packing Problems with Guillotine Patterns: an Empirical Study , 2001 .

[50]  G. M. Buxey,et al.  The Vehicle Scheduling Problem and Monte Carlo Simulation , 1979 .

[51]  Angel A. Juan,et al.  Solving vehicle routing problems with asymmetric costs and heterogeneous fleets , 2014, Int. J. Adv. Oper. Manag..

[52]  Angel A. Juan,et al.  The SR-GCWS hybrid algorithm for solving the capacitated vehicle routing problem , 2008 .

[53]  Gerhard Wäscher,et al.  An improved typology of cutting and packing problems , 2007, Eur. J. Oper. Res..

[54]  Luca Maria Gambardella,et al.  Ant colony system: a cooperative learning approach to the traveling salesman problem , 1997, IEEE Trans. Evol. Comput..

[55]  Angel A. Juan,et al.  Routing fleets with multiple driving ranges: Is it possible to use greener fleet configurations? , 2014, Appl. Soft Comput..

[56]  Angel A. Juan,et al.  A biased-randomized algorithm for the two-dimensional vehicle routing problem with and without item rotations , 2014, Int. Trans. Oper. Res..

[57]  Javier Faulin,et al.  Using parallel & distributed computing for real-time solving of vehicle routing problems with stochastic demands , 2011, Annals of Operations Research.

[58]  El-Ghazali Talbi,et al.  Metaheuristics - From Design to Implementation , 2009 .

[59]  Angel A. Juan,et al.  A multi-agent based cooperative approach to scheduling and routing , 2016, Eur. J. Oper. Res..

[60]  L. M. García Raffi,et al.  A heuristic algorithm based on Monte Carlo methods for the rural postman problem , 1998, Comput. Oper. Res..

[61]  Angel A. Juan,et al.  Vehicle routing in a Spanish distribution company: Saving using a savings-based heuristic , 2013, OR Insight.

[62]  Michael Pinedo,et al.  Scheduling: Theory, Algorithms, and Systems , 1994 .

[63]  Angel A. Juan,et al.  A simheuristic algorithm for solving the permutation flow shop problem with stochastic processing times , 2014, Simul. Model. Pract. Theory.

[64]  Angel A. Juan,et al.  Development and assessment of the SHARP and RandSHARP algorithms for the arc routing problem , 2012, AI Commun..

[65]  W. L. Berry,et al.  Inventory Investment Analysis Using Biased Sampling Techniques , 1977 .

[66]  Celso C. Ribeiro,et al.  Reactive GRASP: An Application to a Matrix Decomposition Problem in TDMA Traffic Assignment , 2000, INFORMS J. Comput..

[67]  Angel A. Juan,et al.  A Biased-Randomised Large Neighbourhood Search for the two-dimensional Vehicle Routing Problem with Backhauls , 2016, Eur. J. Oper. Res..

[68]  Angel A. Juan,et al.  A successive approximations method for the heterogeneous vehicle routing problem: analysing different fleet configurations , 2014 .

[69]  George Logemann,et al.  An Algorithm for the Construction and Evaluation of Feasible Schedules , 1962 .

[70]  Gilbert W. King The Monte Carlo Method as a Natural Mode of Expression in Operations Research , 1953, Oper. Res..

[71]  Fred Glover,et al.  Tabu Search: A Tutorial , 1990 .

[72]  P. F. Córdoba,et al.  A real delivery problem dealt with Monte Carlo Techniques , 2000 .

[73]  Fred M. Tonge Assembly Line Balancing Using Probabilistic Combinations of Heuristics , 1965 .

[74]  Richard W. Eglese,et al.  An Interactive Algorithm for Vehicle Routeing for Winter — Gritting , 1996 .

[75]  Angel A. Juan,et al.  On the use of Monte Carlo simulation, cache and splitting techniques to improve the Clarke and Wright savings heuristics , 2011, J. Oper. Res. Soc..

[76]  Yupo Chan,et al.  LOCATION THEORY AND DECISION ANALYSIS , 2011 .