A review of the role of heuristics in stochastic optimisation: from metaheuristics to learnheuristics

In the context of simulation-based optimisation, this paper reviews recent work related to the role of metaheuristics, matheuristics (combinations of exact optimisation methods with metaheuristics), simheuristics (hybridisation of simulation with metaheuristics), biased-randomised heuristics for ‘agile’ optimisation via parallel computing, and learnheuristics (combination of statistical/machine learning with metaheuristics) to deal with NP-hard and large-scale optimisation problems in areas such as transport and logistics, manufacturing and production, smart cities, telecommunication networks, finance and insurance, sustainable energy consumption, health care, military and defence, e-marketing, or bioinformatics. The manuscript provides the main related concepts and updated references that illustrate the applications of these hybrid optimisation–simulation–learning approaches in solving rich and real-life challenges under dynamic and uncertainty scenarios. A numerical analysis is also included to illustrate the benefits that these approaches can offer across different application fields. Finally, this work concludes by highlighting open research lines on the combination of these methodologies to extend the concept of simulation-based optimisation.

[1]  Angel A. Juan,et al.  A simheuristic algorithm for the capacitated location routing problem with stochastic demands , 2019 .

[2]  I. Turksen Type I and type II fuzzy system modeling , 1999 .

[3]  Laura Calvet,et al.  A simheuristic algorithm to set up starting times in the stochastic parallel flowshop problem , 2018, Simul. Model. Pract. Theory.

[4]  Anthony Brabazon,et al.  Natural Computing Algorithms , 2015, Natural Computing Series.

[5]  Angel A. Juan,et al.  A learnheuristic approach for the team orienteering problem with aerial drone motion constraints , 2020, Appl. Soft Comput..

[6]  Ki-Hwan G. Bae,et al.  US Army performance appraisal policy analysis: a simulation optimization approach , 2018, The Journal of Defense Modeling and Simulation: Applications, Methodology, Technology.

[7]  I. Diarrassouba,et al.  On the complexity of the separation problem for rounded capacity inequalities , 2017, Discret. Optim..

[8]  Bülent Çatay,et al.  A matheuristic method for the electric vehicle routing problem with time windows and fast chargers , 2018, Comput. Oper. Res..

[9]  Junhua Li,et al.  An Improved Tabu Search Algorithm for the Stochastic Vehicle Routing Problem With Soft Time Windows , 2020, IEEE Access.

[10]  Reiner Horst,et al.  A new simplicial cover technique in constrained global optimization , 1992, J. Glob. Optim..

[11]  Angel A. Juan,et al.  A variable neighborhood search simheuristic for project portfolio selection under uncertainty , 2020, J. Heuristics.

[12]  Angel A. Juan,et al.  Modeling and solving the non-smooth arc routing problem with realistic soft constraints , 2018, Expert Syst. Appl..

[13]  Angel A. Juan,et al.  SIMHEURISTICS APPLICATIONS: DEALING WITH UNCERTAINTY IN LOGISTICS, TRANSPORTATION, AND OTHER SUPPLY CHAIN AREAS , 2018, 2018 Winter Simulation Conference (WSC).

[14]  Luca Bertazzi,et al.  A Hybrid Heuristic for an Inventory Routing Problem , 2012, INFORMS J. Comput..

[15]  Laetitia Vermeulen-Jourdan,et al.  Synergies between operations research and data mining: The emerging use of multi-objective approaches , 2012, Eur. J. Oper. Res..

[16]  Angel A. Juan,et al.  Using Oriented Random Search to Provide a Set of Alternative Solutions to the Capacitated Vehicle Routing Problem , 2009 .

[17]  Laura Calvet,et al.  Combining statistical learning with metaheuristics for the Multi-Depot Vehicle Routing Problem with market segmentation , 2016, Comput. Ind. Eng..

[18]  Md. Noor-E-Alam,et al.  A machine learning based stochastic optimization framework for a wind and storage power plant participating in energy pool market , 2018, Applied Energy.

[19]  Haruna Chiroma,et al.  Metaheuristics: a comprehensive overview and classification along with bibliometric analysis , 2021, Artificial Intelligence Review.

[20]  Laura Calvet,et al.  Waste collection under uncertainty: a simheuristic based on variable neighbourhood search , 2017 .

[21]  Angel A. Juan,et al.  Speeding up computational times in simheuristics combining genetic algorithms with discrete-Event simulation , 2020, Simul. Model. Pract. Theory.

[22]  Angel A. Juan,et al.  Optimizing ride-sharing operations in smart sustainable cities: Challenges and the need for agile algorithms , 2021, Comput. Ind. Eng..

[23]  Angel A. Juan,et al.  A simulation-optimization approach to deploy Internet services in large-scale systems with user-provided resources , 2014, Simul..

[24]  Beatriz Brito Oliveira,et al.  Integrating pricing and capacity decisions in car rental: A matheuristic approach , 2018 .

[25]  K.L. Mak,et al.  A genetic algorithm for vehicle routing problems with stochastic demand and soft time windows , 2004, Proceedings of the 2004 IEEE Systems and Information Engineering Design Symposium, 2004..

[26]  Angel A. Juan,et al.  Biased randomization of heuristics using skewed probability distributions: A survey and some applications , 2017, Comput. Ind. Eng..

[27]  Charles Nicholson,et al.  Objective scaling ensemble approach for integer linear programming , 2018, J. Heuristics.

[28]  Daniele Ferone,et al.  Enhancing and extending the classical GRASP framework with biased randomisation and simulation , 2018, J. Oper. Res. Soc..

[29]  Jun Zhang,et al.  Evolutionary Computation Meets Machine Learning: A Survey , 2011, IEEE Computational Intelligence Magazine.

[30]  Angel A. Juan,et al.  SimILS: a simulation-based extension of the iterated local search metaheuristic for stochastic combinatorial optimization , 2016, J. Simulation.

[31]  Diego Oliva,et al.  Fuzzy Simheuristics: Solving Optimization Problems under Stochastic and Uncertainty Scenarios , 2020, Mathematics.

[32]  Enrique Alba,et al.  Parallel multi-objective metaheuristics for smart communications in vehicular networks , 2017, Soft Comput..

[33]  Manuel Chica,et al.  Why Simheuristics? Benefits, Limitations, and Best Practices When Combining Metaheuristics with Simulation , 2017, SSRN Electronic Journal.

[34]  Jairo R. Montoya-Torres,et al.  A simheuristic for bi-objective stochastic permutation flow shop scheduling problem , 2019 .

[35]  Shiliang Sun,et al.  A Survey of Optimization Methods From a Machine Learning Perspective , 2019, IEEE Transactions on Cybernetics.

[36]  Angel A. Juan,et al.  Agile optimization of a two-echelon vehicle routing problem with pickup and delivery , 2021, Int. Trans. Oper. Res..

[37]  Angel A. Juan,et al.  Solving large-scale time capacitated arc routing problems: from real-time heuristics to metaheuristics , 2019, Ann. Oper. Res..

[38]  Laura Calvet,et al.  Designing e-commerce supply chains: a stochastic facility-location approach , 2019, Int. Trans. Oper. Res..

[39]  Celso C. Ribeiro,et al.  Greedy Randomized Adaptive Search Procedures , 2003, Handbook of Metaheuristics.

[40]  Haitao Liu,et al.  Multi-objective metaheuristics for discrete optimization problems: A review of the state-of-the-art , 2020, Appl. Soft Comput..

[41]  Juan José Salazar González,et al.  Balanced vehicle routing: Polyhedral analysis and branch-and-cut algorithm , 2019, Eur. J. Oper. Res..

[42]  Simon Scheidegger,et al.  Machine Learning for High-Dimensional Dynamic Stochastic Economies , 2017, J. Comput. Sci..

[43]  Louis-Martin Rousseau,et al.  A hybrid metaheuristic for the vehicle routing problem with stochastic demand and duration constraints , 2016, J. Heuristics.

[44]  Jairo R. Montoya-Torres,et al.  Robust solutions in multi-objective stochastic permutation flow shop problem , 2019, Comput. Ind. Eng..

[45]  Angel A. Juan,et al.  On the Use of Learnheuristics in Vehicle Routing Optimization Problems with Dynamic Inputs , 2018, Algorithms.

[46]  Angel A. Juan,et al.  Metaheuristics in Telecommunication Systems: Network Design, Routing, and Allocation Problems , 2018, IEEE Systems Journal.

[47]  Angel A. Juan,et al.  Using horizontal cooperation concepts in integrated routing and facility-location decisions , 2019, Int. Trans. Oper. Res..

[48]  Priya L. Donti,et al.  Task-based End-to-end Model Learning in Stochastic Optimization , 2017, NIPS.

[49]  Raafat Elshaer,et al.  A taxonomic review of metaheuristic algorithms for solving the vehicle routing problem and its variants , 2020, Comput. Ind. Eng..

[50]  Michel Gendreau,et al.  A Tabu Search Heuristic for the Vehicle Routing Problem with Stochastic Demands and Customers , 1996, Oper. Res..

[51]  Changjun Wang,et al.  Incorporating a Bayesian Network into Two-Stage Stochastic Programming for Blood Bank Location-Inventory Problem in Case of Disasters , 2019, Discrete Dynamics in Nature and Society.

[52]  Joe Naoum-Sawaya,et al.  Optimization Models for Machine Learning: A Survey , 2019, Eur. J. Oper. Res..

[53]  Juan José Ramos,et al.  A simheuristic algorithm for solving the arc-routing problem with stochastic demands , 2018, J. Simulation.

[54]  Fatih Başçiftçi,et al.  Using Evolutionary Algorithms for the Scheduling of Aircrew on Airborne Early Warning and Control System , 2020 .

[55]  Luca Maria Gambardella,et al.  A survey on metaheuristics for stochastic combinatorial optimization , 2009, Natural Computing.

[56]  Michael Papasimeon,et al.  A simheuristic approach for evolving agent behaviour in the exploration for novel combat tactics , 2019, Operations Research Perspectives.

[57]  Angel A. Juan,et al.  Development and assessment of the SHARP and RandSHARP algorithms for the arc routing problem , 2012, AI Commun..

[58]  Kjetil Fagerholt,et al.  A decomposition solution approach to the troops-to-tasks assignment in military peacekeeping operations , 2020 .

[59]  Daniele Ferone,et al.  Combining simheuristics with Petri nets for solving the stochastic vehicle routing problem with correlated demands , 2020, Expert Syst. Appl..

[60]  Michele Lanzetta,et al.  Integration of hybrid additive/subtractive manufacturing planning and scheduling by metaheuristics , 2020, Comput. Ind. Eng..

[61]  Dimitris Bertsimas,et al.  From Predictive to Prescriptive Analytics , 2014, Manag. Sci..

[62]  Angel A. Juan,et al.  Maximising reward from a team of surveillance drones: a simheuristic approach to the stochastic team orienteering problem , 2020 .

[63]  Thibaut Vidal,et al.  A hybrid heuristic for a broad class of vehicle routing problems with heterogeneous fleet , 2019, Ann. Oper. Res..

[64]  Daniele Ferone,et al.  A simheuristic for routing electric vehicles with limited driving ranges and stochastic travel times , 2019 .

[65]  Giovanni Rinaldi,et al.  Branch-And-Cut Algorithms for the Capacitated VRP , 2001, The Vehicle Routing Problem.

[66]  Fred W. Glover,et al.  Future paths for integer programming and links to artificial intelligence , 1986, Comput. Oper. Res..

[67]  Angel A. Juan,et al.  A discrete-event driven metaheuristic for dynamic home service routing with synchronised trip sharing , 2016 .

[68]  Henrik Andersson,et al.  An iterative matheuristic for the inventory routing problem , 2021, Comput. Oper. Res..

[69]  Angel A. Juan,et al.  Metaheuristics for rich portfolio optimisation and risk management: Current state and future trends , 2019, Operations Research Perspectives.

[70]  Maria Grazia Speranza,et al.  A Matheuristic for the Multivehicle Inventory Routing Problem , 2017, INFORMS J. Comput..

[71]  Ambuj Tewari,et al.  Generalization Bounds in the Predict-then-Optimize Framework , 2019, NeurIPS.

[72]  Angel A. Juan,et al.  A simheuristic algorithm for solving the permutation flow shop problem with stochastic processing times , 2014, Simul. Model. Pract. Theory.

[73]  Andy H.F. Chow,et al.  An actor-critic deep reinforcement learning approach for metro train scheduling with rolling stock circulation under stochastic demand , 2020 .

[74]  Angel A. Juan,et al.  Combining variable neighborhood search with simulation for the inventory routing problem with stochastic demands and stock-outs , 2018, Comput. Ind. Eng..

[75]  Mauro Birattari,et al.  Applications Metaheuristics for the Vehicle Routing Problem with Stochastic Demands , 2004, PPSN.

[76]  Darryl K. Ahner,et al.  The Weapon-Target Assignment Problem , 2019, Comput. Oper. Res..

[77]  Angel A. Juan,et al.  A biased-randomized metaheuristic for the capacitated location routing problem , 2017, Int. Trans. Oper. Res..

[78]  Gürsel A. Süer,et al.  Stochastic mixed-model assembly line sequencing problem: Mathematical modeling and Q-learning based simulated annealing hyper-heuristics , 2019, Eur. J. Oper. Res..

[79]  Laura Calvet,et al.  Learnheuristics: hybridizing metaheuristics with machine learning for optimization with dynamic inputs , 2017 .

[80]  Angel A. Juan,et al.  Solving the deterministic and stochastic uncapacitated facility location problem: from a heuristic to a simheuristic , 2017, J. Oper. Res. Soc..

[81]  Angel A. Juan,et al.  A simheuristic approach for the two-dimensional vehicle routing problem with stochastic travel times , 2018, Simul. Model. Pract. Theory.

[82]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[83]  Abhijit Gosavi,et al.  Simulation-Based Optimization: Parametric Optimization Techniques and Reinforcement Learning , 2003 .

[84]  Masoud Rabbani,et al.  A stochastic multi-period industrial hazardous waste location-routing problem: Integrating NSGA-II and Monte Carlo simulation , 2019, Eur. J. Oper. Res..

[85]  José Arnaldo Barra Montevechi,et al.  Discrete simulation-based optimization methods for industrial engineering problems: A systematic literature review , 2019, Comput. Ind. Eng..

[86]  Angel A. Juan,et al.  Optimizing Energy Consumption in Transportation: Literature Review, Insights, and Research Opportunities , 2020, Energies.

[87]  Djamila Ouelhadj,et al.  The location routing problem using electric vehicles with constrained distance , 2020, Comput. Oper. Res..

[88]  Michael Ludkovski,et al.  Statistical learning for probability-constrained stochastic optimal control , 2019, Eur. J. Oper. Res..

[89]  Angel A. Juan,et al.  A simheuristic algorithm for the stochastic permutation flow-shop problem with delivery dates and cumulative payoffs , 2021, Int. Trans. Oper. Res..

[90]  Leonardo Vanneschi,et al.  Multiobjective Metaheuristic to Design RNA Sequences , 2019, IEEE Transactions on Evolutionary Computation.

[91]  Mahdi Moeini,et al.  A matheuristic for the vehicle routing problem with drones and its variants , 2019, Transportation Research Part C: Emerging Technologies.

[92]  Antonio Bolufé Röhler,et al.  Matheuristics: Optimization, Simulation and Control , 2009, Hybrid Metaheuristics.

[93]  Angel A. Juan,et al.  An iterative biased-randomized heuristic for the fleet size and mix vehicle-routing problem with backhauls , 2019, Int. Trans. Oper. Res..

[94]  Maria Grazia Speranza,et al.  A survey on matheuristics for routing problems , 2014, EURO J. Comput. Optim..

[95]  Paula Carroll,et al.  Decision Making Using Exact Optimization Methods in Sustainable Transportation , 2019 .

[96]  Javier Faulin,et al.  Using parallel & distributed computing for real-time solving of vehicle routing problems with stochastic demands , 2011, Annals of Operations Research.

[97]  Günther R. Raidl,et al.  Combining Metaheuristics and Exact Algorithms in Combinatorial Optimization: A Survey and Classification , 2005, IWINAC.

[98]  Angel A. Juan,et al.  A variable neighborhood search simheuristic for the multiperiod inventory routing problem with stochastic demands , 2020, Int. Trans. Oper. Res..

[99]  Gilbert Laporte,et al.  A concise guide to existing and emerging vehicle routing problem variants , 2019, Eur. J. Oper. Res..

[100]  D. Bertsimas,et al.  Best Subset Selection via a Modern Optimization Lens , 2015, 1507.03133.