Novel ensemble genetic programming hyper-heuristics for uncertain capacitated arc routing problem

The Uncertain Capacitated Arc Routing Problem (UCARP) is an important problem with many real-world applications. A major challenge in UCARP is to handle the uncertain environment effectively and reduce the recourse cost upon route failures. Genetic Programming Hyper-heuristic (GPHH) has been successfully applied to automatically evolve effective routing policies to make real-time decisions in the routing process. However, most existing studies obtain a single complex routing policy which is hard to interpret. In this paper, we aim to evolve an ensemble of simpler and more interpretable routing policies than a single complex policy. By considering the two critical properties of ensemble learning, i.e., the effectiveness of each ensemble element and the diversity between them, we propose two novel ensemble GP approaches namely DivBaggingGP and DivNichGP. DivBaggingGP evolves the ensemble elements sequentially, while DivNichGP evolves them simultaneously. The experimental results showed that both DivBaggingGP and DivNichGP could obtain more interpretable routing policies than the single complex routing policy. DivNichGP can achieve better test performance than DivBaggingGP as well as the single routing policy evolved by the current state-of-the-art GPHH. This demonstrates the effectiveness of evolving both effective and interpretable routing policies using ensemble learning.

[1]  H. Handa,et al.  Robust route optimization for gritting/salting trucks: a CERCIA experience , 2006, IEEE Computational Intelligence Magazine.

[2]  Yi Mei,et al.  Genetic programming hyper-heuristic for multi-vehicle uncertain capacitated arc routing problem , 2018, GECCO.

[3]  Philippe Lacomme,et al.  Evolutionary Algorithms for Stochastic Arc Routing Problems , 2004, EvoWorkshops.

[4]  Byoung-Tak Zhang,et al.  Ensemble Learning with Active Example Selection for Imbalanced Biomedical Data Classification , 2011, IEEE/ACM Transactions on Computational Biology and Bioinformatics.

[5]  Kin Keung Lai,et al.  Credit risk assessment with a multistage neural network ensemble learning approach , 2008, Expert Syst. Appl..

[6]  Richard F. Hartl,et al.  Applying Ant Colony Optimization to the Capacitated Arc Routing Problem , 2004, ANTS Workshop.

[7]  Ke Tang,et al.  A developmental solution to (dynamic) capacitated arc routing problems using genetic programming , 2012, GECCO '12.

[8]  Richard W. Eglese,et al.  A deterministic tabu search algorithm for the capacitated arc routing problem , 2008, Comput. Oper. Res..

[9]  Sanne Wøhlk A Decade of Capacitated Arc Routing , 2008 .

[10]  Philippe Lacomme,et al.  Competitive Memetic Algorithms for Arc Routing Problems , 2004, Ann. Oper. Res..

[11]  Mark Johnston,et al.  Evolving Ensembles of Dispatching Rules Using Genetic Programming for Job Shop Scheduling , 2015, EuroGP.

[12]  Dirk Van,et al.  Ensemble Methods: Foundations and Algorithms , 2012 .

[13]  Bruce L. Golden,et al.  Capacitated arc routing problems , 1981, Networks.

[14]  Jürgen Branke,et al.  On Using Surrogates with Genetic Programming , 2015, Evolutionary Computation.

[15]  Gilbert Laporte,et al.  A Tabu Search Heuristic for the Capacitated Arc Routing Problem , 2000, Oper. Res..

[16]  Zili Zhang,et al.  Automated heuristic design using genetic programming hyper-heuristic for uncertain capacitated arc routing problem , 2017, GECCO.

[17]  Xin Yao,et al.  A memetic algorithm for uncertain Capacitated Arc Routing Problems , 2013, 2013 IEEE Workshop on Memetic Computing (MC).

[18]  Yi Mei,et al.  An Improved Genetic Programming Hyper-Heuristic for the Uncertain Capacitated Arc Routing Problem , 2018, Australasian Conference on Artificial Intelligence.

[19]  Xin Yao,et al.  Decomposition-Based Memetic Algorithm for Multiobjective Capacitated Arc Routing Problem , 2011, IEEE Transactions on Evolutionary Computation.

[20]  Mahesh Pal,et al.  Random forest classifier for remote sensing classification , 2005 .

[21]  Lei Xi,et al.  Rough set and ensemble learning based semi-supervised algorithm for text classification , 2011, Expert Syst. Appl..

[22]  Mengjie Zhang,et al.  Evolving heuristics for Dynamic Vehicle Routing with Time Windows using genetic programming , 2017, 2017 IEEE Congress on Evolutionary Computation (CEC).

[23]  Richard W. Eglese,et al.  A tabu search based heuristic for arc routing with a capacity constraint and time deadline , 1996 .

[24]  Xin Yao,et al.  Dynamic salting route optimisation using evolutionary computation , 2005, 2005 IEEE Congress on Evolutionary Computation.

[25]  Richard F. Hartl,et al.  A survey on dynamic and stochastic vehicle routing problems , 2016 .

[26]  S K Amponsah,et al.  The investigation of a class of capacitated arc routing problems: the collection of garbage in developing countries. , 2004, Waste management.

[27]  Xin Yao,et al.  A Global Repair Operator for Capacitated Arc Routing Problem , 2009, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[28]  Grant Dick,et al.  Evolving bagging ensembles using a spatially-structured niching method , 2018, GECCO.

[29]  Domagoj Jakobovic,et al.  Comparison of ensemble learning methods for creating ensembles of dispatching rules for the unrelated machines environment , 2018, Genetic Programming and Evolvable Machines.

[30]  Xin Yao,et al.  Estimation of the Distribution Algorithm With a Stochastic Local Search for Uncertain Capacitated Arc Routing Problems , 2016, IEEE Transactions on Evolutionary Computation.

[31]  Xin Yao,et al.  Memetic Algorithm With Extended Neighborhood Search for Capacitated Arc Routing Problems , 2009, IEEE Transactions on Evolutionary Computation.

[32]  Philippe Lacomme,et al.  A Genetic Algorithm for the Capacitated Arc Routing Problem and Its Extensions , 2001, EvoWorkshops.

[33]  Xin Yao,et al.  Capacitated arc routing problem in uncertain environments , 2010, IEEE Congress on Evolutionary Computation.

[34]  M. Dror Arc Routing : Theory, Solutions and Applications , 2000 .

[35]  Alain Pétrowski,et al.  A clearing procedure as a niching method for genetic algorithms , 1996, Proceedings of IEEE International Conference on Evolutionary Computation.

[36]  Philippe Lacomme,et al.  First Competitive Ant Colony Scheme for the CARP , 2004, ANTS Workshop.