Towards Interpretable Routing Policy: A Two Stage Multi-Objective Genetic Programming Approach with Feature Selection for Uncertain Capacitated Arc Routing Problem

The Uncertain Capacitated Arc Routing Problem (UCARP) is the dynamic and stochastic counterpart of the well-known Capacitated Arc Routing Problem (CARP). UCARP has a wide range of real-world applications. One of the main challenge in UCARP is to handle the uncertain environment effectively. Routing policy-based approaches are promising technique for solving UCARP as they can respond to the uncertain environment in the real time. However, manually designing effective routing policies is time consuming and heavily replies on domain knowledge. Genetic Programming Hyper-heuristic (GPHH) has been successfully applied to UCARP to automatically evolve effective routing policies. However, the evolved routing policies are usually hard to interpret. In this paper, we aim to improve the potential interpretability of the GP-evolved routing policies by considering both program size and number of distinguished features. To this end, we propose a Two Stage Multi-Objective Genetic Programming Hyper Heuristic approach with Feature Selection (TSFSMOGP). We compared TSFSMOGP with the state-of-the-art single-objective GPHH, a two-stage GPHH with feature selection and a two-stage Multi-Objective GP. The experimental results showed that TSFSMOGP can evolve effective, compact, and thus potentially interpretable routing policies.

[1]  Alain Pétrowski,et al.  A clearing procedure as a niching method for genetic algorithms , 1996, Proceedings of IEEE International Conference on Evolutionary Computation.

[2]  Yi Mei,et al.  Evolving Ensembles of Routing Policies using Genetic Programming for Uncertain Capacitated Arc Routing Problem , 2019, 2019 IEEE Symposium Series on Computational Intelligence (SSCI).

[3]  Xin Yao,et al.  Estimation of the Distribution Algorithm With a Stochastic Local Search for Uncertain Capacitated Arc Routing Problems , 2016, IEEE Transactions on Evolutionary Computation.

[4]  Xin Yao,et al.  Memetic Algorithm With Extended Neighborhood Search for Capacitated Arc Routing Problems , 2009, IEEE Transactions on Evolutionary Computation.

[5]  Yi Mei,et al.  A Novel Genetic Programming Algorithm with Knowledge Transfer for Uncertain Capacitated Arc Routing Problem , 2019, PRICAI.

[6]  Philippe Lacomme,et al.  A Genetic Algorithm for the Capacitated Arc Routing Problem and Its Extensions , 2001, EvoWorkshops.

[7]  Emily Chen,et al.  How do Humans Understand Explanations from Machine Learning Systems? An Evaluation of the Human-Interpretability of Explanation , 2018, ArXiv.

[8]  Zili Zhang,et al.  A Predictive-Reactive Approach with Genetic Programming and Cooperative Coevolution for the Uncertain Capacitated Arc Routing Problem , 2020, Evolutionary Computation.

[9]  Daniel G. Goldstein,et al.  Manipulating and Measuring Model Interpretability , 2018, CHI.

[10]  Yi Mei,et al.  Feature Selection in Evolving Job Shop Dispatching Rules with Genetic Programming , 2016, GECCO.

[11]  Richard F. Hartl,et al.  A survey on dynamic and stochastic vehicle routing problems , 2016 .

[12]  Yi Mei,et al.  Genetic programming hyper-heuristic for multi-vehicle uncertain capacitated arc routing problem , 2018, GECCO.

[13]  S K Amponsah,et al.  The investigation of a class of capacitated arc routing problems: the collection of garbage in developing countries. , 2004, Waste management.

[14]  Xin Yao,et al.  Capacitated arc routing problem in uncertain environments , 2010, IEEE Congress on Evolutionary Computation.

[15]  Yi Mei,et al.  A Two-Stage Genetic Programming Hyper-Heuristic for Uncertain Capacitated Arc Routing Problem , 2019, 2019 IEEE Symposium Series on Computational Intelligence (SSCI).

[16]  Yi Mei,et al.  A two-stage genetic programming hyper-heuristic approach with feature selection for dynamic flexible job shop scheduling , 2019, GECCO.

[17]  Xin Yao,et al.  A memetic algorithm for uncertain Capacitated Arc Routing Problems , 2013, 2013 IEEE Workshop on Memetic Computing (MC).

[18]  Philippe Lacomme,et al.  First Competitive Ant Colony Scheme for the CARP , 2004, ANTS Workshop.

[19]  Philippe Lacomme,et al.  Competitive Memetic Algorithms for Arc Routing Problems , 2004, Ann. Oper. Res..

[20]  Francisco Herrera,et al.  Explainable Artificial Intelligence (XAI): Concepts, Taxonomies, Opportunities and Challenges toward Responsible AI , 2020, Inf. Fusion.

[21]  Yi Mei,et al.  An Improved Genetic Programming Hyper-Heuristic for the Uncertain Capacitated Arc Routing Problem , 2018, Australasian Conference on Artificial Intelligence.

[22]  Gilbert Laporte,et al.  A Tabu Search Heuristic for the Capacitated Arc Routing Problem , 2000, Oper. Res..

[23]  Xin Yao,et al.  A Survey on Evolutionary Computation Approaches to Feature Selection , 2016, IEEE Transactions on Evolutionary Computation.

[24]  Zili Zhang,et al.  Automated heuristic design using genetic programming hyper-heuristic for uncertain capacitated arc routing problem , 2017, GECCO.

[25]  Yi Mei,et al.  Novel ensemble genetic programming hyper-heuristics for uncertain capacitated arc routing problem , 2019, GECCO.

[26]  Mengjie Zhang,et al.  Meta-learning and feature ranking using genetic programming for classification: Variable terminal weighting , 2011, 2011 IEEE Congress of Evolutionary Computation (CEC).

[27]  Bruce L. Golden,et al.  Capacitated arc routing problems , 1981, Networks.

[28]  H. Handa,et al.  Robust route optimization for gritting/salting trucks: a CERCIA experience , 2006, IEEE Computational Intelligence Magazine.

[29]  Kazuo Miyashita,et al.  Improving Performance of GP by Adaptive Terminal Selection , 2000, PRICAI.

[30]  Philippe Lacomme,et al.  Evolutionary Algorithms for Stochastic Arc Routing Problems , 2004, EvoWorkshops.

[31]  M. Dror Arc Routing : Theory, Solutions and Applications , 2000 .

[32]  Richard F. Hartl,et al.  Applying Ant Colony Optimization to the Capacitated Arc Routing Problem , 2004, ANTS Workshop.

[33]  Mengjie Zhang,et al.  Evolving heuristics for Dynamic Vehicle Routing with Time Windows using genetic programming , 2017, 2017 IEEE Congress on Evolutionary Computation (CEC).

[34]  Xin Yao,et al.  Dynamic salting route optimisation using evolutionary computation , 2005, 2005 IEEE Congress on Evolutionary Computation.

[35]  Alper Kursat Uysal,et al.  An improved global feature selection scheme for text classification , 2016, Expert Syst. Appl..

[36]  Yi Mei,et al.  Evolving Scheduling Heuristics via Genetic Programming With Feature Selection in Dynamic Flexible Job-Shop Scheduling , 2020, IEEE Transactions on Cybernetics.

[37]  Mengjie Zhang,et al.  Particle swarm optimisation representations for simultaneous clustering and feature selection , 2016, 2016 IEEE Symposium Series on Computational Intelligence (SSCI).

[38]  Yi Mei,et al.  Genetic programming hyper-heuristic with knowledge transfer for uncertain capacitated arc routing problem , 2019, GECCO.

[39]  Xin Yao,et al.  Decomposition-Based Memetic Algorithm for Multiobjective Capacitated Arc Routing Problem , 2011, IEEE Transactions on Evolutionary Computation.

[40]  Mengjie Zhang,et al.  Feature Selection to Improve Generalization of Genetic Programming for High-Dimensional Symbolic Regression , 2017, IEEE Transactions on Evolutionary Computation.

[41]  Bernd Scholz-Reiter,et al.  Towards improved dispatching rules for complex shop floor scenarios: a genetic programming approach , 2010, GECCO '10.

[42]  Ke Tang,et al.  A developmental solution to (dynamic) capacitated arc routing problems using genetic programming , 2012, GECCO '12.

[43]  Sanne Wøhlk A Decade of Capacitated Arc Routing , 2008 .