A multi-level grammar approach to grammar-guided genetic programming: the case of scheduling in heterogeneous networks

The scale at which the human race consumes data has increased exponentially in recent years. One key part in this increase has been the usage of smart phones and connected devices by the populous. Multi-level heterogeneous networks are the driving force behind this mobile revolution, but these are constrained with limited bandwidth and over-subscription. Scheduling users on these networks has become a growing issue. In recent years grammar-guided genetic programming (G3P) has shown its capability to evolve beyond human-competitive network schedulers. Despite the performance of the G3P schedulers, a large margin of improvement is demonstrated to still exist. In the pursuit of this goal we recently proposed a multi-level grammar approach to generating schedulers. The complexity of the grammar was increased at various stages during evolution, allowing for individuals to add more complex functions through variation operations. The goal is to evolve good quality solutions before allowing the population to specialise more as the grammar functionality increased in a layered learning way. In this paper the results of this initial study are replicated, and confirmed, and it is seen that this approach improves the quality of the evolved schedulers. However, despite the gain in performance, we notice that the proposed approach comes with an acute sensitivity to the generation at which the grammar complexity is increased. Therefore, we put forward a novel seeding strategy and show that the seeding strategy mitigates the shortcomings of the original approach. The use of the seeding strategy outperforms the original approach in all the studied cases, and thus yields a better overall performance than the state-of-the-art G3P generated schedulers.

[1]  Nguyen Xuan Hoai,et al.  Developmental Evaluation in Genetic Programming: The Preliminary Results , 2006, EuroGP.

[2]  Holger Claussen,et al.  A Hierarchical Approach to Grammar-Guided Genetic Programming: The Case of Scheduling in Heterogeneous Networks , 2018, TPNC.

[3]  Michael O'Neill,et al.  PonyGE2: grammatical evolution in Python , 2017, GECCO.

[4]  Joao Marques-Silva,et al.  Exact and Hybrid Solutions for the Multi-Objective VM Reassignment Problem , 2017, Int. J. Artif. Intell. Tools.

[5]  Mengjie Zhang,et al.  Further investigation on genetic programming with transfer learning for symbolic regression , 2016, 2016 IEEE Congress on Evolutionary Computation (CEC).

[6]  Domagoj Jakobovic,et al.  Evolving priority scheduling heuristics with genetic programming , 2012, Appl. Soft Comput..

[7]  Tsuyoshi Murata,et al.  {m , 1934, ACML.

[8]  Xuan Hoai Nguyen,et al.  Learning in Stages: A Layered Learning Approach for Genetic Programming , 2012 .

[9]  Nguyen Xuan Hoai,et al.  Developmental evaluation in Genetic Programming: The TAG-based frame work , 2008, Int. J. Knowl. Based Intell. Eng. Syst..

[10]  A. Lozano,et al.  What Will 5 G Be ? , 2014 .

[11]  Supratim Deb,et al.  Algorithms for Enhanced Inter-Cell Interference Coordination (eICIC) in LTE HetNets , 2013, IEEE/ACM Transactions on Networking.

[12]  Holger Claussen,et al.  Evolutionary Learning of Scheduling Heuristics for Heterogeneous Wireless Communications Networks , 2016, GECCO.

[13]  P. Royston Approximating the Shapiro-Wilk W-test for non-normality , 1992 .

[14]  Anthony Ventresque,et al.  Is seeding a good strategy in multi-objective feature selection when feature models evolve? , 2017, Inf. Softw. Technol..

[15]  Gail M. Sullivan,et al.  Using Effect Size-or Why the P Value Is Not Enough. , 2012, Journal of graduate medical education.

[16]  David Jackson,et al.  Layered Learning in Boolean GP Problems , 2007, EuroGP.

[17]  Nguyen Xuan Hoai,et al.  Developmental Evaluation in Genetic Programming: A Position Paper , 2007, 2007 Frontiers in the Convergence of Bioscience and Information Technologies.

[18]  Holger Claussen,et al.  Evolving femtocell coverage optimization algorithms using genetic programming , 2009, 2009 IEEE 20th International Symposium on Personal, Indoor and Mobile Radio Communications.

[19]  Lei Jiang,et al.  Resource allocation for eICIC scheme in heterogeneous networks , 2012, 2012 IEEE 23rd International Symposium on Personal, Indoor and Mobile Radio Communications - (PIMRC).

[20]  Ali Allahverdi,et al.  The third comprehensive survey on scheduling problems with setup times/costs , 2015, Eur. J. Oper. Res..

[21]  Steven M. Gustafson,et al.  Layered Learning in Genetic Programming for a Cooperative Robot Soccer Problem , 2001, EuroGP.

[22]  Holger Claussen,et al.  Multi-level Grammar Genetic Programming for Scheduling in Heterogeneous Networks , 2018, EuroGP.

[23]  Oliver Stanze,et al.  Scheduling strategies for HetNets using eICIC , 2012, 2012 IEEE International Conference on Communications (ICC).

[24]  Joel Lehman,et al.  Enhancing Divergent Search through Extinction Events , 2015, GECCO.

[25]  Yi Mei,et al.  Genetic programming for production scheduling: a survey with a unified framework , 2017, Complex & Intelligent Systems.

[26]  Liam Murphy,et al.  VM reassignment in hybrid clouds for large decentralised companies: A multi-objective challenge , 2018, Future Gener. Comput. Syst..

[27]  Peter A. Whigham,et al.  Grammar-based Genetic Programming: a survey , 2010, Genetic Programming and Evolvable Machines.

[28]  Holger Claussen,et al.  Scheduling in Heterogeneous Networks Using Grammar-Based Genetic Programming , 2016, EuroGP.

[29]  Lionel C. Briand,et al.  A practical guide for using statistical tests to assess randomized algorithms in software engineering , 2011, 2011 33rd International Conference on Software Engineering (ICSE).

[30]  Nguyen Quang Uy,et al.  Transfer learning in genetic programming , 2015, 2015 IEEE Congress on Evolutionary Computation (CEC).

[31]  Holger Claussen,et al.  A comparison of grammatical genetic programming grammars for controlling femtocell network coverage , 2012, Genetic Programming and Evolvable Machines.

[32]  Holger Claussen,et al.  Duty cycles and load balancing in HetNets with eICIC almost blank subframes , 2013, 2013 IEEE 24th International Symposium on Personal, Indoor and Mobile Radio Communications (PIMRC Workshops).

[33]  C.E. Shannon,et al.  Communication in the Presence of Noise , 1949, Proceedings of the IRE.

[34]  Nguyen Xuan Hoai,et al.  A study on Genetic Programming with layered learning and incremental sampling , 2011, 2011 IEEE Congress of Evolutionary Computation (CEC).

[35]  Riccardo Poli,et al.  Developmental plasticity in linear genetic programming , 2009, GECCO.

[36]  John Murphy,et al.  Towards a Better Replica Management for Hadoop Distributed File System , 2018, 2018 IEEE International Congress on Big Data (BigData Congress).

[37]  Holger Claussen,et al.  Towards automation & augmentation of the design of schedulers for cellular communications networks , 2018, GECCO.

[38]  Bing Xue,et al.  Cross-Domain Reuse of Extracted Knowledge in Genetic Programming for Image Classification , 2017, IEEE Transactions on Evolutionary Computation.

[39]  Liam Murphy,et al.  GeNePi: A Multi-Objective Machine Reassignment Algorithm for Data Centres , 2014, Hybrid Metaheuristics.

[40]  Nguyen Xuan Hoai,et al.  Building on Success in Genetic Programming: Adaptive Variation and Developmental Evaluation , 2007, ISICA.

[41]  Holger Claussen,et al.  Deep learning through evolution: A hybrid approach to scheduling in a dynamic environment , 2017, 2017 International Joint Conference on Neural Networks (IJCNN).

[42]  Holger Claussen,et al.  Towards Automation and Augmentation of the Design of Schedulers for Cellular Communications Networks , 2018, Evolutionary Computation.

[43]  Michael O'Neill,et al.  A Hybrid Algorithm for Multi-Objective Test Case Selection , 2018, 2018 IEEE Congress on Evolutionary Computation (CEC).

[44]  Joao Marques-Silva,et al.  MILP for the Multi-objective VM Reassignment Problem , 2015, 2015 IEEE 27th International Conference on Tools with Artificial Intelligence (ICTAI).

[45]  Nguyen Xuan Hoai,et al.  On Synergistic Interactions Between Evolution, Development and Layered Learning , 2011, IEEE Transactions on Evolutionary Computation.

[46]  Panagiotis G. Ipeirotis,et al.  Introduction to the Special Issue on EC’12 , 2015, ACM Trans. Economics and Comput..

[47]  Mengjie Zhang,et al.  Automated Design of Production Scheduling Heuristics: A Review , 2016, IEEE Transactions on Evolutionary Computation.

[48]  Eitan Altman,et al.  Self organizing strategies for enhanced ICIC (eICIC) , 2014, 2014 12th International Symposium on Modeling and Optimization in Mobile, Ad Hoc, and Wireless Networks (WiOpt).

[49]  Holger Claussen,et al.  Multilayer Optimization of Heterogeneous Networks Using Grammatical Genetic Programming , 2017, IEEE Trans. Cybern..

[50]  Anthony Brabazon,et al.  Foundations in Grammatical Evolution for Dynamic Environments , 2009, Studies in Computational Intelligence.

[51]  Jeffrey G. Andrews,et al.  What Will 5G Be? , 2014, IEEE Journal on Selected Areas in Communications.

[52]  Jun Wang,et al.  Optimized time-domain resource partitioning for enhanced inter-cell interference coordination in heterogeneous networks , 2012, 2012 IEEE Wireless Communications and Networking Conference (WCNC).