Universal Learning Machine with Genetic Programming

This paper presents a proof of concept. It shows that Genetic Programming (GP) can be used as a “universal” machine learning method, that integrates several different algorithms, improving their accuracy. The system we propose, called Universal Genetic Programming (UGP) works by defining an initial population of programs, that contains the models produced by several different machine learning algorithms. The use of elitism allows UGP to return as a final solution the best initial model, in case it is not able to evolve a better one. The use of genetic operators driven by semantic awareness is likely to improve the initial models, by combining and mutating them. On three complex real-life problems, we present experimental evidence that UGP is actually able to improve the models produced by all the studied machine learning algorithms in isolation.

[1]  Leonardo Vanneschi,et al.  A survey of semantic methods in genetic programming , 2014, Genetic Programming and Evolvable Machines.

[2]  John R. Koza,et al.  Genetic programming - on the programming of computers by means of natural selection , 1993, Complex adaptive systems.

[3]  Leonardo Vanneschi,et al.  Geometric Semantic Genetic Programming for Real Life Applications , 2013, GPTP.

[4]  Jason H. Moore,et al.  Investigating the parameter space of evolutionary algorithms , 2017, BioData Mining.

[5]  David H. Wolpert,et al.  No free lunch theorems for optimization , 1997, IEEE Trans. Evol. Comput..

[6]  Leonardo Vanneschi,et al.  A New Implementation of Geometric Semantic GP and Its Application to Problems in Pharmacokinetics , 2013, EuroGP.

[7]  Leonardo Vanneschi,et al.  Prediction of the Unified Parkinson's Disease Rating Scale assessment using a genetic programming system with geometric semantic genetic operators , 2014, Expert Syst. Appl..

[8]  Leonardo Vanneschi,et al.  Prediction of high performance concrete strength using Genetic Programming with geometric semantic genetic operators , 2013, Expert Syst. Appl..

[9]  Krzysztof Krawiec,et al.  Geometric Semantic Genetic Programming , 2012, PPSN.

[10]  Leonardo Vanneschi,et al.  Prediction of energy performance of residential buildings: a genetic programming approach , 2015 .

[11]  Leonardo Vanneschi,et al.  A C++ framework for geometric semantic genetic programming , 2014, Genetic Programming and Evolvable Machines.

[12]  Vincenzo Cutello,et al.  Parallel Problem Solving from Nature - PPSN XII , 2012, Lecture Notes in Computer Science.

[13]  Leonardo Vanneschi,et al.  How to Exploit Alignment in the Error Space: Two Different GP Models , 2014, GPTP.