A multilevel block building algorithm for fast modeling generalized separable systems

Data-driven modeling plays an increasingly important role in different areas of engineering. For most of existing methods, such as genetic programming (GP), the convergence speed might be too slow for large scale problems with a large number of variables. It has become the bottleneck of GP for practical applications. Fortunately, in many applications, the target models are separable in some sense. In this paper, we analyze different types of separability of some real-world engineering equations and establish a mathematical model of generalized separable system (GS system). In order to get the structure of the GS system, a multilevel block building (MBB) algorithm is proposed, in which the target model is decomposed into a number of blocks, further into minimal blocks and factors. Compare to the conventional GP, MBB can make large reductions to the search space. This makes MBB capable of modeling a complex system. The minimal blocks and factors are optimized and assembled with a global optimization search engine, low dimensional simplex evolution (LDSE). An extensive study between the proposed MBB and a state-of-the-art data-driven fitting tool, Eureqa, has been presented with several man-made problems, as well as some real-world problems. Test results indicate that the proposed method is more effective and efficient under all the investigated cases.

[1]  Chee Kiong Soh,et al.  Force identification of dynamic systems using genetic programming , 2005 .

[2]  Bo Yu,et al.  Low dimensional simplex evolution: a new heuristic for global optimization , 2011, Journal of Global Optimization.

[3]  Shaoliang Zhang,et al.  Adaptive space transformation: An invariant based method for predicting aerodynamic coefficients of hypersonic vehicles , 2015, Eng. Appl. Artif. Intell..

[4]  Randall K. McRee,et al.  Symbolic regression using nearest neighbor indexing , 2010, GECCO '10.

[5]  Chen Chen,et al.  A divide and conquer method for symbolic regression , 2017, ArXiv.

[6]  Chen Chen,et al.  Block building programming for symbolic regression , 2017, Neurocomputing.

[7]  Zhiyong Li,et al.  A data-driven adaptive Reynolds-averaged Navier-Stokes k-ω model for turbulent flow , 2017, J. Comput. Phys..

[8]  Vahid Nourani,et al.  A Pareto-optimal moving average-multigene genetic programming model for rainfall-runoff modelling , 2017, Environ. Model. Softw..

[9]  Trent McConaghy,et al.  FFX: Fast, Scalable, Deterministic Symbolic Regression Technology , 2011 .

[10]  Mark Johnston,et al.  Using Numerical Simplification to Control Bloat in Genetic Programming , 2008, SEAL.

[11]  Tommy W. S. Chow,et al.  Clone selection programming and its application to symbolic regression , 2009, Expert Syst. Appl..

[12]  Andy J. Keane,et al.  Engineering Design via Surrogate Modelling - A Practical Guide , 2008 .

[13]  Miran Brezocnik,et al.  Application of genetic programming for modelling of material characteristics , 2011, Expert Syst. Appl..

[14]  Z. L. Li,et al.  Structural damage identification based on Bayesian theory and improved immune genetic algorithm , 2012, Expert Syst. Appl..

[15]  Mohammad Hossein Zarifia,et al.  Analysis of evolutionary techniques for the automated implementation of digital circuits , 2015, Expert Syst. Appl..

[16]  Anthony Worm,et al.  Prioritized Grammar Enumeration: A novel method for symbolic regression , 2016 .

[17]  Mohammad Shokouhifar,et al.  An evolutionary-based methodology for symbolic simplification of analog circuits using genetic algorithm and simulated annealing , 2015, Expert Syst. Appl..

[18]  Dervis Karaboga,et al.  Artificial bee colony programming for symbolic regression , 2012, Inf. Sci..

[19]  J. Anderson,et al.  Hypersonic and High-Temperature Gas Dynamics , 2019 .

[20]  Chen Chen,et al.  Fast Modeling Methods for Complex System with Separable Features , 2017, 2017 10th International Symposium on Computational Intelligence and Design (ISCID).

[21]  Dennis K. J. Lin,et al.  A construction method for orthogonal Latin hypercube designs , 2006 .

[22]  Ramana V. Grandhi,et al.  Improved Distributed Hypercube Sampling , 2002 .

[23]  K WONG,et al.  Automatic identification of weather systems from numerical weather prediction data using genetic algorithm , 2008, Expert Syst. Appl..

[24]  Oddvar O. Bendiksen,et al.  Structures, Structural Dynamics and Materials Conference , 1998 .

[25]  M. O'Neill,et al.  Grammatical evolution , 2001, GECCO '09.

[26]  John R. Koza,et al.  Genetic programming - on the programming of computers by means of natural selection , 1993, Complex adaptive systems.

[27]  Mark Johnston,et al.  How online simplification affects building blocks in genetic programming , 2009, GECCO.

[28]  Vladimir Ceperic,et al.  A symbolic regression-based modelling strategy of AC/DC rectifiers for RFID applications , 2014, Expert Syst. Appl..

[29]  Jiri Blazek,et al.  Computational Fluid Dynamics: Principles and Applications , 2001 .

[30]  Shaoliang Zhang,et al.  Parse-matrix evolution for symbolic regression , 2012, Eng. Appl. Artif. Intell..

[31]  Ivan Volaric,et al.  A data driven compressive sensing approach for time-frequency signal enhancement , 2017, Signal Process..

[32]  J. Anderson,et al.  Fundamentals of Aerodynamics , 1984 .