Improving the prediction of material properties of concrete using Kaizen Programming with Simulated Annealing

Abstract Predicting the properties of materials like concrete has been proven a difficult task given the complex interactions among its components. Over the years, researchers have used Statistics, Machine Learning, and Evolutionary Computation to build models in an attempt to accurately predict such properties. High-quality models are often non-linear, justifying the study of nonlinear regression tools. In this paper, we employ a traditional multiple linear regression method by ordinary least squares to solve the task. However, the model is built upon nonlinear features automatically engineered by Kaizen Programming, a recently proposed hybrid method. Experimental results show that Kaizen Programming can find low-correlated features in an acceptable computational time. Such features build high-quality models with better predictive quality than results reported in the literature.

[1]  Simon Haykin,et al.  Neural Networks: A Comprehensive Foundation , 1998 .

[2]  I-Cheng Yeh,et al.  Modeling slump flow of concrete using second-order regressions and artificial neural networks , 2007 .

[3]  Krzysztof Krawiec,et al.  Multiple regression genetic programming , 2014, GECCO.

[4]  I-Cheng Yeh,et al.  Knowledge discovery of concrete material using Genetic Operation Trees , 2009, Expert Syst. Appl..

[5]  Peter Nordin,et al.  Genetic programming - An Introduction: On the Automatic Evolution of Computer Programs and Its Applications , 1998 .

[6]  Amir Lakizadeh,et al.  Effect of mixture temperature on slump flow prediction of conventional concretes using artificial neural networks , 2012 .

[7]  DeLiang Wang,et al.  Special issue on advanced theory and methodology in intelligent computing: Selected papers from the Seventh International Conference on Intelligent Computing (ICIC 2011) , 2013, Neurocomputing.

[8]  Erwin Stinstra,et al.  Metamodeling by symbolic regression and Pareto simulated annealing , 2008 .

[9]  Xu Tan,et al.  Discovery scientific laws by hybrid evolutionary model , 2015, Neurocomputing.

[10]  Marti A. Hearst Trends & Controversies: Support Vector Machines , 1998, IEEE Intell. Syst..

[11]  Ravindra Nagar,et al.  Modeling slump of ready mix concrete using genetic algorithms assisted training of Artificial Neural Networks , 2015, Expert Syst. Appl..

[12]  Vinicius Veloso de Melo,et al.  Kaizen programming , 2014, GECCO.

[13]  Mihai Oltean,et al.  Genetic Programming with Linear Representation: a Survey , 2009, Int. J. Artif. Intell. Tools.

[14]  M. Stone An Asymptotic Equivalence of Choice of Model by Cross‐Validation and Akaike's Criterion , 1977 .

[15]  R. Tibshirani,et al.  Least angle regression , 2004, math/0406456.

[16]  Jui-Sheng Chou,et al.  Enhanced artificial intelligence for ensemble approach to predicting high performance concrete compressive strength , 2013 .

[17]  Dominic P. Searson GPTIPS 2: An Open-Source Software Platform for Symbolic Data Mining , 2014, Handbook of Genetic Programming Applications.

[18]  Josh C. Bongard,et al.  Improving genetic programming based symbolic regression using deterministic machine learning , 2013, 2013 IEEE Congress on Evolutionary Computation.

[19]  Li Chen,et al.  Modeling Strength of High-Performance Concrete Using an Improved Grammatical Evolution Combined with Macrogenetic Algorithm , 2010, J. Comput. Civ. Eng..

[20]  Jui-Sheng Chou,et al.  Concrete compressive strength analysis using a combined classification and regression technique , 2012 .

[21]  Adil Baykasoglu,et al.  Prediction and multi-objective optimization of high-strength concrete parameters via soft computing approaches , 2009, Expert Syst. Appl..

[22]  Leonardo Vanneschi,et al.  Prediction of high performance concrete strength using Genetic Programming with geometric semantic genetic operators , 2013, Expert Syst. Appl..

[23]  Amir Hossein Gandomi,et al.  A new predictive model for compressive strength of HPC using gene expression programming , 2012, Adv. Eng. Softw..

[24]  Wolfgang Banzhaf,et al.  Genetic Programming for Pedestrians , 1993, ICGA.

[25]  Lee Spector,et al.  Genetic Programming with Epigenetic Local Search , 2015, GECCO.

[26]  Hsing-Chih Tsai,et al.  Predicting high-strength concrete parameters using weighted genetic programming , 2011, Engineering with Computers.

[27]  Chang-an Yuan,et al.  An improved Gene Expression Programming approach for symbolic regression problems , 2014, Neurocomputing.

[28]  Hong-Guang Ni,et al.  Prediction of compressive strength of concrete by neural networks , 2000 .

[29]  Vinicius Veloso de Melo,et al.  Breast cancer detection with logistic regression improved by features constructed by Kaizen programming in a hybrid approach , 2016, 2016 IEEE Congress on Evolutionary Computation (CEC).

[30]  Timothy Perkis,et al.  Stack-based genetic programming , 1994, Proceedings of the First IEEE Conference on Evolutionary Computation. IEEE World Congress on Computational Intelligence.

[31]  Min-Yuan Cheng,et al.  High-performance concrete compressive strength prediction using Genetic Weighted Pyramid Operation Tree (GWPOT) , 2014, Eng. Appl. Artif. Intell..

[32]  José Luis Gordillo,et al.  Synthesis of odor tracking algorithms with genetic programming , 2016, Neurocomputing.

[33]  Masaaki Imai,et al.  Kaizen (Ky'zen) : the key to Japan's competitive success / Masaaki Imai , 1986 .

[34]  C. D. Gelatt,et al.  Optimization by Simulated Annealing , 1983, Science.

[35]  M. A. Bhatti,et al.  Predicting the compressive strength and slump of high strength concrete using neural network , 2006 .

[36]  Leonardo Vanneschi,et al.  Geometric Semantic Genetic Programming with Local Search , 2015, GECCO.

[37]  Lee Spector,et al.  Autoconstructive Evolution: Push, PushGP, and Pushpop , 2001 .

[38]  Vinicius Veloso de Melo,et al.  Predicting High-Performance Concrete Compressive Strength Using Features Constructed by Kaizen Programming , 2015, 2015 Brazilian Conference on Intelligent Systems (BRACIS).

[39]  John R. Koza,et al.  Genetic programming - on the programming of computers by means of natural selection , 1993, Complex adaptive systems.

[40]  Ian H. Witten,et al.  The WEKA data mining software: an update , 2009, SKDD.

[41]  Markus Brameier,et al.  On linear genetic programming , 2005 .

[42]  R. Tibshirani Regression Shrinkage and Selection via the Lasso , 1996 .

[43]  Li Chen,et al.  Prediction of slump flow of high-performance concrete via parallel hyper-cubic gene-expression programming , 2014, Eng. Appl. Artif. Intell..

[44]  H. Bozdogan Model selection and Akaike's Information Criterion (AIC): The general theory and its analytical extensions , 1987 .

[45]  Gerard B. M. Heuvelink,et al.  About regression-kriging: From equations to case studies , 2007, Comput. Geosci..

[46]  Norman P. Bresky,et al.  Tools and Methods for the Improvement of Quality , 1990 .

[47]  I-Cheng Yeh,et al.  Modeling of strength of high-performance concrete using artificial neural networks , 1998 .

[48]  Michael D. Schmidt,et al.  Symbolic Regression of Implicit Equations , 2010 .

[49]  Trent McConaghy,et al.  FFX: Fast, Scalable, Deterministic Symbolic Regression Technology , 2011 .

[50]  S. Bhanja,et al.  Investigations on the compressive strength of silica fume concrete using statistical methods , 2002 .

[51]  İlker Bekir Topçu,et al.  Prediction of compressive strength of concrete containing fly ash using artificial neural networks and fuzzy logic , 2008 .