Optimization Algorithms for Calibrating Cropping Systems Simulation Models - A Case Study with Simplex-derived Methods Integrated in the WARM Simulation Environment

Calibration is the process of adjusting parameters values to obtain a good fit between model outputs and observations. The objective is to later apply the model to conditions similar to those characterizing the data used for the calibration. Even if calibration is a standard in model application, it is a high risk procedure. The purpose of calibration is to determine the values of unknown variables or parameters on the basis of their effects; the underlying risk of calibration is to degrading a mechanistic model to a totally empirical model very similar to a regression model, but without the statistical support to the conclusion drawing from the latter type of model. A reliable calibration process includes four steps. Step 1 is to define a criterion to evaluate the performance of a model in terms of an objective function; step 2 is to select the variables (or parameters) that will be calibrated; step 3 is to select an appropriate algorithm for minimisation (or maximisation) of the objective function; step 4 is the test of calibration results against new data sets. This paper focuses on step 3, and in particular on discussing, testing, and comparing two optimization algorithms derived from the simplex method: a bounded version of the Downhill Simplex (BS) and a modified version of the Evolutionary Shuffled Simplex (ESS). The two algorithms, selected because they do not use derivatives (crop models are strongly not-linear), were tested using two standard benchmark functions for optimization methods: the Rosenbrock and the Rastrigin functions. Results show that, even if BS requires few model evaluations, in some cases it is not able to find a global minimum in a multidimensional complex hyperspace. In this case, a more performing algorithm (such as ESS) should be used. The two algorithms have been introduced in the WARM simulation environment, allowing WARM to run automatic calibrations using both methods. Some results are presented.

[1]  R. Steele,et al.  Optimization , 2005, Encyclopedia of Biometrics.

[2]  Aimo A. Törn,et al.  Global Optimization , 1999, Science.

[3]  Confalonieri Roberto,et al.  Comparison of WOFOST, CropSyst and WARM for Simulating Rice Growth (Japonica Type - Short Cycle Varieties) , 2006 .

[4]  C. D. Gelatt,et al.  Optimization by Simulated Annealing , 1983, Science.

[5]  H. H. Rosenbrock,et al.  An Automatic Method for Finding the Greatest or Least Value of a Function , 1960, Comput. J..

[6]  Luis Orlindo Tedeschi,et al.  Assessment of the adequacy of mathematical models , 2006 .

[7]  Marco Dorigo,et al.  Optimization, Learning and Natural Algorithms , 1992 .

[8]  G. Bellocchi,et al.  A review of methodologies to evaluate agroecosystems simulation models , 1999 .

[9]  Joab R Winkler,et al.  Numerical recipes in C: The art of scientific computing, second edition , 1993 .

[10]  Fred W. Glover,et al.  Future paths for integer programming and links to artificial intelligence , 1986, Comput. Oper. Res..

[11]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[12]  K. Loague,et al.  Statistical and graphical methods for evaluating solute transport models: Overview and application , 1991 .

[13]  Leif T. Jensen,et al.  A comparison of the performance of nine soil organic matter models using datasets from seven long-term experiments , 1997 .

[14]  John A. Nelder,et al.  A Simplex Method for Function Minimization , 1965, Comput. J..

[15]  Gianni Bellocchi,et al.  An indicator of solar radiation model performance based on a fuzzy expert system , 2002 .

[16]  Vladimír Kvasnička,et al.  A hybrid of simplex method and simulated annealing , 1997 .

[17]  M. B. Beck,et al.  Water quality modeling: A review of the analysis of uncertainty , 1987 .

[18]  T. Gan,et al.  Automatic Calibration of Conceptual Rainfall-Runoff Models: Optimization Algorithms, Catchment Conditions, and Model Structure , 1996 .

[19]  Jonathan S. Lindsey,et al.  A parallel simplex search method for use with an automated chemistry workstation , 2002 .

[20]  Stefano Bocchi,et al.  The CropSyst Model to Simulate the N Balance of Rice for Alternative Management , 2006 .

[21]  Larry Brazil,et al.  Multilevel calibration strategy for complex hydrologic simulation models , 1988 .

[22]  Philippe Debaeke,et al.  Agronomy for Sustainable Development , 2008 .

[23]  Daniela Stroppiana,et al.  WARM: A SCIENTIFIC GROUP ON RICE MODELLING , 2005 .