Towards improved calibration of crop models – Where are we now and where should we go?

Abstract Crop simulation models are increasingly used in agricultural decision making. Calibration is a demanding and critical step in developing and applying a model. Despite its importance little attention has been paid to documenting and analysing current calibration practices. This study reports the results from 211 responses to a web-based survey of calibration practices. The survey questions covered multiple choices that are required when doing a calibration exercise. Concerning data, most respondents used field data, but regional data and a combination of field and regional data were also used. Almost all respondents used multiple data types, the most common being phenology and yield data. The median number of estimated parameters was 6, and often this number was only slightly smaller than the number of environments that provided the data. Most respondents fit the data in multiple stages, starting in most cases with phenology data. Many respondents searched for parameter values that minimized a sum of squared errors, but substantial groups used an ad hoc measure of goodness-of-fit, the GLUE method, a weighted least squares method or a Bayesian approach. Nearly half the respondents simply used trial-and-error to search for the best-fit parameters. The other respondents were split more or less equally between those who used existing software and those who wrote new software. Slightly less than half the respondents obtained information on parameter uncertainty. Model evaluation was based on goodness-of-fit or data splitting or cross validation. The median time devoted to crop model calibration was 25 days. Based on these results, a list of topics that should be covered in guidelines for calibration is suggested.

[1]  James W. Jones,et al.  The Agricultural Model Intercomparison and Improvement Project (AgMIP): Protocols and Pilot Studies , 2013 .

[2]  D. Reicosky,et al.  Row Spacing Effects on Light Extinction Coefficients of Corn, Sorghum, Soybean, and Sunflower , 1996 .

[3]  M. Trnka,et al.  Simulation of winter wheat yield and its variability in different climates of Europe: A comparison of eight crop growth models , 2011 .

[4]  James W. Jones,et al.  How do various maize crop models vary in their responses to climate change factors? , 2014, Global change biology.

[5]  Liwang Ma,et al.  Methods of Introducing System Models into Agricultural Research , 2011 .

[6]  C. F. Drury,et al.  Simulation of long-term spring wheat yields, soil organic C, N and water dynamics using DSSAT-CSM in a semi-arid region of the Canadian prairies , 2015, Nutrient Cycling in Agroecosystems.

[7]  Frank Ewert,et al.  Crop modelling for integrated assessment of risk to food production from climate change , 2015, Environ. Model. Softw..

[8]  Daniel Wallach,et al.  Crop Model Calibration: A Statistical Perspective , 2011 .

[9]  B. Efron Estimating the Error Rate of a Prediction Rule: Improvement on Cross-Validation , 1983 .

[10]  James W. Jones,et al.  Influence of likelihood function choice for estimating crop model parameters using the generalized likelihood uncertainty estimation method , 2010 .

[11]  T. Palosuo,et al.  Use of crop simulation modelling to aid ideotype design of future cereal cultivars. , 2015, Journal of experimental botany.

[12]  James W. Jones,et al.  Working with Dynamic Crop Models , 2014 .

[13]  James W. Jones,et al.  Estimating model prediction error: Should you treat predictions as fixed or random? , 2016, Environ. Model. Softw..

[14]  F. Ewert,et al.  The effects of climatic variation in Europe on the yield response of spring wheat cv. Minaret to elevated CO2 and O3: an analysis of open-top chamber experiments by means of two crop growth simulation models , 1999 .

[15]  Warren E. Walker,et al.  Defining Uncertainty: A Conceptual Basis for Uncertainty Management in Model-Based Decision Support , 2003 .

[16]  Claudio O. Stöckle,et al.  Effects of climate change and elevated CO2 on cropping systems: model predictions at two Italian locations , 2000 .

[17]  Paolo Alberti,et al.  Uncertainty in crop model predictions: What is the role of users? , 2016, Environ. Model. Softw..

[18]  R. Lock,et al.  Implication of crop model calibration strategies for assessing regional impacts of climate change in Europe , 2013 .

[19]  Reimund P. Rötter,et al.  Analysis and classification of data sets for calibration and validation of agro-ecosystem models , 2015, Environ. Model. Softw..

[20]  Eric Justes,et al.  Methodological comparison of calibration procedures for durum wheat parameters in the STICS model , 2011 .

[21]  B. De Baets,et al.  Toward a Reliable Evaluation of Forecasting Systems for Plant Diseases: A Case Study Using Fusarium Head Blight of Wheat. , 2012, Plant disease.

[22]  Naftali Lazarovitch,et al.  Modelling the impact of drought and heat stress on common bean with two different photosynthesis model approaches , 2016, Environ. Model. Softw..

[23]  Kurt Christian Kersebaum,et al.  Testing different CO 2 response algorithms against a face crop rotation experiment and application for climate change impact assessment at different sites in Germany , 2009 .

[24]  François Brun,et al.  Assessing the Uncertainty when Using a Model to Compare Irrigation Strategies , 2012 .

[25]  Daniel Wallach,et al.  Using a Bayesian approach to parameter estimation; comparison of the GLUE and MCMC methods , 2002 .

[26]  James W. Jones,et al.  Uncertainty in Simulating Wheat Yields Under Climate Change , 2013 .

[27]  James W. Jones,et al.  Predicting maize phenology: intercomparison of functions for developmental response to temperature , 2014 .

[28]  James W. Jones,et al.  Multimodel ensembles of wheat growth: many models are better than one , 2015, Global change biology.

[29]  Wenzhi Zeng,et al.  Testing the APSIM sunflower model on saline soils of Inner Mongolia, China , 2016 .

[30]  Ralf Wieland,et al.  Analysing the parameter sensitivity of the agro-ecosystem model MONICA for different crops , 2015 .

[31]  Elijah Phiri,et al.  Evaluating CERES-Maize Model Using Planting Dates and Nitrogen Fertilizer in Zambia , 2015 .

[32]  Andrew J. Challinor,et al.  Assessing uncertainty and complexity in regional-scale crop model simulations , 2017 .

[33]  J. Kuha AIC and BIC , 2004 .

[34]  Bryan Stanfill,et al.  Quantifying model-structure- and parameter-driven uncertainties in spring wheat phenology prediction with Bayesian analysis , 2017 .

[35]  Gerrit Hoogenboom,et al.  A Protocol for Parameterization and Calibration of RZWQM2 in Field Research , 2015 .

[36]  Daniel Wallach,et al.  Estimating uncertainty in crop model predictions: Current situation and future prospects , 2017 .