Multi-model cross-pollination in time

The predictive skill of complex models is rarely uniform in model-state space; in weather forecasting models, for example, the skill of the model can be greater in the regions of most interest to a particular operational agency than it is in “remote” regions of the globe. Given a collection of models, a multi-model forecast system using the cross-pollination in time approach can be generalized to take advantage of instances where some models produce forecasts with more information regarding specific components of the model-state than other models, systematically. This generalization is stated and then successfully demonstrated in a moderate (∼40) dimensional nonlinear dynamical system, suggested by Lorenz, using four imperfect models with similar global forecast skill. Applications to weather forecasting and in economic forecasting are discussed. Given that the relative importance of different phenomena in shaping the weather changes in latitude, changes in attitude among forecast centers in terms of the resources assigned to each phenomena are to be expected. The demonstration establishes that cross-pollinating elements of forecast trajectories enriches the collection of simulations upon which the forecast is built, and given the same collection of models can yield a new forecast system with significantly more skill than the original forecast system.

[1]  Renate Hagedorn,et al.  The rationale behind the success of multi-model ensembles in seasonal forecasting — I. Basic concept , 2005 .

[2]  Leonard A. Smith,et al.  Towards improving the framework for probabilistic forecast evaluation , 2015, Climatic Change.

[3]  Gregory S. Duane,et al.  Synchronicity from Synchronized Chaos , 2011, Entropy.

[4]  Bin Wang,et al.  Advance and prospectus of seasonal prediction: assessment of the APCC/CliPAS 14-model ensemble retrospective seasonal prediction (1980–2004) , 2009 .

[5]  Renate Hagedorn,et al.  Communicating the value of probabilistic forecasts with weather roulette , 2009 .

[6]  A. Raftery,et al.  Using Bayesian Model Averaging to Calibrate Forecast Ensembles , 2005 .

[7]  Renate Hagedorn,et al.  The rationale behind the success of multi-model ensembles in seasonal forecasting-II , 2005 .

[8]  mith,et al.  Evaluating Probabilistic Forecasts Using Information Theory , 2002 .

[9]  J. Bernardo Expected Information as Expected Utility , 1979 .

[10]  Wim Wiegerinck,et al.  A multi-model ensemble method that combines imperfect models through learning , 2010 .

[11]  Andrew P. Morse,et al.  DEVELOPMENT OF A EUROPEAN MULTIMODEL ENSEMBLE SYSTEM FOR SEASONAL-TO-INTERANNUAL PREDICTION (DEMETER) , 2004 .

[12]  Leonard A. Smith,et al.  On the Design and use of Ensembles of Multi-model Simulations for Forecasting , 2016, 1603.00393.

[13]  Leonard A. Smith,et al.  Probabilistic noise reduction , 2001 .

[14]  Leonard A. Smith Disentangling Uncertainty and Error: On the Predictability of Nonlinear Systems , 2001 .

[15]  Renate Hagedorn,et al.  The rationale behind the success of multi-model ensembles in seasonal forecasting — II. Calibration and combination , 2005 .

[16]  Wim Wiegerinck,et al.  Dynamically combining climate models to “supermodel” the tropical Pacific , 2016 .

[17]  Leonard A. Smith,et al.  Evaluating Probabilistic Forecasts Using Information Theory , 2002 .

[18]  Leonard A. Smith,et al.  From ensemble forecasts to predictive distribution functions , 2008 .

[19]  Daniel S. Wilks,et al.  Comparison of ensemble‐MOS methods in the Lorenz '96 setting , 2006 .

[20]  A. Whitehead,et al.  What might we learn from Climate Forecasts? , 2002 .

[21]  E. Lorenz Predictability of Weather and Climate: Predictability – a problem partly solved , 2006 .

[22]  Leonard A. Smith,et al.  Combining dynamical and statistical ensembles , 2003 .

[23]  Thomas M. Hamill,et al.  Comparison of Ensemble-MOS Methods Using GFS Reforecasts , 2007 .

[24]  Leonard A. Smith,et al.  Pseudo-Orbit Data Assimilation. Part I: The Perfect Model Scenario , 2014 .

[25]  Leonard A. Smith,et al.  Probabilistic skill in ensemble seasonal forecasts , 2015 .

[26]  W. Briggs Statistical Methods in the Atmospheric Sciences , 2007 .

[27]  Craig H. Bishop,et al.  Adaptive sampling with the ensemble transform Kalman filter , 2001 .

[28]  Balaji Rajagopalan,et al.  Categorical Climate Forecasts through Regularization and Optimal Combination of Multiple GCM Ensembles , 2002 .

[29]  Leonard A. Smith,et al.  Scoring Probabilistic Forecasts: The Importance of Being Proper , 2007 .

[30]  T. Palmer,et al.  ENSEMBLES: A new multi‐model ensemble for seasonal‐to‐annual predictions—Skill and progress beyond DEMETER in forecasting tropical Pacific SSTs , 2009 .

[31]  Leonard A. Smith,et al.  Indistinguishable states II. The imperfect model scenario , 2004 .

[32]  A. Barnston,et al.  The North American multimodel ensemble: Phase-1 seasonal-to-interannual prediction; phase-2 toward developing intraseasonal prediction , 2014 .

[33]  Francisco J. Doblas-Reyes,et al.  Forecast assimilation: a unified framework for the combination of multi-model weather and climate predictions , 2005 .

[34]  Leonard A. Smith,et al.  Pseudo-Orbit Data Assimilation. Part II: Assimilation with Imperfect Models , 2014 .