Improved modeling by coupling imperfect models

Abstract Most of the existing approaches for combining models representing a single real-world phenomenon into a multi-model ensemble combine the models a posteriori. Alternatively, in our method the models are coupled into a supermodel and continuously communicate during learning and prediction. The method learns a set of coupling coefficients from short past data in order to unite the different strengths of the models into a better representation of the observed phenomenon. The method is examined using the Lorenz oscillator, which is altered by introducing parameter and structural differences for creating imperfect models. The short past data is obtained by the standard oscillator, and different weight is assigned to each sample of the past data. The coupling coefficients are learned by using a quasi-Newton method and an evolutionary algorithm. We also introduce a way for reducing the supermodel, which is particularly useful for models of high complexity. The results reveal that the proposed supermodel gives a very good representation of the truth even for substantially imperfect models and short past data, which suggests that the super-modeling is promising in modeling real-world phenomena.

[1]  Adrian E. Raftery,et al.  Bayesian model averaging: a tutorial (with comments by M. Clyde, David Draper and E. I. George, and a rejoinder by the authors , 1999 .

[2]  Nikolaus Hansen,et al.  Completely Derandomized Self-Adaptation in Evolution Strategies , 2001, Evolutionary Computation.

[3]  Reto Knutti,et al.  Challenges in Combining Projections from Multiple Climate Models , 2010 .

[4]  Christopher K. Wikle,et al.  Atmospheric Modeling, Data Assimilation, and Predictability , 2005, Technometrics.

[5]  Wim Wiegerinck,et al.  A multi-model ensemble method that combines imperfect models through learning , 2010 .

[6]  Reto Knutti,et al.  The use of the multi-model ensemble in probabilistic climate projections , 2007, Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[7]  Lennart Ljung,et al.  System Identification: Theory for the User , 1987 .

[8]  Luis A. Aguirre,et al.  Modeling Nonlinear Dynamics and Chaos: A Review , 2009 .

[9]  J. Shukla,et al.  Interactive coupled ensemble: A new coupling strategy for CGCMs , 2002 .

[10]  E. Lorenz Deterministic nonperiodic flow , 1963 .

[11]  C. G. Broyden The Convergence of a Class of Double-rank Minimization Algorithms 1. General Considerations , 1970 .

[12]  J. Nocedal Updating Quasi-Newton Matrices With Limited Storage , 1980 .

[13]  Alex Simpkins,et al.  System Identification: Theory for the User, 2nd Edition (Ljung, L.; 1999) [On the Shelf] , 2012, IEEE Robotics & Automation Magazine.

[14]  Nikolaus Hansen,et al.  Evaluating the CMA Evolution Strategy on Multimodal Test Functions , 2004, PPSN.

[15]  Nicholas I. M. Gould,et al.  Numerical methods for large-scale nonlinear optimization , 2005, Acta Numerica.