DATA ASSIMILATION IN THE LOW NOISE, ACCURATE OBSERVATION REGIME WITH APPLICATION TO THE KUROSHIO CURRENT

On-line data assimilation techniques such as ensemble Kalman filters and particle filters tend to loose accu- racy dramatically when presented with an unlikely observation. Such an observation may be caused by an unusually large measurement error or reflect a rare fluctuation in the dynamics of the system. Over a long enough span of time it becomes likely that one or several of these events will occur. In some cases they are signatures of the most interesting features of the underlying system and their prediction becomes the primary focus of the data assimilation procedure. The Kuroshio current that runs along the eastern coast of Japan is an example of just such a system. It undergoes infrequent but dramatic changes of state between a small meander during which the current remains close to the coast of Japan, and a large meander during which the current bulges away from the coast. Because of the important role that the Kuroshio plays in distributing heat and salinity in the surrounding region, prediction of these transitions is of acute interest. Here we propose several data assimilation strategies capable of efficiently handling rare events such as the transitions of the Kuroshio current in situations where both the stochastic forcing on the system and the observational noise are small. In this regime, large deviation theory can be used to understand why standard filtering methods fail and guide the design of the more effective data assimilation techniques suggested here. These techniques are tested on the Kuroshio and shown to perform much better than standard filtering methods.

[1]  Jun S. Liu,et al.  Monte Carlo strategies in scientific computing , 2001 .

[2]  R. E. Kalman,et al.  A New Approach to Linear Filtering and Prediction Problems , 2002 .

[3]  Andrew M. Stuart,et al.  Evaluating Data Assimilation Algorithms , 2011, ArXiv.

[4]  Bo Qiu,et al.  Kuroshio Path Variations South of Japan: Bimodality as a Self-Sustained Internal Oscillation , 2000 .

[5]  N. Gordon,et al.  Novel approach to nonlinear/non-Gaussian Bayesian state estimation , 1993 .

[6]  Amir Dembo,et al.  Large Deviations Techniques and Applications , 1998 .

[7]  Shenn-Yu Chao,et al.  Bimodality of the Kuroshio , 1984 .

[8]  J. Lynch,et al.  A weak convergence approach to the theory of large deviations , 1997 .

[9]  S. Varadhan Large Deviations and Applications , 1984 .

[10]  Peter J. Bickel,et al.  Comparison of Ensemble Kalman Filters under Non-Gaussianity , 2010 .

[11]  Geir Evensen,et al.  The Ensemble Kalman Filter: theoretical formulation and practical implementation , 2003 .

[12]  G. Eyink,et al.  Accelerated Monte Carlo for Optimal Estimation of Time Series , 2005 .

[13]  M. Bardi,et al.  Optimal Control and Viscosity Solutions of Hamilton-Jacobi-Bellman Equations , 1997 .

[14]  D K Smith,et al.  Numerical Optimization , 2001, J. Oper. Res. Soc..

[15]  Andrew M. Stuart,et al.  A Bayesian approach to Lagrangian data assimilation , 2008 .

[16]  A. Chorin,et al.  Implicit sampling for particle filters , 2009, Proceedings of the National Academy of Sciences.

[17]  Ioannis Karatzas,et al.  Brownian Motion and Stochastic Calculus , 1987 .

[18]  W. Fleming,et al.  Controlled Markov processes and viscosity solutions , 1992 .

[19]  E. Vanden-Eijnden,et al.  Rare Event Simulation of Small Noise Diffusions , 2012 .

[20]  Robert N. Miller,et al.  Data assimilation into nonlinear stochastic models , 1999 .

[21]  Jonathan Weare,et al.  Particle filtering with path sampling and an application to a bimodal ocean current model , 2009, J. Comput. Phys..

[22]  A. Simmons,et al.  The ECMWF operational implementation of four‐dimensional variational assimilation. I: Experimental results with simplified physics , 2007 .

[23]  G. Kitagawa Monte Carlo Filter and Smoother for Non-Gaussian Nonlinear State Space Models , 1996 .

[24]  Istvan Szunyogh,et al.  Efficient data assimilation for spatiotemporal chaos: A local ensemble transform Kalman filter , 2005, physics/0511236.

[25]  Nando de Freitas,et al.  Sequential Monte Carlo Methods in Practice , 2001, Statistics for Engineering and Information Science.

[26]  Matthias Morzfeld,et al.  Implicit particle filters for data assimilation , 2010, 1005.4002.

[27]  M. Freidlin,et al.  Random Perturbations of Dynamical Systems , 1984 .

[28]  E. Kalnay,et al.  Comparison of Local Ensemble Transform Kalman Filter, 3DVAR, and 4DVAR in a Quasigeostrophic Model , 2009 .

[29]  Istvan Szunyogh,et al.  A Local Ensemble Kalman Filter for Atmospheric Data Assimilation , 2002 .