Detecting structural breaks in seasonal time series by regularized optimization

Real-world systems are often complex, dynamic, and nonlinear. Understanding the dynamics of a system from its observed time series is key to the prediction and control of the system's behavior. While most existing techniques tacitly assume some form of stationarity or continuity, abrupt changes, which are often due to external disturbances or sudden changes in the intrinsic dynamics, are common in time series. Structural breaks, which are time points at which the statistical patterns of a time series change, pose considerable challenges to data analysis. Without identification of such break points, the same dynamic rule would be applied to the whole period of observation, whereas false identification of structural breaks may lead to overfitting. In this paper, we cast the problem of decomposing a time series into its trend and seasonal components as an optimization problem. This problem is ill-posed due to the arbitrariness in the number of parameters. To overcome this difficulty, we propose the addition of a penalty function (i.e., a regularization term) that accounts for the number of parameters. Our approach simultaneously identifies seasonality and trend without the need of iterations, and allows the reliable detection of structural breaks. The method is applied to recorded data on fish populations and sea surface temperature, where it detects structural breaks that would have been neglected otherwise. This suggests that our method can lead to a general approach for the monitoring, prediction, and prevention of structural changes in real systems.

[1]  Harvard Medical School,et al.  Effect of nonstationarities on detrended fluctuation analysis. , 2001, Physical review. E, Statistical, nonlinear, and soft matter physics.

[2]  Charles R. Johnson,et al.  Matrix analysis , 1985, Statistical Inference for Engineers and Data Scientists.

[3]  Rob J Hyndman,et al.  Detecting trend and seasonal changes in satellite image time series , 2010 .

[4]  E. Candès,et al.  Stable signal recovery from incomplete and inaccurate measurements , 2005, math/0503066.

[5]  P. Perron,et al.  Estimating and testing linear models with multiple structural changes , 1995 .

[6]  S. Carpenter,et al.  Early-warning signals for critical transitions , 2009, Nature.

[7]  H. Akaike A new look at the statistical model identification , 1974 .

[8]  Pablo A. Marquet,et al.  Scaling metabolic rate fluctuations , 2007, Proceedings of the National Academy of Sciences.

[9]  Jie Sun,et al.  Judging model reduction of complex systems. , 2011, Physical review. E, Statistical, nonlinear, and soft matter physics.

[10]  J. Durbin,et al.  Techniques for Testing the Constancy of Regression Relationships Over Time , 1975 .

[11]  Valerie Cerra,et al.  Growth Dynamics; The Myth of Economic Recovery , 2005 .

[12]  A. Zeileis A Unified Approach to Structural Change Tests Based on ML Scores, F Statistics, and OLS Residuals , 2005 .

[13]  Impacts of the Introduced Round Goby (Apollonia melanostoma) on Dreissenids (Dreissena polymorpha and Dreissena bugensis) and on Macroinvertebrate Community between 2003 and 2006 in the Littoral Zone of Green Bay, Lake Michigan , 2008 .

[14]  A. Wolf,et al.  Impacts of the Introduced Round Goby (Apollonia melanostoma) on Dreissenids (Dreissena polymorpha and Dreissena bugensis) and on Macroinvertebrate Community between 2003 and 2006 in the Littoral Zone of Green Bay, Lake Michigan , 2008 .

[15]  H. Stanley,et al.  Effect of trends on detrended fluctuation analysis. , 2001, Physical review. E, Statistical, nonlinear, and soft matter physics.

[16]  B T Grenfell,et al.  Noisy Clockwork: Time Series Analysis of Population Fluctuations in Animals , 2001, Science.

[17]  J. Janssen,et al.  Impact of Round Gobies (Neogobius melanostomus) on Dreissenids (Dreissena polymorpha and Dreissena bugensis) and the Associated Macroinvertebrate Community Across an Invasion Front , 2006 .

[18]  J. Haywood,et al.  Trending seasonal data with multiple structural breaks . NZ visitor arrivals and the minimal effects of 9 / 11 , 2008 .

[19]  G. Schwarz Estimating the Dimension of a Model , 1978 .

[20]  D. Andrews Tests for Parameter Instability and Structural Change with Unknown Change Point , 1993 .

[21]  Irma J. Terpenning,et al.  STL : A Seasonal-Trend Decomposition Procedure Based on Loess , 1990 .

[22]  Kurt Hornik,et al.  Testing and dating of structural changes in practice , 2003, Comput. Stat. Data Anal..

[23]  D. Andrews Tests for Parameter Instability and Structural Change with Unknown Change Point , 1993 .

[24]  G. Filatrella,et al.  Analysis of a power grid using a Kuramoto-like model , 2007, 0705.1305.

[25]  Guillem Rigaill,et al.  Pruned dynamic programming for optimal multiple change-point detection , 2010 .

[26]  P. Perron,et al.  Computation and Analysis of Multiple Structural-Change Models , 1998 .

[27]  Arnold Neumaier,et al.  Solving Ill-Conditioned and Singular Linear Systems: A Tutorial on Regularization , 1998, SIAM Rev..