Principal component analysis for non-stationary time series based on detrended cross-correlation analysis

The principal component analysis (PCA) has been extensively studied and proved to be a sophisticated technique for the dimension reduction and the index construction of multidimensional stationary time series. However, the PCA method is often susceptible to external trends of original variables in real-world applications, when data present non-stationarity. In this paper, we propose a non-stationary principal component analysis (NSPCA) for multidimensional time series in the presence of non-stationarity. The new method is based on detrended cross-correlation analysis. We theoretically derive the coefficients relating to the combinations of original variables in the NSPCA method. We also apply the NSPCA method to the autoregressive model, Gaussian distributed variables as well as stock sectors in Chinese stock markets, and compare it with the traditional PCA method. We find that the NSPCA method has the advantage to detect intrinsic cross-correlations among variables and identify the patterns of data in the case of non-stationarity, minimizing the effects of external trends which often make the PCA yields few components assigning similar loadings to all variables.

[1]  Imen Kammoun,et al.  Asymptotic Properties of the Detrended Fluctuation Analysis of Long-Range-Dependent Processes , 2008, IEEE Transactions on Information Theory.

[2]  Zhi-Qiang Jiang,et al.  Multifractal detrending moving-average cross-correlation analysis. , 2011, Physical review. E, Statistical, nonlinear, and soft matter physics.

[3]  Boris Podobnik,et al.  Detrended cross-correlation analysis for non-stationary time series with periodic trends , 2011 .

[4]  Karl Pearson F.R.S. LIII. On lines and planes of closest fit to systems of points in space , 1901 .

[5]  Zhong-Ke Gao,et al.  Multiscale complex network for analyzing experimental multivariate time series , 2015 .

[6]  J. Álvarez-Ramírez,et al.  Detrending fluctuation analysis based on moving average filtering , 2005 .

[7]  Pengjian Shang,et al.  Minimizing the trend effect on detrended cross-correlation analysis with empirical mode decomposition , 2012 .

[8]  Zhongke Gao,et al.  A directed weighted complex network for characterizing chaotic dynamics from time series , 2012 .

[9]  Alois Steindl,et al.  Methods for dimension reduction and their application in nonlinear dynamics , 2001 .

[10]  Distribution of eigenvalues of detrended cross-correlation matrix , 2014 .

[11]  B. Moore Principal component analysis in linear systems: Controllability, observability, and model reduction , 1981 .

[12]  Thadeu Josino Pereira Penna,et al.  Fourier-detrended fluctuation analysis , 2005 .

[13]  Naiming Yuan,et al.  Detrended Partial-Cross-Correlation Analysis: A New Method for Analyzing Correlations in Complex System , 2015, Scientific Reports.

[14]  Pengjian Shang,et al.  Multifractal Fourier detrended cross-correlation analysis of traffic signals , 2011 .

[15]  Pengjian Shang,et al.  Measuring information interactions on the ordinal pattern of stock time series. , 2013, Physical review. E, Statistical, nonlinear, and soft matter physics.

[16]  K. Kim,et al.  Face recognition using kernel principal component analysis , 2002, IEEE Signal Process. Lett..

[17]  Markus Ringnér,et al.  What is principal component analysis? , 2008, Nature Biotechnology.

[18]  Claus Weihs,et al.  Variable window adaptive Kernel Principal Component Analysis for nonlinear nonstationary process monitoring , 2011, Comput. Ind. Eng..

[19]  Hernando Ombao,et al.  Time-dependent frequency domain principal components analysis of multichannel non-stationary signals , 2006, Comput. Stat. Data Anal..

[20]  A. J. Morris,et al.  Wavelets and non-linear principal components analysis for process monitoring , 1999 .

[21]  H. Stanley,et al.  Cross-correlations between volume change and price change , 2009, Proceedings of the National Academy of Sciences.

[22]  I. Jolliffe Principal Component Analysis , 2002 .

[23]  Erniel B. Barrios,et al.  Principal components analysis of nonstationary time series data , 2009, Stat. Comput..

[24]  Christopher J. C. Burges,et al.  Dimension Reduction: A Guided Tour , 2010, Found. Trends Mach. Learn..

[25]  J. A. Stewart,et al.  Nonlinear Time Series Analysis , 2015 .

[26]  G. F. Zebende DCCA cross-correlation coefficient: Quantifying level of cross-correlation , 2011 .

[27]  T. Guhr,et al.  Non-stationarity in financial time series: Generic features and tail behavior , 2013, 1304.5130.

[28]  Zhong-Ke Gao,et al.  Multivariate weighted complex network analysis for characterizing nonlinear dynamic behavior in two-phase flow , 2015 .

[29]  C. Peng,et al.  Mosaic organization of DNA nucleotides. , 1994, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[30]  V. Plerou,et al.  Universal and Nonuniversal Properties of Cross Correlations in Financial Time Series , 1999, cond-mat/9902283.

[31]  H. Stanley,et al.  Detrended cross-correlation analysis: a new method for analyzing two nonstationary time series. , 2007, Physical review letters.

[32]  Ka Yee Yeung,et al.  Principal component analysis for clustering gene expression data , 2001, Bioinform..

[33]  Pengjian Shang,et al.  Cross-correlations and structures of stock markets based on multiscale MF-DXA and PCA , 2014 .

[34]  William W. Hsieh,et al.  Nonlinear Principal Component Analysis , 2009 .

[35]  Paul Geladi,et al.  Principal Component Analysis , 1987, Comprehensive Chemometrics.

[36]  Wei-Xing Zhou,et al.  Modified detrended fluctuation analysis based on empirical mode decomposition for the characterization of anti-persistent processes , 2009, 0907.3284.

[37]  Jacqueline J Meulman,et al.  Nonlinear principal components analysis: introduction and application. , 2007, Psychological methods.