Detecting Multiple Step Changes Using Adaptive Regression Splines with Application to Neural Recordings

Time series produced by dynamical systems as frequently the case in neuroscience are rarely stationary but often exhibit quite abrupt changes due to bifurcations or other dynamical phenomena. A plethora of methods for detecting such changes in time series statistics, commonly called change point analysis, have been developed over the years, in addition to test criteria to evaluate change point significance. Issues to consider when developing such methods include computational demands, difficulties arising from either limited amount of data or a large number of covariates, and arriving at statistical tests with sufficient power to detect as many change points as contained in potentially high-dimensional data sets. Here, a general method called Paired Adaptive Regressors for Cumulative Sum (PARCS) is developed for detecting multiple change points in multivariate time series. The method's flexibility to incorporate useful features from other change point detection techniques is highlighted. The advantages of PARCS over existing approaches are demonstrated through a series of simulation experiments, followed by a real data application to neural recordings from rat medial prefrontal cortex during learning.

[1]  D. Hinkley Inference about the intersection in two-phase regression , 1969 .

[2]  Jaromír Antoch,et al.  Permutation tests in change point analysis , 2001 .

[3]  Jonathan W. Pillow,et al.  Single-trial spike trains in parietal cortex reveal discrete steps during decision-making , 2015, Science.

[4]  M. Shadlen,et al.  Response of Neurons in the Lateral Intraparietal Area during a Combined Visual Discrimination Reaction Time Task , 2002, The Journal of Neuroscience.

[5]  E. Gombay,et al.  On the Rate of Approximations for Maximum Likelihood Tests in Change-Point Models , 1996 .

[6]  D. Hinkley Inference in Two-Phase Regression , 1971 .

[7]  A. Redish,et al.  Representational changes of latent strategies in rat medial prefrontal cortex precede changes in behaviour , 2016, Nature Communications.

[8]  Mark W. Watson,et al.  Estimating Turning Points Using Large Data Sets , 2010 .

[9]  Anthony C. Davison,et al.  Bootstrap Methods and Their Application , 1998 .

[10]  Timothy D. Hanks,et al.  Perceptual Decision Making in Rodents, Monkeys, and Humans , 2017, Neuron.

[11]  J. Friedman,et al.  FLEXIBLE PARSIMONIOUS SMOOTHING AND ADDITIVE MODELING , 1989 .

[12]  L. Dümbgen The Asymptotic Behavior of Some Nonparametric Change-Point Estimators , 1991 .

[13]  Tengyao Wang,et al.  High dimensional change point estimation via sparse projection , 2016, 1606.06246.

[14]  Z. Q. John Lu,et al.  Nonlinear Time Series: Nonparametric and Parametric Methods , 2004, Technometrics.

[15]  Stefano Piana,et al.  Identifying localized changes in large systems: Change-point detection for biomolecular simulations , 2015, Proceedings of the National Academy of Sciences.

[16]  Jaromír Antoch,et al.  Effect of dependence on statistics for determination of change , 1997 .

[17]  Trevor Hastie,et al.  The Elements of Statistical Learning , 2001 .

[18]  D. Picard Testing and estimating change-points in time series , 1985, Advances in Applied Probability.

[19]  E. S. Page CONTINUOUS INSPECTION SCHEMES , 1954 .

[20]  Claudia Kirch,et al.  Block permutation principles for the change analysis of dependent data , 2007 .

[21]  Arjun K. Gupta,et al.  Parametric Statistical Change Point Analysis , 2000 .

[22]  Anthony C. Davison,et al.  Bootstrap methods and their application: Tests , 1997 .

[23]  R. Quandt The Estimation of the Parameters of a Linear Regression System Obeying Two Separate Regimes , 1958 .

[24]  H. Chernoff,et al.  ESTIMATING THE CURRENT MEAN OF A NORMAL DISTRIBUTION WHICH IS SUBJECTED TO CHANGES IN TIME , 1964 .

[25]  P. K. Bhattacharya,et al.  Some aspects of change-point analysis , 1994 .

[26]  Gaby Schneider,et al.  Detecting joint pausiness in parallel spike trains , 2017, Journal of Neuroscience Methods.

[27]  M. Kendall,et al.  The advanced theory of statistics , 1945 .

[28]  Didier Paillard,et al.  The timing of Pleistocene glaciations from a simple multiple-state climate model , 1998, Nature.

[29]  A. Scott,et al.  A Cluster Analysis Method for Grouping Means in the Analysis of Variance , 1974 .

[30]  J. Bai,et al.  Estimating Multiple Breaks One at a Time , 1997, Econometric Theory.

[31]  Diane J. Cook,et al.  A survey of methods for time series change point detection , 2017, Knowledge and Information Systems.

[32]  Jianqing Fan,et al.  Nonlinear Time Series : Nonparametric and Parametric Methods , 2005 .

[33]  Moritz Jirak,et al.  Change-point analysis in increasing dimension , 2012, J. Multivar. Anal..

[34]  Emery N Brown,et al.  Dynamic Analysis of Learning in Behavioral Experiments , 2004, The Journal of Neuroscience.

[35]  Daniel Durstewitz Advanced Data Analysis in Neuroscience , 2017 .

[36]  Xufeng Niu,et al.  Detecting Shifts in Hurricane Rates Using a Markov Chain Monte Carlo Approach , 2004 .

[37]  J. Freidman,et al.  Multivariate adaptive regression splines , 1991 .

[38]  J. Herson,et al.  Square Root Transformation Revisited , 1972 .

[39]  J. Durbin,et al.  Techniques for Testing the Constancy of Regression Relationships Over Time , 1975 .

[40]  Young K. Truong,et al.  Polynomial splines and their tensor products in extended linear modeling: 1994 Wald memorial lecture , 1997 .

[41]  Patricia L. Smith,et al.  Curve fitting and modeling with splines using statistical variable selection techniques , 1982 .

[42]  Robert H. Shumway,et al.  Time series analysis and its applications : with R examples , 2017 .

[43]  Noël Veraverbeke,et al.  Change-point problem and bootstrap , 1995 .

[44]  Marie Husková,et al.  Permutation tests for multiple changes , 2001, Kybernetika.

[45]  J. Stock,et al.  ESTIMATING TURNING POINTS USING LARGE DATA SETS November 2010 ( Revised June 2012 ) , 2010 .

[46]  D. Durstewitz,et al.  Abrupt Transitions between Prefrontal Neural Ensemble States Accompany Behavioral Transitions during Rule Learning , 2010, Neuron.

[47]  D. Hinkley Inference about the change-point from cumulative sum tests , 1971 .

[48]  Piotr Fryzlewicz,et al.  Wild binary segmentation for multiple change-point detection , 2014, 1411.0858.

[49]  Kevin P. Murphy,et al.  Modeling recurrent DNA copy number alterations in array CGH data , 2007, ISMB/ECCB.

[50]  David S. Matteson,et al.  A Nonparametric Approach for Multiple Change Point Analysis of Multivariate Data , 2013, 1306.4933.

[51]  Jean-Philippe Vert,et al.  Fast detection of multiple change-points shared by many signals using group LARS , 2010, NIPS.

[52]  D. Lathrop Nonlinear Dynamics and Chaos: With Applications to Physics, Biology, Chemistry, and Engineering , 2015 .

[53]  Lajos Horváth Detection of Changes in Linear Sequences , 1997 .