ACCOUNTING FOR TIME DEPENDENCE IN LARGE-SCALE MULTIPLE TESTING OF EVENT-RELATED POTENTIAL DATA

Event-related potentials (ERPs) are recordings of electrical activity along the scalp time-locked to perceptual, motor and cognitive events. Because ERP signals are often rare and weak, relative to the large between-subject variability, establishing significant associations between ERPs and behavioral (or experimental) variables of interest poses major challenges for statistical analysis. Noting that ERP time dependence exhibits a block pattern suggesting strong local and long-range autocorrelation components, we propose a flexible factor modeling of dependence. An adaptive factor adjustment procedure is derived from a joint estimation of the signal and noise processes, given a prior knowledge of the noise-alone intervals. A simulation study is presented using known signals embedded in a real dependence structure extracted from authentic ERP measurements. The proposed procedure performs well compared with existing multiple testing procedures and is more powerful at discovering interesting ERP features.

[1]  W. Press,et al.  Numerical Recipes: The Art of Scientific Computing , 1987 .

[2]  Genevera I. Allen,et al.  A Generalized Least-Square Matrix Decomposition , 2014 .

[3]  K. Jöreskog.  Some contributions to maximum likelihood factor analysis , 1967 .

[4]  A. Buja,et al.  Remarks on Parallel Analysis. , 1992, Multivariate behavioral research.

[5]  J. Ford,et al.  Reduced auditory evoked potential component N100 in schizophrenia — A critical review , 2008, Psychiatry Research.

[6]  J. Fawcett,et al.  Intentional forgetting reduces color-naming interference: evidence from item-method directed forgetting. , 2013, Journal of experimental psychology. Learning, memory, and cognition.

[7]  Marta Kutas,et al.  Mass univariate analysis of event-related brain potentials/fields II: Simulation studies. , 2011, Psychophysiology.

[8]  S. Hsieh,et al.  A factor-adjusted multiple testing procedure for ERP data analysis , 2012, Behavior research methods.

[9]  M. D. Paz-Caballero,et al.  ERP Correlates of Directed Forgetting Effects in Direct and Indirect Memory Tests , 1999 .

[10]  Russell A. Poldrack,et al.  Handbook of Functional MRI Data Analysis: Bibliography , 2011 .

[11]  Jiashun Jin,et al.  Impossibility of successful classification when useful features are rare and weak , 2009, Proceedings of the National Academy of Sciences.

[12]  Mark W. Woolrich,et al.  Statistical Analysis of fMRI Data , 2009 .

[13]  Hollyn M. Johnson,et al.  Processes of successful intentional forgetting. , 1994 .

[14]  Chloé Friguet,et al.  A Factor Model Approach to Multiple Testing Under Dependence , 2009 .

[15]  D. Guthrie,et al.  Significance testing of difference potentials. , 1991, Psychophysiology.

[16]  Dorothy T. Thayer,et al.  EM algorithms for ML factor analysis , 1982 .

[17]  Yogendra P. Chaubey.  Resampling-Based Multiple Testing: Examples and Methods for p-Value Adjustment , 1993 .

[18]  A. Richardson-Klavehn,et al.  Maintenance rehearsal affects knowing, not remembering; elaborative rehearsal affects remembering, not knowing , 1994, Psychonomic bulletin & review.

[19]  Wenguang Sun,et al.  Large‐scale multiple testing under dependence , 2009 .

[20]  Y. Benjamini,et al.  THE CONTROL OF THE FALSE DISCOVERY RATE IN MULTIPLE TESTING UNDER DEPENDENCY , 2001 .

[21]  D. Donoho,et al.  Higher criticism thresholding: Optimal feature selection when useful features are rare and weak , 2008, Proceedings of the National Academy of Sciences.

[22]  Eduardo Martínez-Montes,et al.  False discovery rate and permutation test: An evaluation in ERP data analysis , 2010, Statistics in medicine.

[23]  R. Näätänen.  Mismatch negativity: clinical research and possible applications. , 2003, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[24]  E. Gordon,et al.  THE TEST-RETEST RELIABILITY OF A STANDARDIZED NEUROCOGNITIVE AND NEUROPHYSIOLOGICAL TEST BATTERY: “NEUROMARKER” , 2005, The International journal of neuroscience.

[25]  S. Dudoit,et al.  Multiple Testing Procedures with Applications to Genomics , 2007 .

[26]  Godfrey H. Thomson,et al.  The Factorial Analysis of Human Ability. , 1940 .

[27]  Maela Kloareg,et al.  Factor Analysis for Multiple Testing (FAMT): An R Package for Large-Scale Significance Testing under Dependence , 2011 .

[28]  B. Efron.  Correlation and Large-Scale Simultaneous Significance Testing , 2007 .

[29]  Isaac Dialsingh,et al.  Large-scale inference: empirical Bayes methods for estimation, testing, and prediction , 2012 .

[30]  David M. Groppe,et al.  Mass univariate analysis of event-related brain potentials/fields I: a critical tutorial review. , 2011, Psychophysiology.

[31]  Jeffrey T Leek,et al.  A general framework for multiple testing dependence , 2008, Proceedings of the National Academy of Sciences.

[32]  Y. Benjamini,et al.  Controlling the false discovery rate: a practical and powerful approach to multiple testing , 1995 .

[33]  Nancy R. Zhang,et al.  Multiple hypothesis testing adjusted for latent variables, with an application to the AGEMAP gene expression data , 2013, 1301.2420.

[34]  Todd C. Handy,et al.  Event-related potentials : a methods handbook , 2005 .

[35]  M. Rugg,et al.  Event-related potentials and recognition memory , 2007, Trends in Cognitive Sciences.

[36]  B. Weiner,et al.  Motivated forgetting and the study of repression. , 1968, Journal of personality.

[37]  R. Blair,et al.  An alternative method for significance testing of waveform difference potentials. , 1993, Psychophysiology.

[38]  N. L. Johnson,et al.  Multivariate Analysis , 1958, Nature.

[39]  H. Pashler,et al.  Puzzlingly High Correlations in fMRI Studies of Emotion, Personality, and Social Cognition 1 , 2009, Perspectives on psychological science : a journal of the Association for Psychological Science.