Are divergence point analyses suitable for response time data?

Estimating the time course of the influence of different factors in human performance is one of the major topics of research in cognitive psychology/neuroscience. Over the past decades, researchers have proposed several methods to tackle this question using latency data. Here we examine a recently proposed procedure that employs survival analyses on latency data to provide precise estimates of the timing of the first discernible influence of a given factor (e.g., word frequency on lexical access) on performance (e.g., fixation durations or response times). A number of articles have used this method in recent years, and hence an exploration of its strengths and its potential weaknesses is in order. Unfortunately, our analysis revealed that the technique has conceptual flaws, and it might lead researchers into believing that they are obtaining a measurement of processing components when, in fact, they are obtaining an uninterpretable measurement.

[1]  Roger Ratcliff,et al.  A Theory of Memory Retrieval. , 1978 .

[2]  Joseph W. Houpt,et al.  An Extension of SIC Predictions to the Wiener Coactive Model. , 2011, Journal of mathematical psychology.

[3]  S. B. Vincent The function of the vibrissae in the behavior of the white rat , 1912 .

[4]  Hadley Wickham,et al.  ggplot2 - Elegant Graphics for Data Analysis (2nd Edition) , 2017 .

[5]  Erik D. Reichle,et al.  Direct lexical control of eye movements in reading: Evidence from a survival analysis of fixation durations , 2012, Cognitive Psychology.

[6]  Jean-Claude Falmagne,et al.  NOTE ON A SIMPLE FIXED‐POINT PROPERTY OF BINARY MIXTURES , 1968 .

[7]  R. Ratcliff Group reaction time distributions and an analysis of distribution statistics. , 1979, Psychological bulletin.

[8]  R Core Team,et al.  R: A language and environment for statistical computing. , 2014 .

[9]  P. Aphalo Learn R ...as you learnt your mother tongue , 2017 .

[10]  James T. Townsend,et al.  The statistical properties of the Survivor Interaction Contrast , 2010 .

[11]  Jeff Miller,et al.  Delta plots with negative-going slopes as a potential marker of decreasing response activation in masked semantic priming , 2017, Psychological Research.

[12]  D. Meyer,et al.  Analyses of multinomial mixture distributions: new tests for stochastic models of cognition and action. , 1991, Psychological bulletin.

[13]  V. Kuperman,et al.  Surviving Blind Decomposition: A Distributional Analysis of the Time-Course of Complex Word Recognition , 2017, Journal of experimental psychology. Learning, memory, and cognition.

[14]  T. Zandt Analysis of Response Time Distributions , 2002 .

[15]  D. Mewhort,et al.  Analysis of Response Time Distributions: An Example Using the Stroop Task , 1991 .

[16]  H. Birx,et al.  The Mismeasure of Man , 1981 .

[17]  Jeffrey N. Rouder,et al.  Assessing the roles of change discrimination and luminance integration: evidence for a hybrid race model of perceptual decision making in luminance discrimination. , 2000, Journal of experimental psychology. Human perception and performance.

[18]  A. Cohen,et al.  Finite Mixture Distributions , 1982 .

[19]  Paul Schedl,et al.  The locus of , 1984 .

[20]  Brian D. Ripley,et al.  Modern Applied Statistics with S Fourth edition , 2002 .

[21]  Eyal M. Reingold,et al.  Estimating the divergence point: a novel distributional analysis procedure for determining the onset of the influence of experimental variables , 2014, Front. Psychol..

[22]  Adrian Staub,et al.  The effect of lexical predictability on distributions of eye fixation durations , 2011, Psychonomic bulletin & review.

[23]  R. Rigby,et al.  Generalized additive models for location, scale and shape , 2005 .

[24]  D. Balota,et al.  Moving Beyond the Mean in Studies of Mental Chronometry , 2011 .

[25]  W. Estes The problem of inference from curves based on group data. , 1956, Psychological bulletin.

[26]  Scott D. Brown,et al.  The simplest complete model of choice response time: Linear ballistic accumulation , 2008, Cognitive Psychology.

[27]  K. Rayner,et al.  Unsegmented text delays word identification: Evidence from a survival analysis of fixation durations , 2013 .

[28]  R. Rigby,et al.  Generalized Additive Models for Location Scale and Shape (GAMLSS) in R , 2007 .

[29]  Erik D. Reichle,et al.  Toward a model of eye movement control in reading. , 1998, Psychological review.

[30]  Estes Wk The problem of inference from curves based on group data. , 1956 .

[31]  Ehtibar N. Dzhafarov,et al.  The structure of simple reaction time to step-function signals , 1992 .

[32]  H. Wickham Simple, Consistent Wrappers for Common String Operations , 2015 .

[33]  E. Lauber,et al.  Conditional and unconditional automaticity: a dual-process model of effects of spatial stimulus-response correspondence. , 1994, Journal of experimental psychology. Human perception and performance.

[34]  Heather Sheridan The Time-course of Lexical Influences on Fixation Durations during Reading: Evidence from Distributional Analyses , 2013 .

[35]  E. Reingold,et al.  On using distributional analysis techniques for determining the onset of the influence of experimental variables , 2018, Quarterly journal of experimental psychology.

[36]  H. Wickham Easily Tidy Data with 'spread()' and 'gather()' Functions , 2016 .

[37]  E. Lauber,et al.  Conditional and unconditional automaticity: a dual-process model of effects of spatial stimulus-response correspondence. , 1994, Journal of experimental psychology. Human perception and performance.

[38]  Mallorie Leinenger Survival analyses reveal how early phonological processing affects eye movements during reading. , 2019, Journal of experimental psychology. Learning, memory, and cognition.

[39]  Jeffrey N. Rouder,et al.  A hierarchical model for estimating response time distributions , 2005, Psychonomic bulletin & review.

[40]  V. Kuperman,et al.  A paradox of apparent brainless behavior: The time-course of compound word recognition , 2019, Cortex.

[41]  William N. Venables,et al.  Modern Applied Statistics with S , 2010 .

[42]  Evan Heit,et al.  Two-Process Models of Recognition Memory: Evidence for Recall-to-Reject? , 1999 .