A warning about median reaction time

When used with positively skewed reaction time distributions, sample medians tend to over-estimate population medians. The extent of overestimation is related directly to the amount of skew in the reaction time distributions and inversely to the size of the sample over which the median is computed. Simulations indicate that overestimation could approach 50 ms with small samples and highly skewed distributions. An important practical consequence of the bias in median reaction time is that sample medians must not be used to compare reaction times across experimental conditions when there are unequal numbers of trials in the conditions. If medians are used with unequal sample sizes, then the bias may produce an artifactual difference in conditions or conceal a true difference. Some recent studies of cuing and stimulus probability effects provide examples of this potential artifact.

[1]  S. Sternberg.  Memory-scanning: mental processes revealed by reaction-time experiments. , 1969, American scientist.

[2]  R. Remington,et al.  Moving attention: Evidence for time-invariant shifts of visual selective attention , 1984, Perception & psychophysics.

[3]  P D MCCORMACK,et al.  THE POSITIVE SKEW OBSERVED IN REACTION TIME DISTRIBUTIONS. , 1964, Canadian journal of psychology.

[4]  David C. Hoaglin,et al.  Applications, basics, and computing of exploratory data analysis , 1983 .

[5]  William H. Press,et al.  Numerical recipes in C. The art of scientific computing , 1987 .

[6]  J. Dykes,et al.  The effect of stimulus probability on the perceptual processing of letters , 1981 .

[7]  Roger Ratcliff,et al.  Retrieval Processes in Recognition Memory , 1976 .

[8]  M. Posner,et al.  Sustained Concentration: Passive Filtering or Active Orienting? , 2019, Preparatory States & Processes.

[9]  Leonard A. Marascuilo,et al.  Statistical methods for behavioral science research , 1971 .

[10]  J Miller,et al.  Priming is not necessary for selective-attention failures: Semantic effects of unattended, unprimed letters , 1987, Perception & psychophysics.

[11]  W. Hockley.  Analysis of response time distributions in the study of cognitive processes. , 1984 .

[12]  W. Hays.  Statistics for the social sciences , 1973 .

[13]  G. Shulman,et al.  Moving attention through visual space. , 1979, Journal of experimental psychology. Human perception and performance.

[14]  A. Lambert,et al.  Selective attention and performance with a multidimensional visual display. , 1986, Journal of experimental psychology. Human perception and performance.