Small-sample characterization of stochastic approximation staircases in forced-choice adaptive threshold estimation

Despite the widespread use of up—down staircases in adaptive threshold estimation, their efficiency and usability in forced-choice experiments has been recently debated. In this study, simulation techniques were used to determine the small-sample convergence properties of stochastic approximation (SA) staircases as a function of several experimental parameters. We found that satisfying some general requirements (use of the accelerated SA algorithm, clear suprathreshold initial stimulus intensity, large initial step size) the convergence was accurate independently of the spread of the underlying psychometric function. SA staircases were also reliable for targeting percent-correct levels far from the midpoint of the psychometric function and performed better than classical up—down staircases with fixed step size. These results prompt the utilization of SA staircases in practical forced-choice estimation of sensory thresholds.

[1]  S. Klein,et al.  Measuring, estimating, and understanding the psychometric function: A commentary , 2001, Perception & psychophysics.

[2]  A. Watson,et al.  Quest: A Bayesian adaptive psychometric method , 1983, Perception & psychophysics.

[3]  M. Leek.  Adaptive procedures in psychophysical research , 2001, Perception & psychophysics.

[4]  B. Treutwein.  Adaptive psychophysical procedures , 1995, Vision Research.

[5]  M. García-Pérez,et al.  Forced-choice staircases with fixed step sizes: asymptotic and small-sample properties , 1998, Vision Research.

[6]  J J Zwislocki,et al.  On a psychophysical transformed-rule up and down method converging on a 75% level of correct responses , 2001, Proceedings of the National Academy of Sciences of the United States of America.

[7]  G. Fechner.  Elemente der Psychophysik , 1998 .

[8]  G. B. Wetherill,et al.  SEQUENTIAL ESTIMATION OF POINTS ON A PSYCHOMETRIC FUNCTION. , 1965, The British journal of mathematical and statistical psychology.

[9]  P. King-Smith,et al.  Efficient and unbiased modifications of the QUEST threshold method: Theory, simulations, experimental evaluation and practical implementation , 1994, Vision Research.

[10]  H. Levitt.  Transformed up-down methods in psychoacoustics. , 1971, The Journal of the Acoustical Society of America.

[11]  T. Takeuchi.  The effect of eccentricity and the adapting level on the café wall illusion , 2005, Perception & psychophysics.

[12]  H. Robbins.  A Stochastic Approximation Method , 1951 .

[13]  M. M. Taylor,et al.  PEST: Efficient Estimates on Probability Functions , 1967 .

[14]  C Kaernbach,et al.  Simple adaptive testing with the weighted up-down method , 1991, Perception & psychophysics.

[15]  Sygal Amitay,et al.  Auditory frequency discrimination learning is affected by stimulus variability , 2005, Perception & psychophysics.

[16]  Chris A. Johnson,et al.  Comparison of the ASA, MOBS, and ZEST threshold methods , 2006, Vision Research.

[17]  L G Brown.  Additional rules for the transformed up-down method in psychophysics , 1996, Perception & psychophysics.

[18]  C. D. Kershaw,et al.  Statistical properties of staircase estimates from two interval forced choice experiments , 1985 .

[19]  M. García-Pérez.  Properties of some variants of adaptive staircases with fixed step sizes. , 2002, Spatial vision.

[20]  Neil A. Macmillan,et al.  Detection Theory: A User's Guide , 1991 .

[21]  C. Tyler,et al.  Bayesian adaptive estimation of psychometric slope and threshold , 1999, Vision Research.

[22]  C. Kaernbach.  Adaptive threshold estimation with unforced-choice tasks , 2001, Perception & psychophysics.

[23]  C Kaernbach,et al.  Slope bias of psychometric functions derived from adaptive data , 2001, Perception & psychophysics.

[24]  D. M. Green,et al.  Stimulus selection in adaptive psychophysical procedures. , 1990, The Journal of the Acoustical Society of America.

[25]  J. L. Hall.  Hybrid adaptive procedure for estimation of psychometric functions. , 1980 .

[26]  H. Kesten.  Accelerated Stochastic Approximation , 1958 .