The Indecision Model of Psychophysical Performance in Dual-Presentation Tasks: Parameter Estimation and Comparative Analysis of Response Formats

Psychophysical data from dual-presentation tasks are often collected with the two-alternative forced-choice (2AFC) response format, asking observers to guess when uncertain. For an analytical description of performance, psychometric functions are then fitted to data aggregated across the two orders/positions in which stimuli were presented. Yet, order effects make aggregated data uninterpretable, and the bias with which observers guess when uncertain precludes separating sensory from decisional components of performance. A ternary response format in which observers are also allowed to report indecision should fix these problems, but a comparative analysis with the 2AFC format has never been conducted. In addition, fitting ternary data separated by presentation order poses serious challenges. To address these issues, we extended the indecision model of psychophysical performance to accommodate the ternary, 2AFC, and same–different response formats in detection and discrimination tasks. Relevant issues for parameter estimation are also discussed along with simulation results that document the superiority of the ternary format. These advantages are demonstrated by fitting the indecision model to published detection and discrimination data collected with the ternary, 2AFC, or same–different formats, which had been analyzed differently in the sources. These examples also show that 2AFC data are unsuitable for testing certain types of hypotheses. matlab and R routines written for our purposes are available as Supplementary Material, which should help spread the use of the ternary format for dependable collection and interpretation of psychophysical data.

[1]  H Dai,et al.  On measuring psychometric functions: a comparison of the constant-stimulus and adaptive up-down methods. , 1995, The Journal of the Acoustical Society of America.

[2]  Yongwoo Yi,et al.  Determining thresholds using adaptive procedures and psychometric fits: evaluating efficiency using theory, simulations, and human experiments , 2015, Experimental Brain Research.

[3]  R. Shapley,et al.  Noise masking of White's illusion exposes the weakness of current spatial filtering models of lightness perception. , 2015, Journal of vision.

[4]  Multidimensional Fechnerian scaling: pairwise comparisons, regular minimality, and nonconstant self-similarity , 2002 .

[5]  Daniel M. Merfeld,et al.  Signal detection theory and vestibular perception: III. Estimating unbiased fit parameters for psychometric functions , 2012, Experimental Brain Research.

[6]  M. García-Pérez.  Thou Shalt Not Bear False Witness Against Null Hypothesis Significance Testing , 2017, Educational and psychological measurement.

[7]  C F Lam,et al.  Determination of optimal data placement for psychometric function estimation: a computer simulation. , 1999, The Journal of the Acoustical Society of America.

[8]  P. Roelfsema,et al.  Contextual effects on perceived contrast: figure-ground assignment and orientation contrast. , 2015, Journal of vision.

[9]  T. Rammsayer,et al.  Time-order errors and standard-position effects in duration discrimination: An experimental study and an analysis by the sensation-weighting model , 2015, Attention, perception & psychophysics.

[10]  M. García-Pérez,et al.  A model for the time-order error in contrast discrimination , 2011, Quarterly journal of experimental psychology.

[11]  R. Ulrich,et al.  Effects of Stimulus Order on Discrimination Processes in Comparative and Equality Judgements: Data and Models , 2014, Quarterly journal of experimental psychology.

[12]  Miguel A. García-Pérez,et al.  Adaptive psychophysical methods for nonmonotonic psychometric functions , 2014, Attention, perception & psychophysics.

[13]  Miguel A. García-Pérez,et al.  Fitting model-based psychometric functions to simultaneity and temporal-order judgment data: MATLAB and R routines , 2013, Behavior research methods.

[14]  E. Peli,et al.  The bisection point across variants of the task , 2014, Attention, Perception, & Psychophysics.

[15]  Nathaniel T. Greene,et al.  Effects of Active and Passive Hearing Protection Devices on Sound Source Localization, Speech Recognition, and Tone Detection , 2015, PloS one.

[16]  B Jenkins,et al.  Orientational anisotropy in the human visual system , 1985, Perception & psychophysics.

[17]  R E Pastore,et al.  Measuring the difference limen for identification of order of onset for complex auditory stimuli , 1996, Perception & psychophysics.

[18]  M. García-Pérez,et al.  Sampling Plans for Fitting the Psychometric Function , 2005, The Spanish Journal of Psychology.

[19]  Rocío Alcalá-Quintana,et al.  The transducer model for contrast detection and discrimination: formal relations, implications, and an empirical test. , 2007, Spatial vision.

[20]  M. García-Pérez.  Optimal setups for forced-choice staircases with fixed step sizes. , 2000, Spatial vision.

[21]  S C Masin,et al.  Attentional scanning and space errors , 1991, Perception & psychophysics.

[22]  Gustav Theodor Fechner,et al.  Elements of psychophysics , 1966 .

[23]  M. García-Pérez,et al.  Does time ever fly or slow down? The difficult interpretation of psychophysical data on time perception , 2014, Front. Hum. Neurosci..

[24]  D. Jamieson.  Two presentation order effects. , 1977, Canadian journal of psychology.

[25]  D. Tolhurst,et al.  Interactions between spatial frequency channels , 1978, Vision Research.

[26]  D. Vorberg,et al.  Estimating the difference limen in 2AFC tasks: Pitfalls and improved estimators , 2009, Attention, perception & psychophysics.

[27]  Thomas H Rammsayer,et al.  Effects of time-order, interstimulus interval, and feedback in duration discrimination of noise bursts in the 50- and 1000-ms ranges. , 2004, Acta psychologica.

[28]  S. C. Masin,et al.  Handedness and space errors , 1991 .

[29]  E. Peli,et al.  Psychometric functions for detection and discrimination with and without flankers , 2011, Attention, perception & psychophysics.

[30]  M. García-Pérez,et al.  Interval bias in 2AFC detection tasks: sorting out the artifacts , 2011, Attention, perception & psychophysics.

[31]  R. Ulrich,et al.  Counting models of temporal discrimination , 2001, Psychonomic bulletin & review.

[32]  A. Winman,et al.  Recent Is More: A Negative Time-Order Effect in Nonsymbolic Numerical Judgment , 2017, Journal of experimental psychology. Human perception and performance.

[33]  M. García-Pérez,et al.  THE DIFFERENCE MODEL WITH GUESSING EXPLAINS INTERVAL BIAS IN TWO‐ALTERNATIVE FORCED‐CHOICE DETECTION PROCEDURES , 2010 .

[34]  D. Jamieson,et al.  Presentation order effects in duration discrimination , 1975 .

[35]  L E Marks,et al.  Differential effects of stimulus context on perceived length: Implications for the horizontal-vertical illusion , 1997, Perception & psychophysics.

[36]  M. García-Pérez,et al.  On the discrepant results in synchrony judgment and temporal-order judgment tasks: a quantitative model , 2012, Psychonomic bulletin & review.

[37]  E. Peli,et al.  Aniseikonia Tests: The Role of Viewing Mode, Response Bias, and Size-Color Illusions. , 2015, Translational vision science & technology.

[38]  D. Kornbrot.  Human Psychophysical Functions, an Update: Methods for Identifying their form; Estimating their Parameters; and Evaluating the Effects of Important Predictors , 2016, Psychometrika.

[39]  M. García-Pérez,et al.  Reminder and 2AFC tasks provide similar estimates of the difference limen: A reanalysis of data from Lapid, Ulrich, and Rammsayer (2008) and a discussion of Ulrich and Vorberg (2009) , 2010, Attention, perception & psychophysics.

[40]  Miguel A. García-Pérez,et al.  Improving the Estimation of Psychometric Functions in 2AFC Discrimination Tasks , 2011, Front. Psychology.

[41]  S. Dakin,et al.  Metamorphopsia and letter recognition. , 2014, Journal of vision.

[42]  Å. Hellström.  Comparison is not just subtraction: Effects of time- and space-order on subjective stimulus difference , 2003, Perception & psychophysics.

[43]  K. Schneider.  Does attention alter appearance? , 2006, Perception & psychophysics.

[44]  R. Ulrich,et al.  Trial-by-trial updating of an internal reference in discrimination tasks: Evidence from effects of stimulus order and trial sequence , 2012, Attention, Perception, & Psychophysics.

[45]  J R Dubno,et al.  Placement of observations for the efficient estimation of a psychometric function. , 1996, The Journal of the Acoustical Society of America.

[46]  Rolf Ulrich,et al.  Estimating discrimination performance in two-alternative forced choice tasks: Routines for MATLAB and R , 2012, Behavior Research Methods.

[47]  Richard F Murray,et al.  Classification images reveal decision variables and strategies in forced choice tasks , 2015, Proceedings of the National Academy of Sciences.

[48]  R. W. Kentridge,et al.  Contrasting the processes of texture segmentation and discrimination with static and phase-reversing stimuli , 2011, Vision Research.

[49]  Eli Peli,et al.  Thresholds vary between spatial and temporal forced-choice paradigms: the case of lateral interactions in peripheral vision. , 2005, Spatial vision.

[50]  Neil A. Macmillan,et al.  Detection theory: A user's guide, 2nd ed. , 2005 .

[51]  Nicholas A Steinmetz,et al.  Distinguishing bias from sensitivity effects in multialternative detection tasks. , 2013, Journal of vision.

[52]  A. Mitra,et al.  Topical, Aqueous, Clear Cyclosporine Formulation Design for Anterior and Posterior Ocular Delivery. , 2015, Translational vision science & technology.

[53]  M. García-Pérez,et al.  Shifts of the psychometric function: Distinguishing bias from perceptual effects , 2013, Quarterly journal of experimental psychology.

[54]  L. Allan.  The time-order error in judgments of duration. , 1977 .