An optimal adjustment procedure to minimize experiment time in decisions with multiple alternatives

Decisions between multiple alternatives typically conform to Hick’s Law: Mean response time increases log-linearly with the number of choice alternatives. We recently demonstrated context effects in Hick’s Law, showing that patterns of response latency and choice accuracy were different for easy versus difficult blocks. The context effect explained previously observed discrepancies in error rate data and provided a new challenge for theoretical accounts of multialternative choice. In the present article, we propose a novel approach to modeling context effects that can be applied to any account that models the speed–accuracy trade-off. The core element of the approach is “optimality” in the way an experimental participant might define it: minimizing the total time spent in the experiment, without making too many errors. We show how this approach can be included in an existing Bayesian model of choice and highlight its ability to fit previous data as well as to predict novel empirical context effects. The model is shown to provide better quantitative fits than a more flexible heuristic account.

[1]  Charles S. Myers,et al.  On reaction times. , 1909 .

[2]  J Ashe,et al.  Choice and stimulus-response compatibility affect duration of response selection. , 1999, Brain research. Cognitive brain research.

[3]  D. Meyer,et al.  Attention and Performance XIV , 1973 .

[4]  Richard D. Roberts,et al.  The relationship between intelligence and choice reaction time within the framework of an extended model of Hick's law: A preliminary report , 1994 .

[5]  D. F. Fisher,et al.  Hick's law and the speed-accuracy trade-off in absolute judgment , 1972 .

[6]  E. A. Alluisi,et al.  Some variables influencing the rate of gain of information. , 1962, Journal of experimental psychology.

[7]  W H Teichner,et al.  Laws of visual choice reaction time. , 1974, Psychological review.

[8]  Sam Behseta,et al.  On the Effects of Signal Acuity in a Multi-Alternative Model of Decision Making , 2010, Neural Computation.

[9]  Andrew M. Saxe,et al.  Acquisition of decision making criteria: reward rate ultimately beats accuracy , 2011, Attention, perception & psychophysics.

[10]  Venugopal V. Veeravalli,et al.  Multihypothesis sequential probability ratio tests - Part I: Asymptotic optimality , 1999, IEEE Trans. Inf. Theory.

[11]  Sungjin Lee,et al.  Prediction of the human response time with the similarity and quantity of information , 2006, Reliab. Eng. Syst. Saf..

[12]  Jonathan D. Cohen,et al.  The physics of optimal decision making: a formal analysis of models of performance in two-alternative forced-choice tasks. , 2006, Psychological review.

[13]  W. Gilchrist,et al.  Statistical Modelling with Quantile Functions , 2000 .

[14]  James L. McClelland,et al.  Hick's law in a stochastic race model with speed-accuracy tradeoffs , 2002 .

[15]  Venugopal V. Veeravalli,et al.  A sequential procedure for multihypothesis testing , 1994, IEEE Trans. Inf. Theory.

[16]  Scott D. Brown,et al.  Observing evidence accumulation during multi-alternative decisions , 2009 .

[17]  Venugopal V. Veeravalli,et al.  Multihypothesis sequential probability ratio tests - Part II: Accurate asymptotic expansions for the expected sample size , 2000, IEEE Trans. Inf. Theory.

[18]  G ten Hoopen,et al.  Vibrotactual choice reaction time, tactile receptor systems and ideomotor compatibility. , 1982, Acta psychologica.

[19]  Jay I. Myung,et al.  Global model analysis by parameter space partitioning. , 2019, Psychological review.

[20]  Charles Chubb,et al.  Visually guided, aimed movements can be unaffected by stimulus–response uncertainty , 2007, Experimental Brain Research.

[21]  P M Rabbitt,et al.  Repetition Effects and Signal Classification Strategies in Serial Choice-Response Tasks , 1968, The Quarterly journal of experimental psychology.

[22]  Sang Joon Kim,et al.  A Mathematical Theory of Communication , 2006 .

[23]  R. Hyman Stimulus information as a determinant of reaction time. , 1953, Journal of experimental psychology.

[24]  Leanne Boucher,et al.  Saccades operate in violation of Hick’s law , 2002, Experimental Brain Research.

[25]  David E. Meyer,et al.  Information, Time, and the Structure of Mental Events: A Twenty-Five-Year Review , 1993 .

[26]  David Hale,et al.  The relation of correct and error responses in a serial choice reaction task , 1968 .

[27]  Yves Lacouture,et al.  A mapping model of bow effects in absolute identification , 1995 .

[28]  Darryl W. Schneider,et al.  A memory-based model of Hick’s law , 2011, Cognitive Psychology.

[29]  R. Ratcliff,et al.  Modeling reaction time and accuracy of multiple-alternative decisions , 2010, Attention, perception & psychophysics.

[30]  Stephen J. Heinen,et al.  Properties of saccades generated as a choice response , 2005, Experimental Brain Research.

[31]  R. Ratcliff,et al.  The effects of aging on the speed-accuracy compromise: Boundary optimality in the diffusion model. , 2010, Psychology and aging.

[32]  W. E. Hick Quarterly Journal of Experimental Psychology , 1948, Nature.

[33]  Richard Schweickert Information, time, and the structure of mental events: a twenty-five-year review , 1993 .

[34]  Jonathan D. Cohen,et al.  Reward rate optimization in two-alternative decision making: empirical tests of theoretical predictions. , 2009, Journal of experimental psychology. Human perception and performance.

[35]  D. Hale Speed-error tradeoff in a three-choice serial reaction task. , 1969 .

[36]  Guy Hawkins,et al.  Context Effects in Multi-Alternative Decision Making: Empirical Data and a Bayesian Model , 2012, Cogn. Sci..