qPR: An adaptive partial-report procedure based on Bayesian inference

Iconic memory is best assessed with the partial report procedure in which an array of letters appears briefly on the screen and a poststimulus cue directs the observer to report the identity of the cued letter(s). Typically, 6–8 cue delays or 600–800 trials are tested to measure the iconic memory decay function. Here we develop a quick partial report, or qPR, procedure based on a Bayesian adaptive framework to estimate the iconic memory decay function with much reduced testing time. The iconic memory decay function is characterized by an exponential function and a joint probability distribution of its three parameters. Starting with a prior of the parameters, the method selects the stimulus to maximize the expected information gain in the next test trial. It then updates the posterior probability distribution of the parameters based on the observer's response using Bayesian inference. The procedure is reiterated until either the total number of trials or the precision of the parameter estimates reaches a certain criterion. Simulation studies showed that only 100 trials were necessary to reach an average absolute bias of 0.026 and a precision of 0.070 (both in terms of probability correct). A psychophysical validation experiment showed that estimates of the iconic memory decay function obtained with 100 qPR trials exhibited good precision (the half width of the 68.2% credible interval = 0.055) and excellent agreement with those obtained with 1,600 trials of the conventional method of constant stimuli procedure (RMSE = 0.063). Quick partial-report relieves the data collection burden in characterizing iconic memory and makes it possible to assess iconic memory in clinical populations.

[1]  C. Rowe,et al.  Amyloid imaging results from the Australian Imaging, Biomarkers and Lifestyle (AIBL) study of aging , 2010, Neurobiology of Aging.

[2]  Denise C. Park,et al.  Toward defining the preclinical stages of Alzheimer’s disease: Recommendations from the National Institute on Aging-Alzheimer's Association workgroups on diagnostic guidelines for Alzheimer's disease , 2011, Alzheimer's & Dementia.

[3]  Georgios Paliouras,et al.  Learning to Filter Spam E-Mail: A Comparison of a Naive Bayesian and a Memory-Based Approach , 2000, ArXiv.

[4]  David E. Irwin,et al.  Integrating visual information from successive fixations. , 1982, Science.

[5]  Richard C. Atkinson,et al.  Human Memory: A Proposed System and its Control Processes , 1968, Psychology of Learning and Motivation.

[6]  Jie W Weiss,et al.  Bayesian Statistical Inference for Psychological Research , 2008 .

[7]  Zhong-Lin Lu,et al.  Developing Bayesian adaptive methods for estimating sensitivity thresholds (d′) in Yes-No and forced-choice tasks , 2015, Front. Psychol..

[8]  J. Kruschke.  Doing Bayesian Data Analysis: A Tutorial with R and BUGS , 2010 .

[9]  C. Tyler,et al.  Bayesian adaptive estimation of psychometric slope and threshold , 1999, Vision Research.

[10]  Alan B. Cobo-Lewis,et al.  An adaptive psychophysical method for subject classification , 1997, Perception & psychophysics.

[11]  Tuomas J. Lukka,et al.  Bayesian adaptive estimation: The next dimension , 2006 .

[12]  P. King-Smith,et al.  Efficient and unbiased modifications of the QUEST threshold method: Theory, simulations, experimental evaluation and practical implementation , 1994, Vision Research.

[13]  Tg Tanner,et al.  Generalized adaptive procedure for psychometric measurement , 2008 .

[14]  B. Dosher,et al.  Fast decay of iconic memory in observers with mild cognitive impairments. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[15]  Michael Dorr,et al.  Rapid and reliable assessment of the contrast sensitivity function on an iPad. , 2013, Investigative ophthalmology & visual science.

[16]  A. P. Dawid.  Bayes's theorem and weighing evidence by juries , 2002 .

[17]  A. Watson,et al.  Quest: A Bayesian adaptive psychometric method , 1983, Perception & psychophysics.

[18]  M. Leek.  Adaptive procedures in psychophysical research , 2001, Perception & psychophysics.

[19]  Jay I. Myung,et al.  Optimal experimental design for model discrimination. , 2009, Psychological review.

[20]  B. Treutwein.  Adaptive psychophysical procedures , 1995, Vision Research.

[21]  Bernard Delyon,et al.  Accelerated Stochastic Approximation , 1993, SIAM J. Optim..

[22]  M. Graffar.  [Modern epidemiology]. , 1971, Bruxelles medical.

[23]  Gerald M. Long,et al.  Iconic memory: a review and critique of the study of short-term visual storage. , 1980, Psychological bulletin.

[24]  Douglas D Garrett,et al.  Neurocognitive markers of cognitive impairment: exploring the roles of speed and inconsistency. , 2007, Neuropsychology.

[25]  Keith A. Johnson,et al.  Amyloid imaging of alzheimer’s disease using pittsburgh compound B , 2006, Current Neurology and Neuroscience Reports.

[26]  M. Chong,et al.  Preclinical Alzheimer's disease: diagnosis and prediction of progression , 2005, The Lancet Neurology.

[27]  A. Lee,et al.  Vascular Dementia , 2011, Chonnam medical journal.

[28]  H. Spencer.  The Principles of Psychology - Vol. I , 2016 .

[29]  Heikki Lyytinen,et al.  A Bayesian-optimal principle for learner-friendly adaptation in learning games , 2010 .

[30]  Zhong-Lin Lu,et al.  Visual Psychophysics: From Laboratory to Theory , 2013 .

[31]  B. Rannala,et al.  Bayesian phylogenetic inference using DNA sequences: a Markov Chain Monte Carlo Method. , 1997, Molecular biology and evolution.

[32]  Luis A. Lesmes,et al.  Bayesian adaptive estimation of threshold versus contrast external noise functions: The quick TvC method , 2006, Vision Research.

[33]  Gina N. LaRossa,et al.  [11C]PIB in a nondemented population , 2006, Neurology.

[34]  G. Sperling.  A Model for Visual Memory Tasks1 , 1963, Human factors.

[35]  Zhong-Lin Lu,et al.  Bayesian adaptive estimation of the contrast sensitivity function: the quick CSF method. , 2010, Journal of vision.

[36]  D. Altman,et al.  Measuring agreement in method comparison studies , 1999, Statistical methods in medical research.

[37]  Chang-Bing Huang,et al.  qCSF in clinical application: efficient characterization and classification of contrast sensitivity functions in amblyopia. , 2010, Investigative ophthalmology & visual science.

[38]  A. O. Dick.  Iconic memory and its relation to perceptual processing and other memory mechanisms , 1974 .

[39]  G M Long,et al.  Iconic memory: a review and critique of the study of short-term visual storage. , 1980, Psychological bulletin.

[40]  Bradley P. Carlin,et al.  Bayesian Adaptive Methods for Clinical Trials , 2010 .

[41]  Mark A. Pitt,et al.  A Hierarchical Adaptive Approach to Optimal Experimental Design , 2014, Neural Computation.

[42]  M. D’Esposito.  Working memory. , 2008, Handbook of clinical neurology.

[43]  Cyrus Derman,et al.  Non-Parametric Up-and-down Experimentation , 1957 .

[44]  R. Wilton.  The Psychology of Learning and Motivation: Advances in Research and Theory. Vol 4. , 1972 .

[45]  Mark A. Pitt,et al.  Adaptive Design Optimization: A Mutual Information-Based Approach to Model Discrimination in Cognitive Science , 2010, Neural Computation.

[46]  George Sperling,et al.  The information available in brief visual presentations. , 1960 .

[47]  William G. Chase,et al.  Short-term visual storage , 1967 .

[48]  N. Prins.  The psi-marginal adaptive method: How to give nuisance parameters the attention they deserve (no more, no less). , 2013, Journal of vision.

[49]  Robert Miller,et al.  Decay of iconic memory traces is related to psychometric intelligence: A fixed-links modeling approach , 2010 .

[50]  Richard A. Tyrrell,et al.  A rapid technique to assess the resting states of the eyes and other threshold phenomena: The Modified Binary Search (MOBS) , 1988 .

[51]  D G Pelli,et al.  The VideoToolbox software for visual psychophysics: transforming numbers into movies. , 1997, Spatial vision.

[52]  H. Robbins.  A Stochastic Approximation Method , 1951 .

[53]  J. Weuve,et al.  Alzheimer disease in the United States (2010–2050) estimated using the 2010 census , 2013, Neurology.

[54]  G. Sperling,et al.  Successive approximations to a model for short term memory. , 1967, Acta psychologica.

[55]  Vincent Di Lollo,et al.  Temporal integration in visual memory. , 1980, Journal of experimental psychology. General.

[56]  Rocío Alcalá-Quintana,et al.  Stopping rules in Bayesian adaptive threshold estimation. , 2005, Spatial vision.

[57]  Hairong Gu.  Graphic-Processing-Units Based Adaptive Parameter Estimation of a Visual Psychophysical Model , 2012 .

[58]  D. Spalding.  The Principles of Psychology , 1873, Nature.

[59]  D H Brainard,et al.  The Psychophysics Toolbox. , 1997, Spatial vision.

[60]  Michael Dorr,et al.  Next-generation vision testing: the quick CSF , 2015 .

[61]  M. M. Taylor,et al.  PEST: Efficient Estimates on Probability Functions , 1967 .

[62]  C Kaernbach,et al.  Simple adaptive testing with the weighted up-down method , 1991, Perception & psychophysics.

[63]  Michael Dorr,et al.  Using 10AFC to further improve the efficiency of the quick CSF method. , 2015, Journal of vision.

[64]  A. C. Davison,et al.  Statistical models: Name Index , 2003 .

[65]  Jay I. Myung,et al.  A hierarchical Bayesian approach to adaptive vision testing: A case study with the contrast sensitivity function , 2016, Journal of vision.

[66]  Yaakov Stern,et al.  Promising developments in neuropsychological approaches for the detection of preclinical Alzheimer’s disease: a selective review , 2013, Alzheimer's Research & Therapy.

[67]  Leah Blau,et al.  Statistical Models In Epidemiology , 2016 .

[68]  H. Levitt.  Transformed up-down methods in psychoacoustics. , 1971, The Journal of the Acoustical Society of America.

[69]  Mark W. Becker,et al.  The Role of Iconic Memory in Change-Detection Tasks , 2000, Perception.

[70]  E. Averbach,et al.  Short-term memory in vision , 1961 .

[71]  M. Eden,et al.  Note on Short Term Storage of Information in Vision , 1964, Perceptual and motor skills.

[72]  Sang Joon Kim,et al.  A Mathematical Theory of Communication , 2006 .

[73]  M. Coltheart,et al.  Iconic memory and visible persistence , 1980, Perception & psychophysics.

[74]  Bengt Winblad,et al.  Health Economics of Severe Dementia , 2006 .

[75]  Gina N. LaRossa,et al.  Inverse relation between in vivo amyloid imaging load and cerebrospinal fluid Aβ42 in humans , 2006, Annals of neurology.