Algorithm for improving psychophysical threshold estimates by detecting sustained inattention in experiments using PEST

Psychophysical procedures are applied in various fields to assess sensory thresholds. During experiments, sampled psychometric functions are usually assumed to be stationary. However, perception can be altered, for example by loss of attention to the presentation of stimuli, leading to biased data, which results in poor threshold estimates. The few existing approaches attempting to identify non-stationarities either detect only whether there was a change in perception, or are not suitable for experiments with a relatively small number of trials (e.g., <$<$ 300). We present a method to detect inattention periods on a trial-by-trial basis with the aim of improving threshold estimates in psychophysical experiments using the adaptive sampling procedure Parameter Estimation by Sequential Testing (PEST). The performance of the algorithm was evaluated in computer simulations modeling inattention, and tested in a behavioral experiment on proprioceptive difference threshold assessment in 20 stroke patients, a population where attention deficits are likely to be present. Simulations showed that estimation errors could be reduced by up to 77% for inattentive subjects, even in sequences with less than 100 trials. In the behavioral data, inattention was detected in 14% of assessments, and applying the proposed algorithm resulted in reduced test–retest variability in 73% of these corrected assessments pairs. The novel algorithm complements existing approaches and, besides being applicable post hoc, could also be used online to prevent collection of biased data. This could have important implications in assessment practice by shortening experiments and improving estimates, especially for clinical settings.

[1]  A. V. Zomeren,et al.  Residual complaints of patients two years after severe head injury. , 1985 .

[2]  G. Mead,et al.  Frequency and natural history of fatigue after stroke: a systematic review of longitudinal studies. , 2012, Journal of psychosomatic research.

[3]  W. F. Prokasy,et al.  Electrodermal Activity in Psychological Research , 1973 .

[4]  Nicolaas Prins,et al.  The psychometric function: the lapse rate revisited. , 2012, Journal of vision.

[5]  Yi Shen,et al.  A maximum-likelihood procedure for estimating psychometric functions: thresholds, slopes, and lapses of attention. , 2012, The Journal of the Acoustical Society of America.

[6]  Jürgen Konczak,et al.  Assessing Proprioceptive Function: Evaluating Joint Position Matching Methods Against Psychophysical Thresholds , 2013, Physical Therapy.

[7]  P. King-Smith,et al.  Efficient and unbiased modifications of the QUEST threshold method: Theory, simulations, experimental evaluation and practical implementation , 1994, Vision Research.

[8]  R. Harden,et al.  A Practical Guide for Medical Teachers , 2017 .

[9]  M R Leek,et al.  An interleaved tracking procedure to monitor unstable psychometric functions. , 1991, The Journal of the Acoustical Society of America.

[10]  D M Green,et al.  Maximum-likelihood procedures and the inattentive observer. , 1995, The Journal of the Acoustical Society of America.

[11]  Ingo Fründ,et al.  Inference for psychometric functions in the presence of nonstationary behavior. , 2011, Journal of vision.

[12]  J. Bollinger Bollinger on Bollinger Bands , 2001 .

[13]  M. García-Pérez,et al.  Forced-choice staircases with fixed step sizes: asymptotic and small-sample properties , 1998, Vision Research.

[14]  Neil A. Macmillan,et al.  Detection Theory: A User's Guide , 1991 .

[15]  J. L. Hall A procedure for detecting variability of psychophysical thresholds , 1981 .

[16]  Donna Fry-Welch,et al.  Age-Related Changes in Upper Extremity Kinesthesis , 2003 .

[17]  P.EWEN KING-SMITH,et al.  PII: S0042-6989(96)00310-0 , 1997 .

[18]  C. Tyler,et al.  Bayesian adaptive estimation of psychometric slope and threshold , 1999, Vision Research.

[19]  Olivier Lambercy,et al.  Age-based model for metacarpophalangeal joint proprioception in elderly , 2017, Clinical interventions in aging.

[20]  H Strasburger,et al.  Converting between measures of slope of the psychometric function , 2001, Perception & psychophysics.

[21]  Y. Matsuoka,et al.  Perceptual limits for a robotic rehabilitation environment using visual feedback distortion , 2005, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[22]  Marleen H De Groot,et al.  Fatigue associated with stroke and other neurologic conditions: Implications for stroke rehabilitation. , 2003, Archives of physical medicine and rehabilitation.

[23]  Pankaj Sharma,et al.  Triple dissociation of attention networks in stroke according to lesion location , 2013, Neurology.

[24]  H. Strasburger,et al.  Fitting the psychometric function , 1999, Perception & psychophysics.

[25]  W. Swanson,et al.  Extracting thresholds from noisy psychophysical data , 1992, Perception & psychophysics.

[26]  M. Carrasco,et al.  Covert attention affects the psychometric function of contrast sensitivity , 2002, Vision Research.

[27]  C S Watson,et al.  Time course of auditory perceptual learning. , 1980, The Annals of otology, rhinology & laryngology. Supplement.

[28]  R. C. Oldfield The assessment and analysis of handedness: the Edinburgh inventory. , 1971, Neuropsychologia.

[29]  F A Wichmann,et al.  Ning for Helpful Comments and Suggestions. This Paper Benefited Con- Siderably from Conscientious Peer Review, and We Thank Our Reviewers the Psychometric Function: I. Fitting, Sampling, and Goodness of Fit , 2001 .

[30]  J. Konczak,et al.  Robot-Aided Assessment of Wrist Proprioception , 2015, Front. Hum. Neurosci..

[31]  M. Mon-Williams,et al.  Motor Control and Learning , 2006 .

[32]  J. Maunsell,et al.  When Attention Wanders: How Uncontrolled Fluctuations in Attention Affect Performance , 2011, The Journal of Neuroscience.

[33]  Hong Z. Tan,et al.  Discrimination and identification of finger joint-angle position using active motion , 2007, TAP.

[34]  G. Gescheider Psychophysics: The Fundamentals , 1997 .

[35]  Olivier Lambercy,et al.  Experimental Validation of a Rapid, Adaptive Robotic Assessment of the MCP Joint Angle Difference Threshold , 2014, EuroHaptics.

[36]  M. M. Taylor On the efficiency of psychophysical measurement. , 1971, The Journal of the Acoustical Society of America.

[37]  P. Veltink,et al.  Observation of time-dependent psychophysical functions and accounting for threshold drifts , 2015, Attention, perception & psychophysics.

[38]  Virginia M. Richards,et al.  Stimulus step size and heterogeneous stimulus conditions in adaptive psychophysics , 1989 .

[39]  Olivier Lambercy,et al.  Assessment-driven selection and adaptation of exercise difficulty in robot-assisted therapy: a pilot study with a hand rehabilitation robot , 2014, Journal of NeuroEngineering and Rehabilitation.

[40]  Julien Bogousslavsky,et al.  Fatigue after Stroke: A Major but Neglected Issue , 2001, Cerebrovascular Diseases.

[41]  J. L. Hall Hybrid adaptive procedure for estimation of psychometric functions. , 1980 .

[42]  H J Meeuwsen,et al.  On the Psycho Physics of Arm-Positioning Movements , 1995, Perceptual and motor skills.

[43]  M. M. Taylor,et al.  PEST: Efficient Estimates on Probability Functions , 1967 .

[44]  Geoffrey Petty Teaching Today: A Practical Guide , 1993 .

[45]  M. Carrasco,et al.  Attention alters appearance , 2004, Nature Neuroscience.

[46]  B Kollmeier,et al.  Adaptive staircase techniques in psychoacoustics: a comparison of human data and a mathematical model. , 1988, The Journal of the Acoustical Society of America.

[47]  H. Levitt Transformed up-down methods in psychoacoustics. , 1971, The Journal of the Acoustical Society of America.

[48]  S. McKee,et al.  Statistical properties of forced-choice psychometric functions: Implications of probit analysis , 1985, Perception & psychophysics.

[49]  O. Parsons,et al.  Continuous reaction time in brain damage. , 1971, Cortex; a journal devoted to the study of the nervous system and behavior.

[50]  Neil A. Macmillan,et al.  Detection theory: A user's guide, 2nd ed. , 2005 .

[51]  Joan López-Moliner,et al.  quickpsy: An R Package to Fit Psychometric Functions for Multiple Groups , 2016, R J..

[52]  Karen A. Wilson,et al.  Attention during Lectures: Beyond Ten Minutes , 2007 .

[53]  M. Carrasco Covert attention increases contrast sensitivity: Psychophysical, neurophysiological and neuroimaging studies. , 2006, Progress in brain research.

[54]  N. Prins The psi-marginal adaptive method: How to give nuisance parameters the attention they deserve (no more, no less). , 2013, Journal of vision.

[55]  C. Kaernbach Adaptive threshold estimation with unforced-choice tasks , 2001, Perception & psychophysics.

[56]  Olivier Lambercy,et al.  Design of a robotic device for assessment and rehabilitation of hand sensory function , 2011, 2011 IEEE International Conference on Rehabilitation Robotics.

[57]  Pamela W. Duncan,et al.  Post-stroke rehabilitation: Assessment, referral, and patient management: Quick reference guide for clinicians , 1996 .

[58]  M. Leek Adaptive procedures in psychophysical research , 2001, Perception & psychophysics.

[59]  B. Treutwein Adaptive psychophysical procedures , 1995, Vision Research.