Serial dependence in a simulated clinical visual search task

In everyday life, we continuously search for and classify objects in the environment around us. This kind of visual search is extremely important when performed by radiologists in cancer image interpretation and officers in airport security screening. During these tasks, observers often examine large numbers of uncorrelated images (tumor x-rays, checkpoint x-rays, etc.) one after another. An underlying assumption of such tasks is that search and recognition are independent of our past experience. Here, we simulated a visual search task reminiscent of medical image search and found that shape classification performance was strongly impaired by recent visual experience, biasing classification errors 7% more towards the previous image content. This perceptual attraction exhibited the three main tuning characteristics of Continuity Fields: serial dependence extended over 12 seconds back in time (temporal tuning), it occurred only between similar tumor-like shapes (feature tuning), and only within a limited spatial region (spatial tuning). Taken together, these results demonstrate that serial dependence influences shape perception and occurs in visual search tasks. They also raise the possibility of a detrimental impact of serial dependence in clinical and practically relevant settings, such as medical image perception.

[1]  David Whitney,et al.  Facilitating Stable Representations: Serial Dependence in Vision , 2011, PloS one.

[2]  Harold L. Kundel,et al.  Reader error, object recognition, and visual search , 2004, SPIE Medical Imaging.

[3]  Masaaki Kawahashi,et al.  Renovation of Journal of Visualization , 2010, J. Vis..

[4]  J. Wolfe,et al.  Varying Target Prevalence Reveals Two Dissociable Decision Criteria in Visual Search , 2010, Current Biology.

[5]  Claus Bundesen,et al.  Independent priming of location and color in identification of briefly presented letters , 2014, Attention, perception & psychophysics.

[6]  H L Kundel,et al.  Finding lung nodules with and without comparative visual scanning , 1981, Perception & psychophysics.

[7]  Kyriaki Mikellidou,et al.  The functional role of serial dependence , 2018, Proceedings of the Royal Society B.

[8]  Miguel P Eckstein,et al.  Visual search: a retrospective. , 2011, Journal of vision.

[9]  Ehsan Samei,et al.  Generalized "satisfaction of search": adverse influences on dual-target search accuracy. , 2010, Journal of experimental psychology. Applied.

[10]  M. Georgeson,et al.  Binocular contrast vision at and above threshold. , 2006, Journal of vision.

[11]  K. Nakayama,et al.  Priming of pop-out: II. The role of position , 1996, Perception & psychophysics.

[12]  Anina N. Rich,et al.  Why do we miss rare targets? Exploring the boundaries of the low prevalence effect. , 2008, Journal of vision.

[13]  A. Bovik,et al.  Visual search in noise: revealing the influence of structural cues by gaze-contingent classification image analysis. , 2006, Journal of vision.

[14]  H L Kundel,et al.  Medical image perception. , 1995, Academic radiology.

[15]  Jeremy M Wolfe,et al.  Prevalence of abnormalities influences cytologists' error rates in screening for cervical cancer. , 2011, Archives of pathology & laboratory medicine.

[16]  G. Campana,et al.  Priming of first- and second-order motion: Mechanisms and neural substrates , 2008, Neuropsychologia.

[17]  Daniel P. Bliss,et al.  Serial Dependence across Perception, Attention, and Memory , 2017, Trends in Cognitive Sciences.

[18]  Serial correlations in Continuous Flash Suppression , 2015, Neuroscience of consciousness.

[19]  Stefanie I. Becker,et al.  The mechanism of priming: episodic retrieval or priming of pop-out? , 2008, Acta psychologica.

[20]  Árni Kristjánsson,et al.  Priming of Color and Position during Visual Search in Unilateral Spatial Neglect , 2005, Journal of Cognitive Neuroscience.

[21]  Jillian H. Fecteau,et al.  Priming of pop-out depends upon the current goals of observers. , 2007, Journal of vision.

[22]  Alastair G. Gale,et al.  Diagnostic performance on briefly presented mammographic images , 1995, Medical Imaging.

[23]  David Alais,et al.  Different coding strategies for the perception of stable and changeable facial attributes , 2016, Scientific Reports.

[24]  F. D. Lange,et al.  Opposite Effects of Recent History on Perception and Decision , 2017, Current Biology.

[25]  Elizabeth A Krupinski,et al.  The role of perception in imaging: past and future. , 2011, Seminars in nuclear medicine.

[26]  D. Whitney,et al.  Serial Dependence in the Perception of Faces , 2014, Current Biology.

[27]  D H Brainard,et al.  The Psychophysics Toolbox. , 1997, Spatial vision.

[28]  J W Oestmann,et al.  Lung lesions: correlation between viewing time and detection. , 1988, Radiology.

[29]  Katsumi Aoki,et al.  Recent development of flow visualization , 2004, J. Vis..

[30]  J. Kaiser,et al.  Two types of serial dependence in visual working memory. , 2018, British journal of psychology.

[31]  Jeremy M. Wolfe,et al.  26.5 brief comms NEW , 2005 .

[32]  P. Mamassian,et al.  Persistent states in vision break universality and time invariance , 2015, Proceedings of the National Academy of Sciences.

[33]  Oliver Braddick,et al.  Can speed be judged independent of direction? , 2017, Journal of vision.

[34]  D. Whitney,et al.  Serial dependence promotes object stability during occlusion , 2016, Journal of vision.

[35]  Naomi M. Kenner,et al.  Low target prevalence is a stubborn source of errors in visual search tasks. , 2007, Journal of experimental psychology. General.

[36]  Warrick Roseboom,et al.  SERIAL DEPENDENCE IN VISUAL VARIANCE , 2018 .

[37]  K S Berbaum,et al.  Role of faulty visual search in the satisfaction of search effect in chest radiography. , 1998, Academic radiology.

[38]  Arthur F Kramer,et al.  Visual Skills in Airport-Security Screening , 2004, Psychological science.

[39]  Adam T. Biggs,et al.  The Ultra-Rare-Item Effect , 2014, Psychological science.

[40]  Satoru Suzuki,et al.  Understanding priming of color-singleton search: Roles of attention at encoding and “retrieval” , 2001, Perception & psychophysics.

[41]  Trafton Drew,et al.  Informatics in radiology: what can you see in a single glance and how might this guide visual search in medical images? , 2013, Radiographics : a review publication of the Radiological Society of North America, Inc.

[42]  Kyriaki Mikellidou,et al.  Serial dependencies act directly on perception. , 2017, Journal of vision.

[43]  Kohsei Takehara,et al.  Time-resolved visualization of shock–vortex systems emitted from an open shock tube , 2010, J. Vis..

[44]  Jeremy M Wolfe,et al.  A half-second glimpse often lets radiologists identify breast cancer cases even when viewing the mammogram of the opposite breast , 2016, Proceedings of the National Academy of Sciences.

[45]  Joonkoo Park,et al.  Serial dependence in numerosity perception , 2018, Journal of vision.

[46]  A. Chetverikov,et al.  Building ensemble representations: How the shape of preceding distractor distributions affects visual search , 2016, Cognition.

[47]  M. Webster,et al.  Adaptation Aftereffects in the Perception of Radiological Images , 2012, PloS one.

[48]  D. Whitney,et al.  Serial dependence in visual perception , 2011 .

[49]  H L Kundel,et al.  Interpreting chest radiographs without visual search. , 1975, Radiology.

[50]  Karla K. Evans,et al.  If You Don’t Find It Often, You Often Don’t Find It: Why Some Cancers Are Missed in Breast Cancer Screening , 2013, PloS one.

[51]  Pia Rotshtein,et al.  On-line attentional selection from competing stimuli in opposite visual fields: effects on human visual cortex and control processes. , 2006, Journal of neurophysiology.

[52]  Nick Donnelly,et al.  High or low target prevalence increases the dual-target cost in visual search. , 2010, Journal of experimental psychology. Applied.

[53]  David Whitney,et al.  Serial dependence in the perception of attractiveness , 2015, Journal of vision.

[54]  M. Webster,et al.  Adaptation and visual search in mammographic images , 2015, Attention, Perception, & Psychophysics.

[55]  Randolph Blake,et al.  Deciding where to attend: priming of pop-out drives target selection. , 2011, Journal of experimental psychology. Human perception and performance.

[56]  Wilson S. Geisler,et al.  Optimal eye movement strategies in visual search , 2005, Nature.

[57]  G. Rhodes,et al.  Face familiarity promotes stable identity recognition: exploring face perception using serial dependence , 2017, Royal Society Open Science.

[58]  D. Whitney,et al.  Serial Dependence of Position Perception , 2014 .

[59]  Á. Kristjánsson,et al.  Attentional priming: recent insights and current controversies. , 2019, Current opinion in psychology.

[60]  Joonkoo Park,et al.  Attractive Serial Dependence in the Absence of an Explicit Task , 2018, Psychological science.

[61]  Todd S. Horowitz,et al.  Prevalence in Visual Search: From the Clinic to the Lab and Back Again , 2017 .

[62]  The challenge of measuring long-term positive aftereffects , 2013, Current Biology.

[63]  D. Burr,et al.  Compressive mapping of number to space reflects dynamic encoding mechanisms, not static logarithmic transform , 2014, Proceedings of the National Academy of Sciences.

[64]  D. Alais,et al.  Serial dependence in face attractiveness judgements tolerates rotations around the yaw axis but not the roll axis , 2016 .

[65]  David Whitney,et al.  The perceived stability of scenes: serial dependence in ensemble representations , 2017, Scientific Reports.

[66]  Dominique Lamy,et al.  Priming of Pop-out provides reliable measures of target activation and distractor inhibition in selective attention , 2008, Vision Research.

[67]  Gianluca Campana,et al.  Repetition effects of features and spatial position: evidence for dissociable mechanisms. , 2009, Spatial vision.

[68]  D. Burr,et al.  Vision: Efficient Adaptive Coding , 2014, Current Biology.

[69]  Árni Kristjánsson,et al.  Rapid learning of visual ensembles. , 2017, Journal of vision.

[70]  Miguel P Eckstein,et al.  Saccadic and perceptual performance in visual search tasks. I. Contrast detection and discrimination. , 2003, Journal of the Optical Society of America. A, Optics, image science, and vision.

[71]  Trafton Drew,et al.  HOW DO RADIOLOGISTS USE THE HUMAN SEARCH ENGINE? , 2016, Radiation protection dosimetry.

[72]  Gianluca Campana,et al.  Left frontal eye field remembers “where” but not “what” , 2007, Neuropsychologia.

[73]  E A Krupinski,et al.  Perception research in medical imaging. , 2005, The British journal of radiology.

[74]  C. Chabris,et al.  Gorillas in Our Midst: Sustained Inattentional Blindness for Dynamic Events , 1999, Perception.

[75]  Leonardo Chelazzi,et al.  Laws of concatenated perception: Vision goes for novelty, decisions for perseverance , 2017, bioRxiv.

[76]  Joseph Krummenacher,et al.  Cross-trial priming of element positions in visual pop-out search is dependent on stimulus arrangement. , 2007, Journal of experimental psychology. Human perception and performance.

[77]  David Alais,et al.  Linear Summation of Repulsive and Attractive Serial Dependencies: Orientation and Motion Dependencies Sum in Motion Perception , 2017, The Journal of Neuroscience.

[78]  Jon Driver,et al.  Repetition streaks increase perceptual sensitivity in visual search of brief displays , 2008, Visual cognition.

[79]  K. Berbaum,et al.  Satisfaction of search in diagnostic radiology. , 1989, Investigative radiology.

[80]  Daniel P. Bliss,et al.  Serial dependence is absent at the time of perception but increases in visual working memory , 2017, bioRxiv.

[81]  Steven B. Most,et al.  What you see is what you set: sustained inattentional blindness and the capture of awareness. , 2005, Psychological review.

[82]  Trafton Drew,et al.  Scanners and drillers: characterizing expert visual search through volumetric images. , 2013, Journal of vision.

[83]  J. Wolfe,et al.  The Invisible Gorilla Strikes Again , 2013, Psychological science.

[84]  Jeremy M Wolfe,et al.  Prevalence effects in newly trained airport checkpoint screeners: trained observers miss rare targets, too. , 2013, Journal of vision.

[85]  D. Whitney,et al.  Serial dependence in position occurs at the time of perception , 2018, Psychonomic Bulletin & Review.

[86]  K. Nakayama,et al.  Priming of pop-out: I. Role of features , 1994, Memory & cognition.

[87]  A. Treisman.  Perceiving and re-perceiving objects. , 1992, The American psychologist.