Decisions about objects in real-world scenes are influenced by visual saliency before and during their inspection

Evidence from eye-tracking experiments has provided mixed support for saliency map models of inspection, with the task set for the viewer accounting for some of the discrepancies between predictions and observations. In the present experiment viewers inspected pictures of road scenes with the task being to decide whether or not they would enter a highway from a junction. Road safety observations have concluded that highly visible road users are less likely to be involved in crashes, suggesting that saliency is important in real-world tasks. The saliency of a critical vehicle was varied in the present task, as was the type of vehicle and the preferred vehicle of the viewer. Decisions were influenced by saliency, with more risky decisions when low saliency motorcycles were present. Given that the vehicles were invariably inspected, this may relate to the high incidence of "looked-but-failed-to-see" crashes involving motorcycles and to prevalence effects in visual search. Eye-tracking measures indicated effects of saliency on the fixation preceding inspection of the critical vehicle (as well as effects on inspection of the vehicle itself), suggesting that high saliency can attract an early fixation. These results have implications for recommendations about the conspicuity of vulnerable road users.

[1]  G. A. Thomson,et al.  The role frontal motorcycle conspicuity has in road accidents , 1980 .

[2]  T. Foulsham,et al.  How Does the Purpose of Inspection Influence the Potency of Visual Salience in Scene Perception? , 2007, Perception.

[3]  Asha Iyer,et al.  Components of bottom-up gaze allocation in natural images , 2005, Vision Research.

[4]  Derrick J. Parkhurst,et al.  Modeling the role of salience in the allocation of overt visual attention , 2002, Vision Research.

[5]  T. Foulsham,et al.  What can saliency models predict about eye movements? Spatial and sequential aspects of fixations during encoding and recognition. , 2008, Journal of vision.

[6]  P L Zador,et al.  Motorcycle headlight-use laws and fatal motorcycle crashes in the US, 1975-83. , 1985, American journal of public health.

[7]  Alan Kennedy,et al.  Parafoveal Processing in Word Recognition , 2000, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[8]  G. Underwood,et al.  Domain knowledge moderates the influence of visual saliency in scene recognition. , 2009, British journal of psychology.

[9]  T. Foulsham,et al.  Quarterly Journal of Experimental Psychology: in press Visual saliency and semantic incongruency influence eye movements when , 2022 .

[10]  David Crundall,et al.  Attending overtaking cars and motorcycles through the mirrors before changing lanes. , 2012, Accident; analysis and prevention.

[11]  G. Underwood,et al.  Low-level visual saliency does not predict change detection in natural scenes. , 2007, Journal of vision.

[12]  Iain D. Gilchrist,et al.  Visual correlates of fixation selection: effects of scale and time , 2005, Vision Research.

[13]  David D Clarke,et al.  The role of motorcyclist and other driver behaviour in two types of serious accident in the UK. , 2007, Accident; analysis and prevention.

[14]  T. Foulsham,et al.  Is attention necessary for object identification? Evidence from eye movements during the inspection of real-world scenes , 2008, Consciousness and Cognition.

[15]  P. König,et al.  Does luminance‐contrast contribute to a saliency map for overt visual attention? , 2003, The European journal of neuroscience.

[16]  Jeremy M. Wolfe,et al.  26.5 brief comms NEW , 2005 .

[17]  M. Eckstein,et al.  Optimal observer model of single-fixation oddity search predicts a shallow set-size function. , 2007, Journal of vision.

[18]  J. Pelz,et al.  Oculomotor behavior and perceptual strategies in complex tasks , 2001, Vision Research.

[19]  T. Foulsham,et al.  Saliency and scan patterns in the inspection of real-world scenes: Eye movements during encoding and recognition , 2009 .

[20]  F. Hamker,et al.  About the influence of post-saccadic mechanisms for visual stability on peri-saccadic compression of object location. , 2008, Journal of vision.

[21]  T. Foulsham,et al.  Eye movements during scene inspection: A test of the saliency map hypothesis , 2006 .

[22]  R Elvik.  The effects on accidents of compulsory use of daytime running lights for cars in Norway. , 1993, Accident; analysis and prevention.

[23]  Elizabeth Crundall,et al.  Why do car drivers fail to give way to motorcycles at t-junctions? , 2012, Accident; analysis and prevention.

[24]  P. Viviani,et al.  Saccadic eye movements to peripherally discriminated visual targets. , 1982, Journal of experimental psychology. Human perception and performance.

[25]  L. Stark,et al.  Most naturally occurring human saccades have magnitudes of 15 degrees or less. , 1975, Investigative ophthalmology.

[26]  A. L. I︠A︡rbus.  Eye Movements and Vision , 1967 .

[27]  Susan L. Franzel,et al.  Guided search: an alternative to the feature integration model for visual search. , 1989, Journal of experimental psychology. Human perception and performance.

[28]  C. Koch,et al.  Task-demands can immediately reverse the effects of sensory-driven saliency in complex visual stimuli. , 2008, Journal of vision.

[29]  Michael L. Mack,et al.  VISUAL SALIENCY DOES NOT ACCOUNT FOR EYE MOVEMENTS DURING VISUAL SEARCH IN REAL-WORLD SCENES , 2007 .

[30]  D. Wright.  Behavioural research in road safety VII , 1998 .

[31]  Robin L. Hill,et al.  Eye movements : a window on mind and brain , 2007 .

[32]  I D Brown,et al.  A REVIEW OF THE 'LOOKED BUT FAILED TO SEE' ACCIDENT CAUSATION FACTOR , 2002 .

[33]  Cynthia Owsley,et al.  Vision and driving , 2010, Vision Research.

[34]  Vision Research , 1961, Nature.

[35]  Michael Sivak,et al.  The Effect of Improvements in Motorcycle/Motorcyclist Conspicuity on Driver Behavior , 1981 .

[36]  T. Foulsham,et al.  Short article: Does conspicuity enhance distraction? Saliency and eye landing position when searching for objects , 2009, Quarterly journal of experimental psychology.

[37]  W Yuan,et al.  The effectiveness of the 'ride-bright' legislation for motorcycles in Singapore. , 2000, Accident; analysis and prevention.

[38]  A. L. Yarbus,et al.  Eye Movements and Vision , 1967, Springer US.

[39]  Naomi M. Kenner,et al.  Low target prevalence is a stubborn source of errors in visual search tasks. , 2007, Journal of experimental psychology. General.

[40]  B. Velichkovsky,et al.  Time course of information processing during scene perception: The relationship between saccade amplitude and fixation duration , 2005 .

[41]  J. Wolfe,et al.  Guided Search 2.0 A revised model of visual search , 1994, Psychonomic bulletin & review.

[42]  C. Koch,et al.  A saliency-based search mechanism for overt and covert shifts of visual attention , 2000, Vision Research.

[43]  Simon G Hosking,et al.  The visual search patterns and hazard responses of experienced and inexperienced motorcycle riders. , 2010, Accident; analysis and prevention.

[44]  Alessandra Marinoni,et al.  Are car drivers holding a motorcycle licence less responsible for motorcycle--car crash occurrence? A non-parametric approach. , 2006, Accident; analysis and prevention.