Evolution and Optimality of Similar Neural Mechanisms for Perception and Action during Search

A prevailing theory proposes that the brain's two visual pathways, the ventral and dorsal, lead to differing visual processing and world representations for conscious perception than those for action. Others have claimed that perception and action share much of their visual processing. But which of these two neural architectures is favored by evolution? Successful visual search is life-critical and here we investigate the evolution and optimality of neural mechanisms mediating perception and eye movement actions for visual search in natural images. We implement an approximation to the ideal Bayesian searcher with two separate processing streams, one controlling the eye movements and the other stream determining the perceptual search decisions. We virtually evolved the neural mechanisms of the searchers' two separate pathways built from linear combinations of primary visual cortex receptive fields (V1) by making the simulated individuals' probability of survival depend on the perceptual accuracy finding targets in cluttered backgrounds. We find that for a variety of targets, backgrounds, and dependence of target detectability on retinal eccentricity, the mechanisms of the searchers' two processing streams converge to similar representations showing that mismatches in the mechanisms for perception and eye movements lead to suboptimal search. Three exceptions which resulted in partial or no convergence were a case of an organism for which the targets are equally detectable across the retina, an organism with sufficient time to foveate all possible target locations, and a strict two-pathway model with no interconnections and differential pre-filtering based on parvocellular and magnocellular lateral geniculate cell properties. Thus, similar neural mechanisms for perception and eye movement actions during search are optimal and should be expected from the effects of natural selection on an organism with limited time to search for food that is not equi-detectable across its retina and interconnected perception and action neural pathways.

[1]  Karl R Gegenfurtner,et al.  Grasping visual illusions: Consistent data and no dissociation , 2008, Cognitive neuropsychology.

[2]  Miguel P Eckstein,et al.  Saccadic and perceptual performance in visual search tasks. I. Contrast detection and discrimination. , 2003, Journal of the Optical Society of America. A, Optics, image science, and vision.

[3]  Eli Brenner,et al.  Flexibility in intercepting moving objects. , 2007, Journal of vision.

[4]  T Moore,et al.  Shape representations and visual guidance of saccadic eye movements. , 1999, Science.

[5]  J. V. van Hateren,et al.  Independent component filters of natural images compared with simple cells in primary visual cortex , 1998, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[6]  Robert M. McPeek,et al.  Deficits in saccade target selection after inactivation of superior colliculus , 2004, Nature Neuroscience.

[7]  R. Andersen,et al.  Coding of intention in the posterior parietal cortex , 1997, Nature.

[8]  Wilson S. Geisler,et al.  Optimal eye movement strategies in visual search , 2005, Nature.

[9]  D. M. Green,et al.  Signal detection theory and psychophysics , 1966 .

[10]  Miguel P Eckstein,et al.  Similar Neural Representations of the Target for Saccades and Perception during Search , 2007, The Journal of Neuroscience.

[11]  H. Sakata,et al.  The TINS Lecture The parietal association cortex in depth perception and visual control of hand action , 1997, Trends in Neurosciences.

[12]  G. Legge,et al.  Mr. Chips: an ideal-observer model of reading. , 1997, Psychological review.

[13]  Preeti Verghese,et al.  The psychophysics of visual search , 2000, Vision Research.

[14]  Wilson S. Geisler,et al.  Natural systems analysis , 2008, Electronic Imaging.

[15]  O. Blanke,et al.  Dorsal–Ventral Integration in the Recognition of Motion-Defined Unfamiliar Faces , 2009, The Journal of Neuroscience.

[16]  R. Krauzlis,et al.  Tracking with the mind’s eye , 1999, Trends in Neurosciences.

[17]  Antonio Torralba,et al.  Contextual guidance of eye movements and attention in real-world scenes: the role of global features in object search. , 2006, Psychological review.

[18]  P. Lennie,et al.  Spatial and temporal contrast sensitivities of neurones in lateral geniculate nucleus of macaque. , 1984, The Journal of physiology.

[19]  Brian H Scott,et al.  A comparison of pursuit eye movement and perceptual performance in speed discrimination. , 2003, Journal of vision.

[20]  Wilson S. Geisler,et al.  Simple summation rule for optimal fixation selection in visual search , 2009, Vision Research.

[21]  M. Goldberg,et al.  The Role of the Lateral Intraparietal Area of the Monkey in the Generation of Saccades and Visuospatial Attention , 2002, Annals of the New York Academy of Sciences.

[22]  M. Goodale,et al.  The visual brain in action , 1995 .

[23]  Christopher R. Houck,et al.  A Genetic Algorithm for Function Optimization: A Matlab Implementation , 2001 .

[24]  A. Bovik,et al.  Visual search in noise: revealing the influence of structural cues by gaze-contingent classification image analysis. , 2006, Journal of vision.

[25]  R. Krauzlis,et al.  Shared motion signals for human perceptual decisions and oculomotor actions. , 2003, Journal of vision.

[26]  Alfred L. Foster,et al.  Natural Systems. , 1938, Proceedings of the National Academy of Sciences of the United States of America.

[27]  A. C. Bovik,et al.  Eye movements selective for spatial frequency and orientation during active visual search , 2009, Vision Research.

[28]  Susan L. Franzel,et al.  Guided search: an alternative to the feature integration model for visual search. , 1989, Journal of experimental psychology. Human perception and performance.

[29]  Miguel P Eckstein,et al.  Attentional Cues in Real Scenes, Saccadic Targeting, and Bayesian Priors , 2005, Psychological science.

[30]  Rajesh P. N. Rao,et al.  Eye movements in iconic visual search , 2002, Vision Research.

[31]  Jeffrey D Schall,et al.  The neural selection and control of saccades by the frontal eye field. , 2002, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[32]  Martina Poletti,et al.  Miniature eye movements enhance fine spatial detail , 2007, Nature.

[33]  L. Jakobson,et al.  A neurological dissociation between perceiving objects and grasping them , 1991, Nature.

[34]  M. Goodale,et al.  Separate visual pathways for perception and action , 1992, Trends in Neurosciences.

[35]  Preeti Verghese,et al.  Where to look next? Eye movements reduce local uncertainty. , 2007, Journal of vision.

[36]  M. Eckstein,et al.  Virtual evolution for visual search in natural images results in behavioral receptive fields with inhibitory surrounds , 2009, Visual Neuroscience.

[37]  Melvyn A. Goodale,et al.  Dissociation of perception and action unmasked by the hollow-face illusion , 2006, Brain Research.

[38]  Leslie G. Ungerleider.  Two cortical visual systems , 1982 .

[39]  Paul Dassonville,et al.  Perception, Action, and Roelofs Effect: A Mere Illusion of Dissociation , 2004, PLoS biology.

[40]  Miguel P Eckstein,et al.  The footprints of visual attention in the Posner cueing paradigm revealed by classification images. , 2002, Journal of vision.