Bio-Inspired Computer Vision: Setting the Basis for a New Departure

Studies in biological vision have always been a great source of inspiration for design of computer vision algorithms. In the past, several successful methods were designed with varying degrees of correspondence with biological vision studies, ranging from purely functional inspiration to methods that utilize models that were primarily developed for explaining biological observations. Even though it seems well recognized that computational models of visual cortex can help in design of computer vision algorithms, it is a non-trivial exercise for a computer vision researcher to mine relevant information from biological literature as very few studies in biology are organized at a task level. This has lead to a widening gap between biological vision and computer vision research. In this paper we aim to bridge this gap by provide insights and methodology to envision a new departure in this area. Not only we revisit some of the main features of biological vision and discuss the foundations of existing computational studies modeling biological vision, but also we revisit three classical computer vision tasks from a biological perspective: image sensing, segmentation and optical flow. Using this task-centric approach, we discuss well-known biological functional principles and compare them with approaches taken by computer vision. Based on this comparative analysis of computer and biological vision, we will present some recent promising approaches in modelling biological vision and we highlight a few novel ideas that we think are promising for future investigations in computer vision. To this extent, this papers provides new insights for the design of biology-based computer vision algorithms and pave a way for much needed interaction between the two communities.

[1]  Selina S. Solomon,et al.  Texture-dependent motion signals in primate middle temporal area , 2013, The Journal of physiology.

[2]  Andrea Vedaldi,et al.  Vlfeat: an open and portable library of computer vision algorithms , 2010, ACM Multimedia.

[3]  Christopher C. Pack,et al.  Cortical Mechanisms for the Integration of Visual Motion , 2008 .

[4]  M. Goodale,et al.  Separate visual pathways for perception and action , 1992, Trends in Neurosciences.

[5]  C. Gilbert,et al.  Improvement in visual sensitivity by changes in local context: Parallel studies in human observers and in V1 of alert monkeys , 1995, Neuron.

[6]  Edward M. Callaway,et al.  A dedicated circuit linking direction selective retinal ganglion cells to primary visual cortex , 2014, Nature.

[7]  Luc Van Gool,et al.  The Pascal Visual Object Classes (VOC) Challenge , 2010, International Journal of Computer Vision.

[8]  G. DeAngelis,et al.  A Normalization Model of Multisensory Integration , 2011, Nature Neuroscience.

[9]  Thomas Serre,et al.  HMDB: A large video database for human motion recognition , 2011, 2011 International Conference on Computer Vision.

[10]  Shih-Chii Liu,et al.  Neuromorphic sensory systems , 2010, Current Opinion in Neurobiology.

[11]  Leslie G. Ungerleider Two cortical visual systems , 1982 .

[12]  Dorin Comaniciu,et al.  Mean Shift: A Robust Approach Toward Feature Space Analysis , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[13]  Alexander Borst,et al.  Neural Simulations on Multi-Core Architectures , 2009, Front. Neuroinform..

[14]  G.B. Coleman,et al.  Image segmentation by clustering , 1979, Proceedings of the IEEE.

[15]  P. Roelfsema Cortical algorithms for perceptual grouping. , 2006, Annual review of neuroscience.

[16]  D. J. Felleman,et al.  Distributed hierarchical processing in the primate cerebral cortex. , 1991, Cerebral cortex.

[17]  Tomaso Poggio,et al.  Computational vision and regularization theory , 1985, Nature.

[18]  King-Sun Fu,et al.  A survey on image segmentation , 1981, Pattern Recognit..

[19]  Richard Szeliski,et al.  A Database and Evaluation Methodology for Optical Flow , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[20]  A. Borst Fly visual course control: behaviour, algorithms and circuits , 2014, Nature Reviews Neuroscience.

[21]  S. Grossberg How does the brain build a cognitive code , 1988 .

[22]  Thomas L. Dean,et al.  Neural Networks and Neuroscience-Inspired Computer Vision , 2014, Current Biology.

[23]  D. Hubel Exploration of the primary visual cortex, 1955–78 , 1982, Nature.

[24]  L. Chalupa,et al.  The visual neurosciences , 2004 .

[25]  D. Bradley,et al.  Velocity computation in the primate visual system , 2008, Nature Reviews Neuroscience.

[26]  A. Sillito,et al.  Corticothalamic feedback enhances stimulus response precision in the visual system , 2007, Proceedings of the National Academy of Sciences.

[27]  P. Roelfsema,et al.  Incremental grouping of image elements in vision , 2011, Attention, perception & psychophysics.

[28]  H. Rodman,et al.  Coding of visual stimulus velocity in area MT of the macaque , 1987, Vision Research.

[29]  Olivier Temam,et al.  Implementation of signal processing tasks on neuromorphic hardware , 2011, The 2011 International Joint Conference on Neural Networks.

[30]  J. Bakin,et al.  Visual Responses in Monkey Areas V1 and V2 to Three-Dimensional Surface Configurations , 2000, The Journal of Neuroscience.

[31]  J. Hegdé,et al.  A comparative study of shape representation in macaque visual areas v2 and v4. , 2007, Cerebral cortex.

[32]  D. Hubel,et al.  Segregation of form, color, movement, and depth: anatomy, physiology, and perception. , 1988, Science.

[33]  Jitendra Malik,et al.  Figure/Ground Assignment in Natural Images , 2006, ECCV.

[34]  Pierre Kornprobst,et al.  Streaming an image through the eye: The retina seen as a dithered scalable image coder , 2012, Signal Process. Image Commun..

[35]  Gérard G. Medioni,et al.  Inference of Surfaces, 3D Curves, and Junctions From Sparse, Noisy, 3D Data , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[36]  Henry Kennedy,et al.  Cortical High-Density Counterstream Architectures , 2013, Science.

[37]  F. Chavane,et al.  Lateral Spread of Orientation Selectivity in V1 is Controlled by Intracortical Cooperativity , 2011, Front. Syst. Neurosci..

[38]  W. D. Ross,et al.  Visual brain and visual perception: how does the cortex do perceptual grouping? , 1997, Trends in Neurosciences.

[39]  Walter J. Scheirer,et al.  Perceptual Annotation: Measuring Human Vision to Improve Computer Vision , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[40]  S. Zeki A vision of the brain , 1993 .

[41]  J. Movshon,et al.  Nature and interaction of signals from the receptive field center and surround in macaque V1 neurons. , 2002, Journal of neurophysiology.

[42]  Xavier Cufí,et al.  Yet Another Survey on Image Segmentation: Region and Boundary Information Integration , 2002, ECCV.

[43]  J L Gallant,et al.  Sparse coding and decorrelation in primary visual cortex during natural vision. , 2000, Science.

[44]  D. Bradley,et al.  Structure and function of visual area MT. , 2005, Annual review of neuroscience.

[45]  N. Qian,et al.  A Physiological Model for Motion-Stereo Integration and a Unified Explanation of Pulfrich-like Phenomena , 1997, Vision Research.

[46]  Ryad Benosman,et al.  Asynchronous event‐based high speed vision for microparticle tracking , 2012 .

[47]  Antonio Martínez-Álvarez,et al.  Translating Image Sequences into Spike Patterns for Cortical Neuro-Stimulation , 2004, Neurocomputing.

[48]  HyungGoo R. Kim,et al.  A novel role for visual perspective cues in the neural computation of depth , 2014, Nature Neuroscience.

[49]  Onkar S. Dhande,et al.  Retinal ganglion cell maps in the brain: implications for visual processing , 2014, Current Opinion in Neurobiology.

[50]  Thomas D. Albright,et al.  Neural correlates of perceptual motion coherence , 1992, Nature.

[51]  Jeanny Hérault,et al.  Modeling Visual Perception for Image Processing , 2007, IWANN.

[52]  Victor S. Johnston,et al.  Mate choice decisions: the role of facial beauty , 2006, Trends in Cognitive Sciences.

[53]  S. Ullman Visual routines , 1984, Cognition.

[54]  S. Grossberg How does a brain build a cognitive code , 1980 .

[55]  Andrew S. Cassidy,et al.  A million spiking-neuron integrated circuit with a scalable communication network and interface , 2014, Science.

[56]  W. Usrey,et al.  Emerging views of corticothalamic function , 2008, Current Opinion in Neurobiology.

[57]  Richard T Born,et al.  Joint tuning for direction of motion and binocular disparity in macaque MT is largely separable. , 2013, Journal of neurophysiology.

[58]  R. Masland Cell populations of the retina: the Proctor lecture. , 2011, Investigative ophthalmology & visual science.

[59]  Pierre Kornprobst,et al.  Tracking segmented objects using tensor voting , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[60]  Jonathan R. Williford,et al.  Border-ownership coding , 2013, Scholarpedia.

[61]  Patrick Bouthemy,et al.  Joint Motion Estimation and Layer Segmentation in Transparent Image Sequences—Application to Noise Reduction in X-Ray Image Sequences , 2009, EURASIP J. Adv. Signal Process..

[62]  M. Carandini,et al.  Mapping of stimulus energy in primary visual cortex. , 2005, Journal of neurophysiology.

[63]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[64]  Daniel Matolin,et al.  A QVGA 143 dB Dynamic Range Frame-Free PWM Image Sensor With Lossless Pixel-Level Video Compression and Time-Domain CDS , 2011, IEEE Journal of Solid-State Circuits.

[65]  Jake T C Clements,et al.  Differential Feedback Modulation of Center and Surround Mechanisms in Parvocellular Cells in the Visual Thalamus , 2012, The Journal of Neuroscience.

[66]  James R. Anderson,et al.  Retinal connectomics: Towards complete, accurate networks , 2013, Progress in Retinal and Eye Research.

[67]  Simon J. Thorpe,et al.  Ultra-rapid object detection with saccadic eye movements: Visual processing speed revisited , 2006, Vision Research.

[68]  A. Sillito,et al.  Looking back: corticothalamic feedback and early visual processing , 2006, Trends in Neurosciences.

[69]  R. Masland The Neuronal Organization of the Retina , 2012, Neuron.

[70]  Christopher C. Pack,et al.  Direction selectivity of center-surround interactions in macaque MT , 2010 .

[71]  G. H. Jacobs Primate color vision: A comparative perspective , 2008, Visual Neuroscience.

[72]  Jean Petitot An introduction to the Mumford–Shah segmentation model , 2003, Journal of Physiology-Paris.

[73]  P. Roelfsema Elemental operations in vision , 2005, Trends in Cognitive Sciences.

[74]  Tony F. Chan,et al.  Active contours without edges , 2001, IEEE Trans. Image Process..

[75]  Stephan Tschechne,et al.  Hierarchical representation of shapes in visual cortex—from localized features to figural shape segregation , 2014, Front. Comput. Neurosci..

[76]  M. Carandini,et al.  Normalization as a canonical neural computation , 2011, Nature Reviews Neuroscience.

[77]  E. Peterhans,et al.  Subjective contours - bridging the gap between psychophysics and physiology , 1991, Trends in Neurosciences.

[78]  John K. Tsotsos,et al.  It’s all about the constraints , 2014, Current Biology.

[79]  O. Braddick Segmentation versus integration in visual motion processing , 1993, Trends in Neurosciences.

[80]  D. Ballard,et al.  Eye movements in natural behavior , 2005, Trends in Cognitive Sciences.

[81]  Roel M. Willems Re-Appreciating the Why of Cognition: 35 Years after Marr and Poggio , 2011, Front. Psychology.

[82]  Heiko Neumann,et al.  Disambiguating Visual Motion Through Contextual Feedback Modulation , 2004, Neural Computation.