A Rotational Motion Perception Neural Network Based on Asymmetric Spatiotemporal Visual Information Processing

All complex motion patterns can be decomposed into several elements, including translation, expansion/contraction, and rotational motion. In biological vision systems, scientists have found that specific types of visual neurons have specific preferences to each of the three motion elements. There are computational models on translation and expansion/contraction perceptions; however, little has been done in the past to create computational models for rotational motion perception. To fill this gap, we proposed a neural network that utilizes a specific spatiotemporal arrangement of asymmetric lateral inhibited direction selective neural networks (DSNNs) for rotational motion perception. The proposed neural network consists of two parts—presynaptic and postsynaptic parts. In the presynaptic part, there are a number of lateral inhibited DSNNs to extract directional visual cues. In the postsynaptic part, similar to the arrangement of the directional columns in the cerebral cortex, these direction selective neurons are arranged in a cyclic order to perceive rotational motion cues. In the postsynaptic network, the delayed excitation from each direction selective neuron is multiplied by the gathered excitation from this neuron and its unilateral counterparts depending on which rotation, clockwise (cw) or counter-cw (ccw), to perceive. Systematic experiments under various conditions and settings have been carried out and validated the robustness and reliability of the proposed neural network in detecting cw or ccw rotational motion. This research is a critical step further toward dynamic visual information processing.

[1]  M. Graziano,et al.  Tuning of MST neurons to spiral motions , 1994, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[2]  R H Wurtz,et al.  Functional specialization for visual motion processing in primate cerebral cortex. , 1990, Cold Spring Harbor symposia on quantitative biology.

[3]  H. Sakata,et al.  The TINS Lecture The parietal association cortex in depth perception and visual control of hand action , 1997, Trends in Neurosciences.

[4]  Shigang Yue,et al.  A Synthetic Vision System Using Directionally Selective Motion Detectors to Recognize Collision , 2007, Artificial Life.

[5]  Christopher R. Madan,et al.  Perception of complex motion in humans and pigeons (Columba livia) , 2014, Experimental Brain Research.

[6]  P. Simmons,et al.  Gliding behaviour elicited by lateral looming stimuli in flying locusts , 2004, Journal of Comparative Physiology A.

[7]  H. Sakata,et al.  Parietal cortical neurons responding to rotary movement of visual stimulus in space , 2004, Experimental Brain Research.

[8]  Richard Stafford,et al.  A bio-inspired visual collision detection mechanism for cars: Optimisation of a model of a locust neuron to a novel environment , 2006, Neurocomputing.

[9]  Shigang Yue,et al.  Collision detection in complex dynamic scenes using an LGMD-based visual neural network with feature enhancement , 2006, IEEE Transactions on Neural Networks.

[10]  Shigang Yue,et al.  Redundant Neural Vision Systems—Competing for Collision Recognition Roles , 2013, IEEE Transactions on Autonomous Mental Development.

[11]  Michael A. Arbib,et al.  A neural network for the detection of rotational motion , 1991, IJCNN-91-Seattle International Joint Conference on Neural Networks.

[12]  Liqing Zhang,et al.  Computational Model for Rotation-Invariant Perception , 2007, Third International Conference on Natural Computation (ICNC 2007).

[13]  Margaret E. Sereno,et al.  Learning to See Rotation and Dilation with a Hebb Rule , 1990, NIPS.

[14]  D. Burr,et al.  Two stages of visual processing for radial and circular motion , 1995, Nature.

[15]  P Cavanagh,et al.  Motion Aftereffect: A Global Mechanism for the Perception of Rotation , 1980, Perception.

[16]  Kechen Zhang,et al.  Emergence of Position-Independent Detectors of Sense of Rotation and Dilation with Hebbian Learning: An Analysis , 1999, Neural Computation.

[17]  T. L. Harrington,et al.  Neural mechanisms of space vision in the parietal association cortex of the monkey , 1985, Vision Research.

[18]  Zhuhong Zhang,et al.  Fly visual system inspired artificial neural network for collision detection , 2015, Neurocomputing.

[19]  B. Hassenstein,et al.  Systemtheoretische Analyse der Zeit-, Reihenfolgen- und Vorzeichenauswertung bei der Bewegungsperzeption des Rüsselkäfers Chlorophanus , 1956 .

[20]  Aike Guo,et al.  A multilayer neural network model for perception of rotational motion , 1997, Science in China Series C: Life Sciences.

[21]  Yongdong Zhang,et al.  A Highly Parallel Framework for HEVC Coding Unit Partitioning Tree Decision on Many-core Processors , 2014, IEEE Signal Processing Letters.

[22]  R. Desimone,et al.  Columnar organization of directionally selective cells in visual area MT of the macaque. , 1984, Journal of neurophysiology.

[23]  A. Verri,et al.  Differential techniques for optical flow , 1990 .

[24]  Risto Miikkulainen,et al.  Modeling directional selectivity using self-organizing delay-adaptation maps , 2002, Neurocomputing.

[25]  F. Claire Rind,et al.  Motor activity and trajectory control during escape jumping in the locust Locusta migratoria , 2005, Journal of Comparative Physiology A.

[26]  K. Tanaka,et al.  Analysis of motion of the visual field by direction, expansion/contraction, and rotation cells clustered in the dorsal part of the medial superior temporal area of the macaque monkey. , 1989, Journal of neurophysiology.

[27]  Edmund T. Rolls,et al.  Invariant Global Motion Recognition in the Dorsal Visual System: A Unifying Theory , 2007, Neural Computation.

[28]  田中 啓治 Analysis of Local and Wide-Field Movements in the Superior Temporal Visual Areas of the Macaque Monkey , 1987 .

[29]  Robert L. Ward,et al.  A neural network model of spiral–planar motion tuning in MSTd , 2003, Vision Research.

[30]  M. Hershenson,et al.  Visual system responds to rotational and size-change components of complex proximal motion patterns , 1987, Perception & psychophysics.

[31]  L M Vaina,et al.  Computational modelling of optic flow selectivity in MSTd neurons. , 1998, Network.

[32]  F. Claire Rind,et al.  IDENTIFICATION OF DIRECTIONALLY SELECTIVE MOTION-DETECTING NEURONES IN THE LOCUST LOBULA AND THEIR SYNAPTIC CONNECTIONS WITH AN IDENTIFIED DESCENDING NEURONE , 1990 .

[33]  Johann H. Bollmann,et al.  Layer-Specific Targeting of Direction-Selective Neurons in the Zebrafish Optic Tectum , 2012, Neuron.

[34]  W. Reichardt,et al.  A two dimensional field theory for motion computation , 1988, Biological Cybernetics.

[35]  Angelika Lingnau,et al.  Selective visual responses to expansion and rotation in the human MT complex revealed by functional magnetic resonance imaging adaptation , 2008, The European journal of neuroscience.

[36]  Hideo Sakata,et al.  Functional properties of rotation-sensitive neurons in the posterior parietal association cortex of the monkey , 1994, Experimental Brain Research.

[37]  A. Verri,et al.  First-order analysis of optical flow in monkey brain. , 1992, Proceedings of the National Academy of Sciences of the United States of America.

[38]  F. Rind,et al.  Neural network based on the input organization of an identified neuron signaling impending collision. , 1996, Journal of neurophysiology.

[39]  Nicholas J. Priebe,et al.  Direction Selectivity of Excitation and Inhibition in Simple Cells of the Cat Primary Visual Cortex , 2005, Neuron.

[40]  Benjamin Sivyer,et al.  Two types of ON direction-selective ganglion cells in rabbit retina , 2010, Neuroscience Letters.

[41]  A. Borst,et al.  Neural networks in the cockpit of the fly , 2002, Journal of Comparative Physiology A.

[42]  Yongdong Zhang,et al.  Efficient Parallel Framework for HEVC Motion Estimation on Many-Core Processors , 2014, IEEE Transactions on Circuits and Systems for Video Technology.

[43]  Frank S. Werblin,et al.  Mechanisms and circuitry underlying directional selectivity in the retina , 2002, Nature.

[44]  Peter U. Tse,et al.  V3A processes contour curvature as a trackable feature for the perception of rotational motion , 2010 .

[45]  Alexa Riehle,et al.  Directionally Selective Motion Detection by Insect Neurons , 1989 .

[46]  G. Rizzolatti,et al.  Afferent properties of periarcuate neurons in macaque monkeys. II. Visual responses , 1981, Behavioural Brain Research.

[47]  D. Hubel,et al.  Receptive fields, binocular interaction and functional architecture in the cat's visual cortex , 1962, The Journal of physiology.

[48]  R. Wurtz,et al.  Sensitivity of MST neurons to optic flow stimuli. I. A continuum of response selectivity to large-field stimuli. , 1991, Journal of neurophysiology.

[49]  Jonathan A. Marshall,et al.  Self-organizing neural networks for perception of visual motion , 1990, Neural Networks.

[50]  Yongdong Zhang,et al.  Parallel deblocking filter for HEVC on many-core processor , 2014 .

[51]  Fabrizio Gabbiani,et al.  Collision detection as a model for sensory-motor integration. , 2011, Annual review of neuroscience.

[52]  F. Claire Rind,et al.  A DIRECTIONALLY SELECTIVE MOTION-DETECTING NEURONE IN THE BRAIN OF THE LOCUST: PHYSIOLOGICAL AND MORPHOLOGICAL CHARACTERIZATION , 1990 .

[53]  Robert Malsch,et al.  A Three-Dimensional Motion Aftereffect Produced by Prolonged Adaptation to a Rotation Simulation , 1984, Perception.

[54]  Keiji Tanaka,et al.  Integration of direction signals of image motion in the superior temporal sulcus of the macaque monkey , 1986, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[55]  M. Feller,et al.  Genetic Identification of an On-Off Direction- Selective Retinal Ganglion Cell Subtype Reveals a Layer-Specific Subcortical Map of Posterior Motion , 2009, Neuron.

[56]  G. Orban,et al.  Responses of macaque STS neurons to optic flow components: a comparison of areas MT and MST. , 1994, Journal of neurophysiology.

[57]  R. Wurtz,et al.  Sensitivity of MST neurons to optic flow stimuli. II. Mechanisms of response selectivity revealed by small-field stimuli. , 1991, Journal of neurophysiology.

[58]  H. Barlow,et al.  The mechanism of directionally selective units in rabbit's retina. , 1965, The Journal of physiology.

[59]  Shigang Yue,et al.  Postsynaptic organisations of directional selective visual neural networks for collision detection , 2013, Neurocomputing.

[60]  D. Burr,et al.  A cortical area that responds specifically to optic flow, revealed by fMRI , 2000, Nature Neuroscience.

[61]  Angie Koban,et al.  Rotational object discrimination by pigeons. , 2009, Journal of experimental psychology. Animal behavior processes.

[62]  Liang Li,et al.  Efficient parallel HEVC intra-prediction on many-core processor , 2014 .

[63]  Shigang Yue,et al.  Visual motion pattern extraction and fusion for collision detection in complex dynamic scenes , 2006, Comput. Vis. Image Underst..

[64]  D C Van Essen,et al.  Functional properties of neurons in middle temporal visual area of the macaque monkey. I. Selectivity for stimulus direction, speed, and orientation. , 1983, Journal of neurophysiology.

[65]  Edward M. Callaway,et al.  A dedicated circuit links direction-selective retinal ganglion cells to the primary visual cortex , 2014 .

[66]  Jan J. Koenderink,et al.  Local structure of movement parallax of the plane , 1976 .

[67]  L Leinonen,et al.  Functional properties of neurones in the posterior part of area 7 in awake monkey. , 1980, Acta physiologica Scandinavica.