Spatiotemporal Energy Models

Spatiotemporal energy models were developed to explain the physiological properties of a class of motion sensitive neurons known as complex direction selective (DS) cells in the primary visual cortex (V1). These models are tuned to respond to energy within the spatiotemporal frequency spectrum of time-varying imagery, particularly to the spectral bands that are associated with specific directions of motion. This is accomplished using quadrature pairs of linear filters that are oriented both in space and in space-time. Spatiotemporal energy models are commonly used as the initial stages of higher-level models of motion, stereopsis, and form processing.

[1]  Y Chen,et al.  Modeling V1 disparity tuning to time-varying stimuli. , 2001, Journal of neurophysiology.

[2]  W. Reichardt.  Autokorrelations-Auswertung als Funktionsprinzip des Zentralnervensystems , 1957 .

[3]  T. Poggio,et al.  Visual hyperacuity: spatiotemporal interpolation in human vision , 1981, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[4]  J. Movshon,et al.  Spatial summation in the receptive fields of simple cells in the cat's striate cortex. , 1978, The Journal of physiology.

[5]  J. van Santen,et al.  Elaborated Reichardt detectors. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[6]  L. Palmer,et al.  Contribution of linear spatiotemporal receptive field structure to velocity selectivity of simple cells in area 17 of cat , 1989, Vision Research.

[7]  J. van Santen,et al.  Temporal covariance model of human motion perception. , 1984, Journal of the Optical Society of America. A, Optics and image science.

[8]  Bruce G. Cumming,et al.  Adaptation to Natural Binocular Disparities in Primate V1 Explained by a Generalized Energy Model , 2008, Neuron.

[9]  Andrew B. Watson,et al.  A look at motion in the frequency domain , 1983 .

[10]  J. Robson,et al.  Application of fourier analysis to the visibility of gratings , 1968, The Journal of physiology.

[11]  A J Ahumada,et al.  Model of human visual-motion sensing. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[12]  Ning Qian,et al.  A Coarse-to-Fine Disparity Energy Model with Both Phase-Shift and Position-Shift Receptive Field Mechanisms , 2004, Neural Computation.

[13]  G. F. Cooper,et al.  The spatial selectivity of the visual cells of the cat , 1969, The Journal of physiology.

[14]  Izumi Ohzawa,et al.  Mechanisms of stereoscopic vision: the disparity energy model , 1998, Current Opinion in Neurobiology.

[15]  R. Shapley,et al.  Linear mechanisms of directional selectivity in simple cells of cat striate cortex. , 1987, Proceedings of the National Academy of Sciences of the United States of America.

[16]  W. Reichardt,et al.  Autocorrelation, a principle for the evaluation of sensory information by the central nervous system , 1961 .

[17]  C Blakemore,et al.  On the existence of neurones in the human visual system selectively sensitive to the orientation and size of retinal images , 1969, The Journal of physiology.

[18]  E H Adelson,et al.  Spatiotemporal energy models for the perception of motion. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[19]  L. Maffei,et al.  The visual cortex as a spatial frequency analyser. , 1973, Vision research.

[20]  Bruce G Cumming,et al.  A simple model accounts for the response of disparity-tuned V1 neurons to anticorrelated images , 2002, Visual Neuroscience.

[21]  Bertram E. Shi,et al.  The changing disparity energy model , 2010, Vision Research.

[22]  D. Hubel,et al.  Receptive fields, binocular interaction and functional architecture in the cat's visual cortex , 1962, The Journal of physiology.

[23]  I. Ohzawa,et al.  Stereoscopic depth discrimination in the visual cortex: neurons ideally suited as disparity detectors. , 1990, Science.