Independent component analysis applied to feature extraction from colour and stereo images

Previous work has shown that independent component analysis (ICA) applied to feature extraction from natural image data yields features resembling Gabor functions and simple-cell receptive fields. This article considers the effects of including chromatic and stereo information. The inclusion of colour leads to features divided into separate red/green, blue/yellow, and bright/dark channels. Stereo image data, on the other hand, leads to binocular receptive fields which are tuned to various disparities. The similarities between these results and the observed properties of simple cells in the primary visual cortex are further evidence for the hypothesis that visual cortical neurons perform some type of redundancy reduction, which was one of the original motivations for ICA in the first place. In addition, ICA provides a principled method for feature extraction from colour and stereo images; such features could be used in image processing operations such as denoising and compression, as well as in pattern recognition.

[1]  B. M. Oliver.  Efficient coding , 1952 .

[2]  佐藤 保,et al.  Principal Components , 2021, Encyclopedic Dictionary of Archaeology.

[3]  D. Hubel,et al.  Receptive fields, binocular interaction and functional architecture in the cat's visual cortex , 1962, The Journal of physiology.

[4]  C. Blakemore,et al.  The neural mechanism of binocular depth discrimination , 1967, The Journal of physiology.

[5]  D. Hubel,et al.  Receptive fields and functional architecture of monkey striate cortex , 1968, The Journal of physiology.

[6]  G. Poggio,et al.  Binocular interaction and depth sensitivity in striate and prestriate cortex of behaving rhesus monkey. , 1977, Journal of neurophysiology.

[7]  E. Oja.  Simplified neuron model as a principal component analyzer , 1982, Journal of mathematical biology.

[8]  E. Bienenstock,et al.  Theory for the development of neuron selectivity: orientation specificity and binocular interaction in visual cortex , 1982, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[9]  R. L. Valois,et al.  The orientation and direction selectivity of cells in macaque visual cortex , 1982, Vision Research.

[10]  D. Hubel,et al.  Anatomy and physiology of a color system in the primate visual cortex , 1984, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[11]  K. Mullen.  The contrast sensitivity of human colour vision to red‐green and blue‐yellow chromatic gratings. , 1985, The Journal of physiology.

[12]  Ralph Linsker,et al.  Self-organization in a perceptual network , 1988, Computer.

[13]  E. Switkes,et al.  Functional anatomy of macaque striate cortex. V. Spatial frequency , 1988, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[14]  S. Levay,et al.  Ocular dominance and disparity coding in cat visual cortex , 1988, Visual Neuroscience.

[15]  E. Switkes,et al.  Functional anatomy of macaque striate cortex. II. Retinotopic organization , 1988, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[16]  D. Ts'o,et al.  The organization of chromatic and spatial interactions in the primate striate cortex , 1988, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[17]  Stéphane Mallat,et al.  A Theory for Multiresolution Signal Decomposition: The Wavelet Representation , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[18]  Joseph J. Atick,et al.  Towards a Theory of Early Visual Processing , 1990, Neural Computation.

[19]  Christian Jutten,et al.  Blind separation of sources, part I: An adaptive algorithm based on neuromimetic architecture , 1991, Signal Process..

[20]  Ingrid Daubechies,et al.  Ten Lectures on Wavelets , 1992 .

[21]  Zhaoping Li,et al.  Understanding Retinal Color Coding from First Principles , 1992, Neural Computation.

[22]  Leslie S. Smith,et al.  The principal components of natural images , 1992 .

[23]  Joseph J. Atick,et al.  What Does the Retina Know about Natural Scenes? , 1992, Neural Computation.

[24]  D. Heeger.  Normalization of cell responses in cat striate cortex , 1992, Visual Neuroscience.

[25]  Joseph J. Atick,et al.  Convergent Algorithm for Sensory Receptive Field Development , 1993, Neural Computation.

[26]  I. Ohzawa,et al.  Spatiotemporal organization of simple-cell receptive fields in the cat's striate cortex. II. Linearity of temporal and spatial summation. , 1993, Journal of neurophysiology.

[27]  J. V. van Hateren.  Spatial, temporal and spectral pre-processing for colour vision , 1993, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[28]  I. Ohzawa,et al.  Spatiotemporal organization of simple-cell receptive fields in the cat's striate cortex. I. General characteristics and postnatal development. , 1993, Journal of neurophysiology.

[29]  Zhaoping Li,et al.  Efficient stereo coding in the multiscale representation , 1994 .

[30]  Pierre Comon,et al.  Independent component analysis, A new concept? , 1994, Signal Process..

[31]  David J. Field,et al.  What Is the Goal of Sensory Coding? , 1994, Neural Computation.

[32]  Terrence J. Sejnowski,et al.  An Information-Maximization Approach to Blind Separation and Blind Deconvolution , 1995, Neural Computation.

[33]  Andrzej Cichocki,et al.  A New Learning Algorithm for Blind Signal Separation , 1995, NIPS.

[34]  K. Miller.  Modeling Joint Development of Ocular Dominance and Orientation Maps in Primary Visual Cortex , 1996 .

[35]  Ning Qian,et al.  Binocular Receptive Field Models, Disparity Tuning, and Characteristic Disparity , 1996, Neural Computation.

[36]  David J. Field,et al.  Emergence of simple-cell receptive field properties by learning a sparse code for natural images , 1996, Nature.

[37]  Jean-François Cardoso,et al.  Equivariant adaptive source separation , 1996, IEEE Trans. Signal Process..

[38]  Nathan Intrator,et al.  Effect of Binocular Cortical Misalignment on Ocular Dominance and Orientation Selectivity , 1996, Neural Computation.

[39]  Andrzej Cichocki,et al.  Robust neural networks with on-line learning for blind identification and blind separation of sources , 1996 .

[40]  R C Reid,et al.  Efficient Coding of Natural Scenes in the Lateral Geniculate Nucleus: Experimental Test of a Computational Theory , 1996, The Journal of Neuroscience.

[41]  Harry G. Barrow,et al.  A Self-Organizing Model of Color Blob Formation , 1996, Neural Computation.

[42]  Aapo Hyvärinen,et al.  A Fast Fixed-Point Algorithm for Independent Component Analysis , 1997, Neural Computation.

[43]  Erkki Oja,et al.  The nonlinear PCA learning rule in independent component analysis , 1997, Neurocomputing.

[44]  Erkki Oja,et al.  A class of neural networks for independent component analysis , 1997, IEEE Trans. Neural Networks.

[45]  A. Grinvald,et al.  Spatio–temporal frequency domains and their relation to cytochrome oxidase staining in cat visual cortex , 1997, Nature.

[46]  David J. Field,et al.  Sparse coding with an overcomplete basis set: A strategy employed by V1? , 1997, Vision Research.

[47]  A. Grinvald,et al.  Spatio–temporal frequency domains and their relation to cytochrome oxidase staining in cat visual cortex , 1997, Nature.

[48]  J. Movshon,et al.  Linearity and Normalization in Simple Cells of the Macaque Primary Visual Cortex , 1997, The Journal of Neuroscience.

[49]  Terrence J. Sejnowski,et al.  The “independent components” of natural scenes are edge filters , 1997, Vision Research.

[50]  J. V. van Hateren,et al.  Independent component filters of natural images compared with simple cells in primary visual cortex , 1998, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[51]  Petteri Pajunen,et al.  Blind source separation using algorithmic information theory , 1998, Neurocomputing.

[52]  K. Miller,et al.  Correlation-Based Development of Ocularly Matched Orientation and Ocular Dominance Maps: Determination of Required Input Activities , 1998, The Journal of Neuroscience.

[53]  Nicholas J. Priebe,et al.  Contrast-Invariant Orientation Tuning in Cat Visual Cortex: Thalamocortical Input Tuning and Correlation-Based Intracortical Connectivity , 1998, The Journal of Neuroscience.

[54]  D. Ruderman,et al.  INDEPENDENT COMPONENT ANALYSIS OF NATURAL IMAGE SEQUENCES YIELDS SPATIOTEMPORAL FILTERS SIMILAR TO SIMPLE CELLS IN PRIMARY VISUAL CORTEX , 1998 .

[55]  D. Ruderman,et al.  Statistics of cone responses to natural images: implications for visual coding , 1998 .

[56]  D. Ruderman,et al.  Independent component analysis of natural image sequences yields spatio-temporal filters similar to simple cells in primary visual cortex , 1998, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[57]  Aapo Hyvärinen,et al.  Survey on Independent Component Analysis , 1999 .

[58]  Aapo Hyvärinen,et al.  Fast and robust fixed-point algorithms for independent component analysis , 1999, IEEE Trans. Neural Networks.

[59]  Hyvarinen.  Sparse code shrinkage: denoising of nongaussian data by maximum likelihood estimation , 1999, Neural computation.

[60]  I. Ohzawa,et al.  Neural mechanisms for encoding binocular disparity: receptive field position versus phase. , 1999, Journal of neurophysiology.

[61]  A Hyvarinen,et al.  SURVEY OF INDEPENDENT COMPONENT ANALYSIS , 1999 .

[62]  Terrence J. Sejnowski,et al.  Unsupervised Learning , 2018, Encyclopedia of GIS.

[63]  Aapo Hyvärinen,et al.  Sparse Code Shrinkage: Denoising of Nongaussian Data by Maximum Likelihood Estimation , 1999, Neural Computation.

[64]  Terrence J. Sejnowski,et al.  The Spectral Independent Components of Natural Scenes , 2000, Biologically Motivated Computer Vision.

[65]  Aapo Hyvärinen,et al.  Emergence of Phase- and Shift-Invariant Features by Decomposition of Natural Images into Independent Feature Subspaces , 2000, Neural Computation.

[66]  Simon Haykin,et al.  Image Denoising by Sparse Code Shrinkage , 2001 .

[67]  Simon Haykin,et al.  Intelligent Signal Processing , 2001 .

[68]  Refractor.  Vision , 2000, The Lancet.