Image Representation in Visual Cortex and High Nonlinear Approximation

We briefly review the sparse coding principle employed in the sensory information processing system of mammals and focus on the phenomenon that such principle is realized through over-complete representation strategy in primary sensory cortical areas (V1). Considering the lack of quantitative analysis of how many gains in sparsenality the over-complete representation strategy brings in neuroscience, in this paper, we give a quantitative analysis from the viewpoint of nonlinear approximation. The result shows that the over-complete strategy can provide sparser representation than the complete strategy.

[1]  Bruno A Olshausen,et al.  Sparse coding of sensory inputs , 2004, Current Opinion in Neurobiology.

[2]  Michael Elad,et al.  Optimally sparse representation in general (nonorthogonal) dictionaries via ℓ1 minimization , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[3]  Bruno A. Olshausen,et al.  Principles of Image Representation in Visual Cortex , 2003 .

[4]  Terrence J. Sejnowski,et al.  Slow Feature Analysis: Unsupervised Learning of Invariances , 2002, Neural Computation.

[5]  S T Roweis,et al.  Nonlinear dimensionality reduction by locally linear embedding. , 2000, Science.

[6]  H. C. LONGUET-HIGGINS,et al.  Non-Holographic Associative Memory , 1969, Nature.

[7]  David J. Field,et al.  Sparse coding with an overcomplete basis set: A strategy employed by V1? , 1997, Vision Research.

[8]  S. Laughlin,et al.  An Energy Budget for Signaling in the Grey Matter of the Brain , 2001, Journal of cerebral blood flow and metabolism : official journal of the International Society of Cerebral Blood Flow and Metabolism.

[9]  Kim Steenstrup Pedersen,et al.  The Nonlinear Statistics of High-Contrast Patches in Natural Images , 2003, International Journal of Computer Vision.

[10]  Michael Elad,et al.  Submitted to Ieee Transactions on Image Processing Image Decomposition via the Combination of Sparse Representations and a Variational Approach , 2022 .

[11]  Arkadi Nemirovski,et al.  On sparse representation in pairs of bases , 2003, IEEE Trans. Inf. Theory.

[12]  P. Lennie.  The Cost of Cortical Computation , 2003, Current Biology.

[13]  Terrence J. Sejnowski,et al.  Learning Overcomplete Representations , 2000, Neural Computation.