论文信息 - Slow Feature Analysis: A Theoretical Analysis of Optimal Free Responses

Slow Feature Analysis: A Theoretical Analysis of Optimal Free Responses

Temporal slowness is a learning principle that allows learning of invariant representations by extracting slowly varying features from quickly varying input signals. Slow feature analysis (SFA) is an efficient algorithm based on this principle and has been applied to the learning of translation, scale, and other invariances in a simple model of the visual system. Here, a theoretical analysis of the optimization problem solved by SFA is presented, which provides a deeper understanding of the simulation results obtained in previous studies.

Laurenz Wiskott | Laurenz Wiskott

[1] Geoffrey E. Hinton. Connectionist Learning Procedures , 1989, Artif. Intell..

[2] Peter Földiák,et al. Learning Invariance from Transformation Sequences , 1991, Neural Comput..

[3] Graeme Mitchison,et al. Removing Time Variation with the Anti-Hebbian Differential Synapse , 1991, Neural Computation.

[4] Geoffrey E. Hinton,et al. Self-organizing neural network that discovers surfaces in random-dot stereograms , 1992, Nature.

[5] Mark H. Johnson,et al. Object Recognition and Sensitive Periods: A Computational Analysis of Visual Imprinting , 1994, Neural Computation.

[6] James V. Stone,et al. A Learning Rule for Extracting Temporal Invariances , 1995, IWANN.

[7] E. Rolls,et al. INVARIANT FACE AND OBJECT RECOGNITION IN THE VISUAL SYSTEM , 1997, Progress in Neurobiology.

[8] Hanchuan Peng,et al. Energy function for learning invariance in multilayer perceptron , 1998 .

[9] Konrad P. Körding,et al. Extracting Slow Subspaces from Natural Videos Leads to Complex Cells , 2001, ICANN.

[10] Laurenz Wiskott,et al. Applying Slow Feature Analysis to Image Sequences Yields a Rich Repertoire of Complex Cell Properties , 2002, ICANN.

[11] Terrence J. Sejnowski,et al. Slow Feature Analysis: Unsupervised Learning of Invariances , 2002, Neural Computation.

[12] Laurenz Wiskott,et al. Is slowness a learning principle of the visual cortex? , 2003, Zoology.