Slow Feature Analysis: Perspectives for Technical Applications of a Versatile Learning Algorithm

Slow Feature Analysis (SFA) is an unsupervised learning algorithm based on the slowness principle and has originally been developed to learn invariances in a model of the primate visual system. Although developed for computational neuroscience, SFA has turned out to be a versatile algorithm also for technical applications since it can be used for feature extraction, dimensionality reduction, and invariance learning. With minor adaptations SFA can also be applied to supervised learning problems such as classification and regression. In this work, we review several illustrative examples of possible applications including the estimation of driving forces, nonlinear blind source separation, traffic sign recognition, and face processing.

[1]  Laurenz Wiskott,et al.  An extension of slow feature analysis for nonlinear blind source separation , 2014, J. Mach. Learn. Res..

[2]  Wolfgang Konen,et al.  The slowness principle: SFA can detect different slow components in non-stationary time series , 2011 .

[3]  Dacheng Tao,et al.  Slow Feature Analysis for Human Action Recognition , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Michael Tangermann,et al.  Slow Feature Analysis - A Tool for Extraction of Discriminating Event-Related Potentials in Brain-Computer Interfaces , 2011, ICANN.

[5]  Laurenz Wiskott,et al.  Slow feature analysis yields a rich repertoire of complex cell properties. , 2005, Journal of vision.

[6]  Graeme Mitchison,et al.  Removing Time Variation with the Anti-Hebbian Differential Synapse , 1991, Neural Computation.

[7]  Wolfgang Konen,et al.  Gesture recognition on few training data using Slow Feature Analysis and parametric bootstrap , 2010, The 2010 International Joint Conference on Neural Networks (IJCNN).

[8]  Laurenz Wiskott,et al.  What Is the Relation Between Slow Feature Analysis and Independent Component Analysis? , 2006, Neural Computation.

[9]  Terrence J. Sejnowski,et al.  Slow Feature Analysis: Unsupervised Learning of Invariances , 2002, Neural Computation.

[10]  Pietro Berkes.  Handwritten Digit Recognition with Nonlinear Fisher Discriminant Analysis , 2005, ICANN.

[11]  Franz Kummert,et al.  Monocular road segmentation using slow feature analysis , 2011, 2011 IEEE Intelligent Vehicles Symposium (IV).

[12]  Johannes Stallkamp,et al.  The German Traffic Sign Recognition Benchmark: A multi-class classification competition , 2011, The 2011 International Joint Conference on Neural Networks.

[13]  Dominique Martinez,et al.  Kernel-Based Extraction of Slow Features: Complex Cells Learn Disparity and Translation Invariance from Natural Images , 2002, NIPS.

[14]  Laurenz Wiskott,et al.  Heuristic Evaluation of Expansions for Non-linear Hierarchical Slow Feature Analysis , 2011, 2011 10th International Conference on Machine Learning and Applications and Workshops.

[15]  Klaus Obermayer,et al.  Sparse Optimization for Second Order Kernel Methods , 2006, The 2006 IEEE International Joint Conference on Neural Network Proceedings.

[16]  S. Höfer,et al.  Using Slow Feature Analysis to Extract Behavioural Manifolds Related to Humanoid Robot Postures , 2010 .

[17]  Robert A. Legenstein,et al.  Reinforcement Learning on Slow Features of High-Dimensional Input Streams , 2010, PLoS Comput. Biol..

[18]  Laurenz Wiskott,et al.  Gender and Age Estimation from Synthetic Face Images with Hierarchical Slow Feature Analysis , 2010 .

[19]  Laurenz Wiskott,et al.  Slow Feature Analysis: A Theoretical Analysis of Optimal Free Responses , 2003, Neural Computation.

[20]  T. Schreiber.  Interdisciplinary application of nonlinear time series methods , 1998, chao-dyn/9807001.

[21]  Laurenz Wiskott,et al.  A Theory of Slow Feature Analysis for Transformation-Based Input Signals with an Application to Complex Cells , 2011, Neural Computation.

[22]  Niko Wilbert,et al.  Invariant Object Recognition and Pose Estimation with Slow Feature Analysis , 2011, Neural Computation.

[23]  Wolfgang Maass,et al.  A Theoretical Basis for Emergent Pattern Discrimination in Neural Systems Through Slow Feature Extraction , 2010, Neural Computation.

[24]  Hani Mahdi,et al.  A simple evaluation of face detection algorithms using unpublished static images , 2010, 2010 10th International Conference on Intelligent Systems Design and Applications.

[25]  Aapo Hyvärinen,et al.  Nonlinear independent component analysis: Existence and uniqueness results , 1999, Neural Networks.

[26]  Laurenz Wiskott,et al.  Slowness and Sparseness Lead to Place, Head-Direction, and Spatial-View Cells , 2007, PLoS Comput. Biol..

[27]  Peter Földiák,et al.  Learning Invariance from Transformation Sequences , 1991, Neural Comput..

[28]  Geoffrey E. Hinton.  Connectionist Learning Procedures , 1989, Artif. Intell..

[29]  Aapo Hyvärinen,et al.  Survey on Independent Component Analysis , 1999 .

[30]  Laurenz Wiskott.  Estimating Driving Forces of Nonstationary Time Series with Slow Feature Analysis Laurenz Wiskott Institute for Theoretical Biology , 2003 .

[31]  Motoaki Kawanabe,et al.  Kernel-Based Nonlinear Blind Source Separation , 2003, Neural Computation.

[32]  P. Berkes.  Pattern Recognition with Slow Feature Analysis , 2005 .