Biologically Inspired Dictionary Learning for Visual Pattern Recognition

Holonomic brain theory provides an understanding of neural system behaviour. It is argued that recognition of objects in mammalian brain follows a sparse representation of responses to bar-like structures. We considered different scales and orie ntations of Gabor wavelets to form a dictionary. While previous works in the literature used greedy pursuit based methods for sparse coding, this work takes advantage of a locally competitive algorithm (LCA) which calculates more regular sparse coefficients by combining the interactions of artif icial neurons. Moreover the proposed learning algorithm can be implemented in parallel processing which makes it efficient for real-time application s. A complex-valued synergetic neural network is train ed using a quantum particle swarm optimization to perform a classification test. Finally, we provide an experimental real application for biological implementation of sparse dictionary learning to rec ognize emotion using body expression. Classificatio n results are promising and quite comparable to the r ecognition rate by human response. Povzetek: Z zgledovanjem po biolookih sistemih je p redstavljena je metoda ucenja vizualnih vzorcev.

[1]  Loïc Kessous,et al.  Multimodal emotion recognition in speech-based interaction using facial expression, body gesture and acoustic analysis , 2010, Journal on Multimodal User Interfaces.

[2]  Song-Chun Zhu,et al.  What are Textons? , 2005, International Journal of Computer Vision.

[3]  Bin Lu,et al.  The research of learning algorithm of synergetic neural network , 2012, 2012 International Conference on Computer Science and Information Processing (CSIP).

[4]  Mitja Peruš,et al.  Biological and Quantum Computing for Human Vision: Holonomic Models and Applications , 2010 .

[5]  J J Hopfield,et al.  Neural networks and physical systems with emergent collective computational abilities. , 1982, Proceedings of the National Academy of Sciences of the United States of America.

[6]  Tzyy-Ping Jung,et al.  Independent Component Analysis of Electroencephalographic Data , 1995, NIPS.

[7]  Marie-Hélène Grosbras,et al.  Developmental Changes in Emotion Recognition from Full-Light and Point-Light Displays of Body Movement , 2012, PloS one.

[8]  Anthony Steed,et al.  Automatic Recognition of Non-Acted Affective Postures , 2011, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[9]  Beatrice de Gelder,et al.  The Bodily Expressive Action Stimulus Test (BEAST). Construction and Validation of a Stimulus Basis for Measuring Perception of Whole Body Expression of Emotions , 2011, Front. Psychology.

[10]  Bruno A Olshausen,et al.  Sparse coding of sensory inputs , 2004, Current Opinion in Neurobiology.

[11]  Jun Gao,et al.  Optical-electronic shape recognition system based on synergetic associative memory , 2001, IS&T/SPIE Electronic Imaging.

[12]  Rebecca M. Brannon,et al.  User Manual and Supporting Information for Library of Codes for Centroidal Voronoi Point Placement and Associated Zeroth, First, and Second Moment Determination , 2002 .

[13]  Frank E. Pollick,et al.  Combining faces and movements to recognize affect , 2004 .

[14]  Hatice Gunes,et al.  Bi-modal emotion recognition from expressive face and body gestures , 2007, J. Netw. Comput. Appl..

[15]  Vision Research , 1961, Nature.

[16]  Max Gunzburger,et al.  Constrained CVT meshes and a comparison of triangular mesh generators , 2009, Comput. Geom..

[17]  Michael A. Saunders,et al.  Atomic Decomposition by Basis Pursuit , 1998, SIAM J. Sci. Comput..

[18]  N. Frijda The laws of emotion. , 1988, The American psychologist.

[19]  David J. Field,et al.  Emergence of simple-cell receptive field properties by learning a sparse code for natural images , 1996, Nature.

[20]  Mitja Perus Image processing and becoming conscious of its result , 2001, Informatica.

[21]  D. Rees,et al.  Three-dimensional pose from two-dimensional images: a novel approach using synergetic networks , 1995, Proceedings of ICNN'95 - International Conference on Neural Networks.

[22]  Hermann Haken Synergetic computers and cognition: a top-down approach to neural nets , 1991 .

[23]  LeeTai Sing Image Representation Using 2D Gabor Wavelets , 1996 .

[24]  Mark Richards,et al.  Choosing a starting configuration for particle swarm optimization , 2004, 2004 IEEE International Joint Conference on Neural Networks (IEEE Cat. No.04CH37541).

[25]  Joseph F. Murray,et al.  Dictionary Learning Algorithms for Sparse Representation , 2003, Neural Computation.

[26]  Mário A. T. Figueiredo Adaptive Sparseness for Supervised Learning , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[27]  Xiaojun Wu,et al.  Quantum-Behaved Particle Swarm Optimization: Analysis of Individual Particle Behavior and Parameter Selection , 2012, Evolutionary Computation.

[28]  Richard G. Baraniuk,et al.  Sparse Coding via Thresholding and Local Competition in Neural Circuits , 2008, Neural Computation.

[29]  D. Koruga,et al.  Synergy of classical and quantum communications channels in brain: neuron-astrocyte network , 2004, 7th Seminar on Neural Network Applications in Electrical Engineering, 2004. NEUREL 2004. 2004.

[30]  Helio J. C. Barbosa,et al.  A new adaptive penalty scheme for genetic algorithms , 2003, Inf. Sci..

[31]  B. de Gelder,et al.  Rapid detection of fear in body expressions, an ERP study , 2007, Brain Research.

[32]  K. Pribram Brain and Perception: Holonomy and Structure in Figural Processing , 1991 .

[33]  Qiang Du,et al.  Centroidal Voronoi Tessellations: Applications and Algorithms , 1999, SIAM Rev..

[34]  Simon Haykin,et al.  Neural Networks: A Comprehensive Foundation , 1998 .

[35]  Stéphane Mallat,et al.  Matching pursuits with time-frequency dictionaries , 1993, IEEE Trans. Signal Process..

[36]  R. Blake,et al.  Perception of human motion. , 2007, Annual review of psychology.

[37]  N. Frijda Impulsive action and motivation , 2010, Biological Psychology.

[38]  A. Young,et al.  Emotion Perception from Dynamic and Static Body Expressions in Point-Light and Full-Light Displays , 2004, Perception.

[39]  David J. Field,et al.  Sparse coding with an overcomplete basis set: A strategy employed by V1? , 1997, Vision Research.

[40]  Song-Chun Zhu,et al.  Learning Active Basis Model for Object Detection and Recognition , 2010, International Journal of Computer Vision.

[41]  Nico H. Frijda Not Passion’s Slave , 2010 .

[42]  T. Poggio,et al.  Neural mechanisms of object recognition , 2002, Current Opinion in Neurobiology.

[43]  J. Daugman Two-dimensional spectral analysis of cortical receptive field profiles , 1980, Vision Research.

[44]  Beatrice de Gelder,et al.  The Bodily Expressive Action Stimulus Test (BEAST). Construction and validation of a stimulus basis for measuring perception of whole body expression of emotions , 2011 .