Automatic scene recognition for low-resource devices using evolving classifiers

In this paper an original approach is proposed which makes possible autonomous scenes recognition performed on-line by an evolving self-learning classifier. Existing approaches for scene recognition are off-line and used in intelligent albums for picture categorization/selection. The emergence of powerful mobile platforms with camera on board and sensor-based autonomous (robotic) systems is pushing forward the requirement for efficient self-learning and adaptive/evolving algorithms. Fast real-time and online algorithms for categorisation of the real world environment based on live video stream are essential for understanding and situation awareness as well as for localization and context awareness. In scene analysis the critical problem is feature extraction mechanism for a quick description of the scene. In this paper we apply a well known technique called spatial envelop or GIST. Visual scenes can be quite different but very often they can be grouped in similar types/categories. For example, pictures from different cities across the Globe, e.g. Tokyo, Vancouver, New York, Moscow, Dusseldorf, etc. bear the similar pattern of an urban scene — high rise buildings, despite the differences in the architectural style. Same applies for the beaches of Miami, Maldives, Varna, Costa del Sol, etc. One assumption based on which such automatic video classifiers can be build is to pre-train them using a large number of such images from different groups. Variety of possible scenes suggests the limitations of such an approach. Therefore, we use in this paper the recently propose evolving fuzzy rule-based classifier, simpl_eClass, which is self-learning and thus updates its rules and categories descriptions with each new image. In addition, it is fully recursive, computationally efficient and yet linguistically transparent.

[1]  Jun Rekimoto,et al.  ID CAM: a smart camera for scene capturing and ID recognition , 2003, The Second IEEE and ACM International Symposium on Mixed and Augmented Reality, 2003. Proceedings..

[2]  Plamen Angelov,et al.  Intelligent leader follower behaviour for unmanned ground-based vehicles , 2011 .

[3]  Haifeng Li,et al.  Intelligent Digital Photo Management System Using Ontology and SWRL , 2010, 2010 International Conference on Computational Intelligence and Security.

[4]  Antonio Torralba,et al.  Using the forest to see the trees: exploiting context for visual object detection and localization , 2010, CACM.

[5]  Marco Morana,et al.  Mobile Interface for Content-Based Image Management , 2010, 2010 International Conference on Complex, Intelligent and Software Intensive Systems.

[6]  T. Higuchi Monte carlo filter using the genetic algorithm operators , 1997 .

[7]  Lucas J. van Vliet,et al.  Recursive Gabor filtering , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[8]  Yuntao Qian,et al.  Automatic scene recognition for digital camera by semantic features , 2008, 2008 International Conference on Wavelet Analysis and Pattern Recognition.

[9]  Issam Dagher,et al.  Incremental PCA-LDA algorithm , 2010, 2010 IEEE International Conference on Computational Intelligence for Measurement Systems and Applications.

[10]  Luis Moreno,et al.  A Genetic Algorithm for Mobile Robot Localization Using Ultrasonic Sensors , 1999, J. Intell. Robotic Syst..

[11]  Antonio Torralba,et al.  Building the gist of a scene: the role of global image features in recognition. , 2006, Progress in brain research.

[12]  Frederick E. Petry,et al.  Scene recognition using genetic algorithms with semantic nets , 1990, Pattern Recognit. Lett..

[13]  Javier González,et al.  An optimal filtering algorithm for non-parametric observation models in robot localization , 2008, 2008 IEEE International Conference on Robotics and Automation.

[14]  Godfrey C. Onwubolu,et al.  Differential Evolution: A Handbook for Global Permutation-Based Combinatorial Optimization , 2009 .

[15]  Lucas J. van Vliet,et al.  Recursive Gabor filtering , 2002, IEEE Trans. Signal Process..

[16]  A. Friedman Framing pictures: the role of knowledge in automatized encoding and memory for gist. , 1979, Journal of experimental psychology. General.

[17]  Plamen P. Angelov,et al.  Real-time human activity recognition from wireless sensors using evolving fuzzy systems , 2010, International Conference on Fuzzy Systems.

[18]  Jana Kosecka,et al.  Experiments in place recognition using gist panoramas , 2009, 2009 IEEE 12th International Conference on Computer Vision Workshops, ICCV Workshops.

[19]  Luis Moreno,et al.  Evolutionary filter for robust mobile robot global localization , 2006, Robotics Auton. Syst..

[20]  Plamen P. Angelov,et al.  Simpl_eClass: Simplified potential-free evolving fuzzy rule-based classifiers , 2011, 2011 IEEE International Conference on Systems, Man, and Cybernetics.

[21]  Jan-Michael Frahm,et al.  Modeling and Recognition of Landmark Image Collections Using Iconic Scene Graphs , 2008, International Journal of Computer Vision.

[22]  Cordelia Schmid,et al.  Beyond Bags of Features: Spatial Pyramid Matching for Recognizing Natural Scene Categories , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[23]  Hong Bingrong,et al.  Coevolution Based Adaptive Monte Carlo Localization (CEAMCL) , 2004, ArXiv.

[24]  Plamen P. Angelov,et al.  Autonomous visual self-localization in completely unknown environment , 2007, 2012 IEEE Conference on Evolving and Adaptive Intelligent Systems.

[25]  Plamen P. Angelov,et al.  Evolving Fuzzy-Rule-Based Classifiers From Data Streams , 2008, IEEE Transactions on Fuzzy Systems.

[26]  Plamen P. Angelov,et al.  Fuzzily Connected Multimodel Systems Evolving Autonomously From Data Streams , 2011, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[27]  Youhong Lu,et al.  Fast computation of Gabor functions , 1996, IEEE Signal Processing Letters.

[28]  Antonio Bandera,et al.  Incremental Hybrid Approach for Unsupervised Classification: Applications to Visual Landmarks Recognition , 2010, ICIAR.

[29]  Laurent Itti,et al.  Gist: A Mobile Robotics Application of Context-Based Vision in Outdoor Environment , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Workshops.

[30]  N. Ranganathan,et al.  Efficient computation of gabor filter based multiresolution responses , 1994, Pattern Recognit..

[31]  Maher Rizkalla,et al.  Design of analog CMOS integrated circuits input stage for the operation at zero temperature coefficient using PSPICE , 1992, [1992] Proceedings of the 35th Midwest Symposium on Circuits and Systems.

[32]  Antonio Torralba,et al.  Modeling the Shape of the Scene: A Holistic Representation of the Spatial Envelope , 2001, International Journal of Computer Vision.

[33]  Dennis Gabor,et al.  Theory of communication , 1946 .

[34]  A. Oliva,et al.  Diagnostic Colors Mediate Scene Recognition , 2000, Cognitive Psychology.

[35]  D.P. Filev,et al.  An approach to online identification of Takagi-Sugeno fuzzy models , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[36]  Wolfram Burgard,et al.  Robust Monte Carlo localization for mobile robots , 2001, Artif. Intell..

[37]  Xiaowei Zhou,et al.  Real-time joint Landmark Recognition and Classifier Generation by an Evolving Fuzzy System , 2006, 2006 IEEE International Conference on Fuzzy Systems.

[38]  R. Righart,et al.  Recognition of facial expressions is influenced by emotional scene gist , 2008, Cognitive, affective & behavioral neuroscience.

[39]  Martin Szummer,et al.  Indoor-outdoor image classification , 1998, Proceedings 1998 IEEE International Workshop on Content-Based Access of Image and Video Database.

[40]  Andrea Gasparri,et al.  Monte Carlo Filter in Mobile Robotics Localization: A Clustered Evolutionary Point of View , 2006, J. Intell. Robotic Syst..