Image Classification Using Fusion of Holistic Visual Descriptions

An efficient approach for scene classification is necessary for automatically labeling an image as well as for retrieval of desired images from large scale repositories. In this paper machine learning and computer vision techniques have been applied for scene classification. The system is based on feature fusion method with holistic visual color, texture and edge descriptors. Color moments, Color Coherence Vector, Color Auto Correlogram, GLCM, Daubechies Wavelets, Gabor filters and MPEG-7 Edge Direction Histogram have been used in the proposed system to find the best combination of features for this problem. Two state-of- the-art soft computing machine learning techniques: Support vector machine (SVM) and Artificial Neural Networks have been used to classify scene images into meaningful categories. The benchmarked Oliva-Torralba dataset has been used in this research. We report satisfactory categorization performances on a large data set of eight categories of 2688 complex, natural and urban scenes. Using a set of exhaustive experiments our proposed system has achieved classification accuracy as high as 92.5% for natural scenes (OT4) and as high as 86.4% for mixed scene categories (OT8). We also evaluate the system performance by predictive accuracy measures namely sensitivity, specificity, F-score and kappa statistic.

[1]  Jun Yu,et al.  Pairwise constraints based multiview features fusion for scene classification , 2013, Pattern Recognit..

[2]  Jiebo Luo,et al.  Using Semantic Features for Scene Classification: how Good do they Need to Be? , 2006, 2006 IEEE International Conference on Multimedia and Expo.

[3]  Anil K. Jain,et al.  Image classification for content-based indexing , 2001, IEEE Trans. Image Process..

[4]  Ji Zhang,et al.  Image Mining: Issues, Frameworks and Techniques , 2001, MDM/KDD.

[5]  Irving Biederman,et al.  On the Semantics of a Glance at a Scene , 2017 .

[6]  Huan Liu,et al.  Feature Extraction for Image Mining , 2002, Multimedia Information Systems.

[7]  Martin Szummer,et al.  Indoor-outdoor image classification , 1998, Proceedings 1998 IEEE International Workshop on Content-Based Access of Image and Video Database.

[8]  Rosalind W. Picard,et al.  Texture orientation for sorting photos "at a glance" , 1994, Proceedings of 12th International Conference on Pattern Recognition.

[9]  Sukhendu Das,et al.  Indoor vs . Outdoor Scene Classification using Probabilistic Neural Network , 2022 .

[10]  Jitendra Malik,et al.  Recognition of Images in Large Databases Using a Learning Framework , 1997 .

[11]  Aude Oliva,et al.  Global semantic classification of scenes using power spectrum templates , 1999 .

[12]  Robert Marti,et al.  Object and Scene Classification: what does a Supervised Approach Provide us? , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[13]  Sukhendu Das,et al.  Indoor versus Outdoor Scene Classification Using Probabilistic Neural Network , 2007, EURASIP J. Adv. Signal Process..

[14]  Stephen Grossberg,et al.  ARTSCENE: A neural system for natural scene classification. , 2009, Journal of vision.

[15]  Robert M. Haralick,et al.  Textural Features for Image Classification , 1973, IEEE Trans. Syst. Man Cybern..

[16]  A. Oliva,et al.  From Blobs to Boundary Edges: Evidence for Time- and Spatial-Scale-Dependent Scene Recognition , 1994 .

[17]  S. N. Omkar,et al.  Satellite Image Processing for Land Use and Land Cover Mapping , 2014 .

[18]  Jiebo Luo,et al.  Indoor vs outdoor classification of consumer photographs using low-level and semantic features , 2001, Proceedings 2001 International Conference on Image Processing (Cat. No.01CH37205).

[19]  Shih-Fu Chang,et al.  Integration of Visual and Text-Based Approaches for the Content Labeling and Classification of Photographs , 1999, SIGIR 1999.

[20]  Alessandro Perina,et al.  Learning natural scene categories by selective multi-scale feature extraction , 2010, Image Vis. Comput..

[21]  Elaine C. Yiu.  Image classification using color cues and texture orientation , 1996 .

[22]  Yeong-Taeg Kim,et al.  An efficient neural network based indoor-outdoor scene classification algorithm , 2010, 2010 Digest of Technical Papers International Conference on Consumer Electronics (ICCE).

[23]  Amitabh Wahi,et al.  Wavelet - Based Classification of Outdoor Natural Scenes by Resilient Neural Network , 2014 .

[24]  Jiebo Luo,et al.  A computationally efficient approach to indoor/outdoor scene classification , 2002, Object recognition supported by user interaction for service robots.

[25]  Guizhong Liu,et al.  A Hierarchical GIST Model Embedding Multiple Biological Feasibilities for Scene Classification , 2010, 2010 20th International Conference on Pattern Recognition.

[26]  Edward Y. Chang,et al.  CBSA: content-based soft annotation for multimodal image retrieval using Bayes point machines , 2003, IEEE Trans. Circuits Syst. Video Technol..

[27]  Deepika Gupta,et al.  Hybrid Feature based Natural Scene Classification using Neural Network , 2012 .

[28]  Aude Oliva,et al.  Classification of scene photographs from local orientations features , 2000, Pattern Recognit. Lett..

[29]  Pietro Perona,et al.  A Bayesian hierarchical model for learning natural scene categories , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[30]  Bernt Schiele,et al.  A Semantic Typicality Measure for Natural Scene Categorization , 2004, DAGM-Symposium.

[31]  Antonio Torralba,et al.  Modeling the Shape of the Scene: A Holistic Representation of the Spatial Envelope , 2001, International Journal of Computer Vision.