A Novel Statistical Method for Scene Classification Based on Multi-Object Categorization and Logistic Regression

In recent years, interest in scene classification of different indoor-outdoor scene images has increased due to major developments in visual sensor techniques. Scene classification has been demonstrated to be an efficient method for environmental observations but it is a challenging task considering the complexity of multiple objects in scenery images. These images include a combination of different properties and objects i.e., (color, text, and regions) and they are classified on the basis of optimal features. In this paper, an efficient multiclass objects categorization method is proposed for the indoor-outdoor scene classification of scenery images using benchmark datasets. We illustrate two improved methods, fuzzy c-mean and mean shift algorithms, which infer multiple object segmentation in complex images. Multiple object categorization is achieved through multiple kernel learning (MKL), which considers local descriptors and signatures of regions. The relations between multiple objects are then examined by intersection over union algorithm. Finally, scene classification is achieved by using Multi-class Logistic Regression (McLR). Experimental evaluation demonstrated that our scene classification method is superior compared to other conventional methods, especially when dealing with complex images. Our system should be applicable in various domains such as drone targeting, autonomous driving, Global positioning systems, robotics and tourist guide applications.

[1]  Mohammed Bennamoun,et al.  A Spatial Layout and Scale Invariant Feature Representation for Indoor Scene Classification , 2015, IEEE Transactions on Image Processing.

[2]  Hongxing Guo,et al.  Understanding Indoor Scene: Spatial Layout Estimation, Scene Classification, and Object Detection , 2018, ICMSSP '18.

[3]  Qi Tian,et al.  Object Categorization Using Class-Specific Representations , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[4]  Jürgen Weber,et al.  Analytical analysis of single-stage pressure relief valves , 2019, International Journal of Hydromechatronics.

[5]  Ravindra Kshirsagar,et al.  Mean shift technique for image segmentation and Modified Canny Edge Detection Algorithm for circle detection , 2014, 2014 International Conference on Communication and Signal Processing.

[6]  Lili Luo,et al.  K-means cluster algorithm based on color image enhancement for cell segmentation , 2012, 2012 5th International Conference on BioMedical Engineering and Informatics.

[7]  Qian Du,et al.  Scene classification using local and global features with collaborative representation fusion , 2016, Inf. Sci..

[8]  Qi Tian,et al.  Multiview, Few-Labeled Object Categorization by Predicting Labels With View Consistency , 2019, IEEE Transactions on Cybernetics.

[9]  Dewen Hu,et al.  Scene classification using a multi-resolution bag-of-features model , 2013, Pattern Recognit..

[10]  Dong Liu,et al.  A Bayesian Approach to Multimodal Visual Dictionary Learning , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[11]  Nik Bessis,et al.  Logistic Regression Multinomial for Arrhythmia Detection , 2016, 2016 IEEE 1st International Workshops on Foundations and Applications of Self* Systems (FAS*W).

[12]  C.-C. Jay Kuo,et al.  Outdoor Scene Classification Using Labeled Segments , 2016 .

[13]  C.-C. Jay Kuo,et al.  Large-Scale Indoor/Outdoor Image Classification via Expert Decision Fusion (EDF) , 2014, ACCV Workshops.

[14]  Sebastian Nowozin,et al.  Optimal Decisions from Probabilistic Models: The Intersection-over-Union Case , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[15]  Duoqian Miao,et al.  Influence of kernel clustering on an RBFN , 2019, CAAI Trans. Intell. Technol..

[16]  Lintai Wu,et al.  Three-stage network for age estimation , 2019, CAAI Trans. Intell. Technol..

[17]  Hongtao Lu,et al.  Image classification based on improved VLAD , 2015, Multimedia Tools and Applications.

[18]  Daijin Kim,et al.  A Depth Video Sensor-Based Life-Logging Human Activity Recognition System for Elderly Care in Smart Indoor Environments , 2014, Sensors.

[19]  Guillermo Sapiro,et al.  Multiple shape models for simultaneous object classification and segmentation , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[20]  Ahmad Jalal,et al.  Scene Understanding and Recognition: Statistical Segmented Model using Geometrical Features and Gaussian Naïve Bayes , 2019, 2019 International Conference on Applied and Engineering Mathematics (ICAEM).

[21]  Sheng Bi,et al.  Human Segmentation in a Complex Situation Based on Properties of the Human Visual System , 2006, 2006 6th World Congress on Intelligent Control and Automation.

[22]  Daijin Kim,et al.  Robust human activity recognition from depth video using spatiotemporal multi-fused features , 2017, Pattern Recognit..

[23]  Sean Martin,et al.  Sequential Bayesian inference models for multiple object classification , 2011, 14th International Conference on Information Fusion.

[24]  Jin Xing,et al.  A New Deep Learning Algorithm for SAR Scene Classification Based on Spatial Statistical Modeling and Features Re-Calibration , 2019, Sensors.

[25]  Cordelia Schmid,et al.  Aggregating Local Image Descriptors into Compact Codes , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[26]  G. Wiselin Jiji,et al.  MRI Brain Image Segmentation based on Thresholding , 2013 .

[27]  Bülent Sankur,et al.  Survey over image thresholding techniques and quantitative performance evaluation , 2004, J. Electronic Imaging.

[28]  R. Krishna,et al.  Image Segmentation and Region Growing Algorithm , 2012 .

[29]  Matthieu Cord,et al.  Semantic pooling for image categorization using multiple kernel learning , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[30]  Yogita K. Dubey,et al.  Color Image Segmentation Using Kernalized Fuzzy C-means Clustering , 2015, 2015 Fifth International Conference on Communication Systems and Network Technologies.

[31]  Jian-Huang Lai,et al.  Data-Driven Scene Understanding with Adaptively Retrieved Exemplars , 2015, IEEE MultiMedia.

[32]  Xianzhong Long,et al.  VLAD Encoding Based on LLC for Image Classification , 2019, ICMLC '19.

[33]  Yisha Liu,et al.  Outdoor Scene Understanding Based on Multi-Scale PBA Image Features and Point Cloud Features , 2019, Sensors.

[34]  Mark D. McDonnell,et al.  Track Everything: Limiting Prior Knowledge in Online Multi-Object Recognition , 2017, IEEE Transactions on Image Processing.

[35]  Jing-Yu Yang,et al.  Content-based image retrieval using computational visual attention model , 2015, Pattern Recognit..

[36]  Antonio Criminisi,et al.  TextonBoost: Joint Appearance, Shape and Context Modeling for Multi-class Object Recognition and Segmentation , 2006, ECCV.

[37]  Hong Zhu,et al.  Scene Categorization Model Using Deep Visually Sensitive Features , 2019, IEEE Access.

[38]  Selim Aksoy,et al.  Multisource Region Attention Network for Fine-Grained Object Recognition in Remote Sensing Imagery , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[39]  Antonio Torralba,et al.  Recognizing indoor scenes , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[40]  Seba Susan,et al.  New shape descriptor in the context of edge continuity , 2019, CAAI Trans. Intell. Technol..

[41]  David A. McAllester,et al.  Object Detection with Discriminatively Trained Part Based Models , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[42]  Manouchehr Shokri,et al.  A Review on the Artificial Neural Network Approach to Analysis and Prediction of Seismic Damage in Infrastructure , 2019, International Journal of Hydromechatronics.

[43]  Xiang Fu,et al.  Exploring confusing scene classes for the places dataset: Insights and solutions , 2017, 2017 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC).

[44]  Travis Wiens,et al.  Engine Speed Reduction for Hydraulic Machinery Using Predictive Algorithms , 2019, International Journal of Hydromechatronics.

[45]  Sanja Fidler,et al.  Human-Machine CRFs for Identifying Bottlenecks in Scene Understanding , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.