Proposing a new feature descriptor for moving object detection

Abstract Segmenting moving objects from various video streams especially in the presence of complex dynamic backgrounds is one of the most pivotal and fundamental tasks in computer vision. Although there are many high quality proposals for moving object detection and segmentation, still some issues such as sudden changes in illumination, camera jitter, swaying vegetation, rippling water, etc need to be resolved. This paper proposes a new method for moving object detection using background subtraction technique. To this end, a new color feature descriptor and a new model updating strategy are proposed for ameliorating the effects of these natural challenges. The proposed descriptor is a local fuzzy descriptor that tries to extract the color feature of a pixel by looking at its neighbors. Because of its local nature, this descriptor is able to accurately detect and extract moving objects. The fuzzy nature of the descriptor helps it to be robust against diverse challenging situations. In order to validate the functionality and show the supremacy of the proposed method, comprehensive experiments were conducted on various challenging datasets. From the experimental results, it is observed that the proposed method achieves acceptable results for moving object detection and segmentation.

[1]  Lucia Maddalena,et al.  Background Subtraction for Moving Object Detection in RGBD Data: A Survey , 2018, J. Imaging.

[2]  Sandeep Singh Sengar,et al.  Detection of moving objects based on enhancement of optical flow , 2017 .

[3]  Gholam Ali Montazer,et al.  Extended Bag of Visual Words for Face Detection , 2015, IWANN.

[4]  Hasan Sajid,et al.  Universal Multimode Background Subtraction , 2017, IEEE Transactions on Image Processing.

[5]  Cheng Dai,et al.  Human action recognition using two-stream attention based LSTM networks , 2020, Appl. Soft Comput..

[6]  Sukadev Meher,et al.  Detection of Moving Objects Using Fuzzy Color Difference Histogram Based Background Subtraction , 2016, IEEE Signal Processing Letters.

[7]  Gholam Ali Montazer,et al.  Atanassov's intuitionistic fuzzy histon for robust moving object detection , 2017, Int. J. Approx. Reason..

[8]  Zoran Duric,et al.  Using histograms to detect and track objects in color video , 2001, Proceedings 30th Applied Imagery Pattern Recognition Workshop (AIPR 2001). Analysis and Understanding of Time Varying Imagery.

[9]  Marc Van Droogenbroeck,et al.  ViBe: A Universal Background Subtraction Algorithm for Video Sequences , 2011, IEEE Transactions on Image Processing.

[10]  Jianfang Dou,et al.  Modeling the background and detecting moving objects based on Sift flow , 2014 .

[11]  A. Senthil Murugan,et al.  A study on various methods used for video summarization and moving object detection for video surveillance applications , 2018, Multimedia Tools and Applications.

[12]  Gholam Ali Montazer,et al.  A new image feature descriptor for content based image retrieval using scale invariant feature transform and local derivative pattern , 2017 .

[13]  Gerhard Rigoll,et al.  A deep convolutional neural network for video sequence background subtraction , 2018, Pattern Recognit..

[14]  Kazuhiko Sumi,et al.  Background subtraction based on cooccurrence of image variations , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[15]  Wei Lu,et al.  Dynamic Background Subtraction Using Histograms Based on Fuzzy C-Means Clustering and Fuzzy Nearness Degree , 2019, IEEE Access.

[16]  Guoying Zhao,et al.  Background Subtraction Based on Low-Rank and Structured Sparse Decomposition , 2015, IEEE Transactions on Image Processing.

[17]  Sajid Javed,et al.  Robust Subspace Learning: Robust PCA, Robust Subspace Tracking, and Robust Subspace Recovery , 2017, IEEE Signal Processing Magazine.

[18]  Simone Palazzo,et al.  A texton-based kernel density estimation approach for background modeling under extreme conditions , 2014, Comput. Vis. Image Underst..

[19]  Gholam Ali Montazer,et al.  Content based image retrieval system using clustered scale invariant feature transforms , 2015 .

[20]  Hélène Laurent,et al.  Comparative study of background subtraction algorithms , 2010, J. Electronic Imaging.

[21]  W. Eric L. Grimson,et al.  Learning Patterns of Activity Using Real-Time Tracking , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[22]  Kalpana Goyal,et al.  Review of background subtraction methods using Gaussian mixture model for video surveillance systems , 2017, Artificial Intelligence Review.

[23]  Davar Giveki,et al.  Scene classification using a new radial basis function classifier and integrated SIFT–LBP features , 2020, Pattern Analysis and Applications.

[24]  Thierry Bouwmans,et al.  Background Subtraction For Visual Surveillance: A Fuzzy Approach , 2012 .

[25]  Harish Bhaskar,et al.  On the Role and the Importance of Features for Background Modeling and Foreground Detection , 2016, Comput. Sci. Rev..

[26]  Midhula Vijayan,et al.  Moving Object Detection Using Local Binary Pattern and Gaussian Background Model , 2018 .

[27]  Li Song,et al.  Dynamic background subtraction based on spatial extended center-symmetric local binary pattern , 2010, 2010 IEEE International Conference on Multimedia and Expo.

[28]  Atsushi Shimada,et al.  Analytics of Deep Neural Network-Based Background Subtraction , 2018, J. Imaging.

[29]  Gerhard Rigoll,et al.  Background segmentation with feedback: The Pixel-Based Adaptive Segmenter , 2012, 2012 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[30]  Wonjun Kim,et al.  Background Subtraction for Dynamic Texture Scenes Using Fuzzy Color Histograms , 2012, IEEE Signal Processing Letters.

[31]  Hans-Jürgen Zimmermann,et al.  Fuzzy Set Theory - and Its Applications , 1985 .

[32]  Guillaume-Alexandre Bilodeau,et al.  SuBSENSE: A Universal Change Detection Method With Local Adaptive Sensitivity , 2015, IEEE Transactions on Image Processing.

[33]  Gholam Ali Montazer,et al.  Scene Classification Using Multi-Resolution WAHOLB Features and Neural Network Classifier , 2017, Neural Processing Letters.

[34]  Thierry Bouwmans,et al.  Online Weighted One-Class Ensemble for feature selection in background/foreground separation , 2016, 2016 23rd International Conference on Pattern Recognition (ICPR).

[35]  Antonio Torralba,et al.  SIFT Flow: Dense Correspondence across Scenes and Its Applications , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[36]  Luís Corte-Real,et al.  BMOG: boosted Gaussian Mixture Model with controlled complexity for background subtraction , 2017, Pattern Analysis and Applications.

[37]  Lucia Maddalena,et al.  The SOBS algorithm: What are the limits? , 2012, 2012 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[38]  Xiaowei Zhou,et al.  Moving Object Detection by Detecting Contiguous Outliers in the Low-Rank Representation , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[39]  Bin Shao,et al.  3D Indoor Environment Modeling and Detection of Moving Object and Scene Understanding , 2018, Trans. Edutainment.

[40]  Juan José Pantrigo,et al.  Real-time human body tracking based on data fusion from multiple RGB-D sensors , 2017, Multimedia Tools and Applications.

[41]  Davar Giveki,et al.  A New Content Based Image Retrieval Model Based on Wavelet Transform , 2015 .

[42]  Ezzeddine Zagrouba,et al.  Abnormal behavior recognition for intelligent video surveillance systems: A review , 2018, Expert Syst. Appl..

[43]  Juan Martin,et al.  A Low-Complexity Vision-Based System for Real-Time Traffic Monitoring , 2017, IEEE Transactions on Intelligent Transportation Systems.

[44]  Thierry Bouwmans,et al.  Background Subtraction in Real Applications: Challenges, Current Models and Future Directions , 2019, Comput. Sci. Rev..

[45]  Zhiming Luo,et al.  Interactive deep learning method for segmenting moving objects , 2017, Pattern Recognit. Lett..

[46]  Qing Lei,et al.  A Comprehensive Survey of Vision-Based Human Action Recognition Methods , 2019, Sensors.

[47]  Anu Singha,et al.  Moving Object Detection in Night Time: A Survey , 2019, 2019 2nd International Conference on Innovations in Electronics, Signal Processing and Communication (IESC).

[48]  Xuewu Zhang,et al.  An Improved LBP Feature Based Moving Object Detection , 2019, Journal of Physics: Conference Series.

[49]  Somnath Sengupta,et al.  Detection of Moving Objects Using Multi-channel Kernel Fuzzy Correlogram Based Background Subtraction , 2014, IEEE Transactions on Cybernetics.

[50]  Shengping Zhang,et al.  Dynamic Background Subtraction Based on Local Dependency Histogram , 2008, Int. J. Pattern Recognit. Artif. Intell..

[51]  Manisha Kaushal,et al.  Soft Computing based object detection and tracking approaches: State-of-the-Art survey , 2018, Appl. Soft Comput..

[52]  Dit-Yan Yeung,et al.  Bayesian Robust Matrix Factorization for Image and Video Processing , 2013, 2013 IEEE International Conference on Computer Vision.

[53]  Xiaochun Cao,et al.  Total Variation Regularized RPCA for Irregularly Moving Object Detection Under Dynamic Background , 2016, IEEE Transactions on Cybernetics.

[54]  Sandeep Singh Sengar,et al.  Moving object area detection using normalized self adaptive optical flow , 2016 .

[55]  Thierry Bouwmans,et al.  Type-2 Fuzzy Mixture of Gaussians Model: Application to Background Modeling , 2008, ISVC.

[56]  Marko Heikkilä,et al.  A texture-based method for modeling the background and detecting moving objects , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[57]  Gholam Ali Montazer,et al.  Farsi/Arabic handwritten digit recognition using quantum neural networks and bag of visual words method , 2017, Optical Memory and Neural Networks.

[58]  Larry S. Davis,et al.  Real-time foreground-background segmentation using codebook model , 2005, Real Time Imaging.

[59]  Jen-Hui Chuang,et al.  Learning a Scene Background Model via Classification , 2009, IEEE Transactions on Signal Processing.

[60]  Soon Ki Jung,et al.  Unsupervised deep context prediction for background estimation and foreground segmentation , 2018, Machine Vision and Applications.

[61]  Sudhish N. George,et al.  Simultaneous denoising and moving object detection using low rank approximation , 2019, Future Gener. Comput. Syst..

[62]  Soon Ki Jung,et al.  Deep Neural Network Concepts for Background Subtraction: A Systematic Review and Comparative Evaluation , 2018, Neural Networks.

[63]  Thierry Bouwmans,et al.  Traditional and recent approaches in background modeling for foreground detection: An overview , 2014, Comput. Sci. Rev..

[64]  Nuno Vasconcelos,et al.  Anomaly Detection and Localization in Crowded Scenes , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[65]  Mingliang Chen,et al.  Spatiotemporal GMM for Background Subtraction with Superpixel Hierarchy , 2018, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[66]  Shaogang Gong,et al.  A highly efficient block-based dynamic background model , 2005, IEEE Conference on Advanced Video and Signal Based Surveillance, 2005..

[67]  Gholam Ali Montazer,et al.  An improved radial basis function neural network for object image retrieval , 2015, Neurocomputing.

[68]  S. Bianco,et al.  How Far Can You Get By Combining Change Detection Algorithms? , 2015, ICIAP.

[69]  Gholam Ali Montazer,et al.  Scene Classification Based on Local Binary Pattern and Improved Bag of Visual Words , 2015, IWANN.

[70]  Marc Van Droogenbroeck,et al.  A Generic Feature Selection Method for Background Subtraction Using Global Foreground Models , 2015, ACIVS.