Robust Segmentation and Classification of Moving Objects from Surveillance Video

Object segmentation and classification in the video sequence is a classical and critical problem that is constantly addressed due to vast real-time applications such as autonomous vehicles, smart surveillance, etc. Segmentation and classification of moving objects in video sequences captured from real-time non-constraint sequences is a challenging task. This paper presents a moving object segmentation and classification method for video sequences captured in a real-time environment. The key contributions of the paper include a method to detect and segment motion regions by applying the non-parametric Kolmogorov–Smirnov statistical test in the Spatio-temporal domain and a probabilistic neural network-based classification method to classify the moving objects into various classes. Promising results are obtained by experimentation using challenging PETS and Change Detection datasets. To corroborate the efficacy, a comparative analysis with contemporary method is also performed.

[1]  S. Murali,et al.  Segmentation of Motion Objects from Surveillance Video Sequences Using Temporal Differencing Combined with Multiple Correlation , 2009, 2009 Sixth IEEE International Conference on Advanced Video and Signal Based Surveillance.

[2]  I. Haritaoglu,et al.  Background and foreground modeling using nonparametric kernel density estimation for visual surveillance , 2002 .

[3]  L. Davis,et al.  Background and foreground modeling using nonparametric kernel density estimation for visual surveillance , 2002, Proc. IEEE.

[4]  Azriel Rosenfeld,et al.  Computer Vision , 1988, Adv. Comput..

[5]  Reinhard Klette,et al.  Object Classification and Tracking in Video Surveillance , 2003, CAIP.

[6]  Kaiqi Huang,et al.  View independent object classification by exploring scene consistency information for traffic scene surveillance , 2013, Neurocomputing.

[7]  Majid Komeili,et al.  TED: A texture-edge descriptor for pedestrian detection in video sequences , 2012, Pattern Recognit..

[8]  Sridha Sridharan,et al.  Improved Simultaneous Computation of Motion Detection and Optical Flow for Object Tracking , 2009, 2009 Digital Image Computing: Techniques and Applications.

[9]  T. Mahalingam,et al.  A robust single and multiple moving object detection, tracking and classification , 2020 .

[10]  Concetto Spampinato,et al.  MASK-RL: Multiagent Video Object Segmentation Framework Through Reinforcement Learning , 2020, IEEE Transactions on Neural Networks and Learning Systems.

[11]  Pong C. Yuen,et al.  Object motion detection using information theoretic spatio-temporal saliency , 2009, Pattern Recognit..

[12]  Alessandro Verri,et al.  Motion Segmentation from Optical Flow , 1989, Alvey Vision Conference.

[13]  Jin Bae Park,et al.  MOSnet: moving object segmentation with convolutional networks , 2017 .

[14]  Yi-Ping Hung,et al.  Efficient hierarchical method for background subtraction , 2007, Pattern Recognit..

[15]  Joaquim Salvi,et al.  Motion Segmentation: a Review , 2008, CCIA.

[16]  Fang-Hsuan Cheng,et al.  Real time multiple objects tracking and identification based on discrete wavelet transform , 2006, Pattern Recognit..

[17]  Chu-Sing Yang,et al.  An efficient continuous tracking system in real-time surveillance application , 2012, J. Netw. Comput. Appl..

[18]  Hyeran Byun,et al.  Human tracking and silhouette extraction for human–robot interaction systems , 2008, Pattern Analysis and Applications.

[19]  Donald F. Specht,et al.  Probabilistic neural networks , 1990, Neural Networks.

[20]  Bohyung Han,et al.  Modeling and segmentation of floating foreground and background in videos , 2012, Pattern Recognit..

[21]  Reinhard Klette,et al.  Moving Object Segmentation Using Optical Flow and Depth Information , 2009, PSIVT.

[22]  Luc Van Gool,et al.  One-Shot Video Object Segmentation , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[23]  Ali Javed,et al.  Human Identification On the basis of Gaits Using Time Efficient Feature Extraction and Temporal Median Background Subtraction , 2014 .

[24]  Ashish Ghosh,et al.  Change detection for moving object segmentation with robust background construction under Wronskian framework , 2013, Machine Vision and Applications.

[25]  Iyiola E. Olatunji,et al.  Video Analytics for Visual Surveillance and Applications: An Overview and Survey , 2019, Learning and Analytics in Intelligent Systems.

[26]  Ming-Kuei Hu,et al.  Visual pattern recognition by moment invariants , 1962, IRE Trans. Inf. Theory.

[27]  W. Eric L. Grimson,et al.  Adaptive background mixture models for real-time tracking , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[28]  Mubarak Shah,et al.  Tracking and Object Classification for Automated Surveillance , 2002, ECCV.

[29]  Karteek Alahari,et al.  Learning Video Object Segmentation with Visual Memory , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[30]  Mohamed Bellouki,et al.  Shadow elimination and vehicles classification approaches in traffic video surveillance context , 2014, J. Vis. Lang. Comput..

[31]  Chia-Feng Juang,et al.  Moving object classification using local shape and HOG features in wavelet-transformed space with hierarchical SVM classifiers , 2015, Appl. Soft Comput..

[32]  Fatih Murat Porikli,et al.  Changedetection.net: A new change detection benchmark dataset , 2012, 2012 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[33]  T. R. Vijaya Lakshmi,et al.  Object Classification Using SIFT Algorithm and Transformation Techniques , 2019 .

[34]  Lucia Maddalena,et al.  The SOBS algorithm: What are the limits? , 2012, 2012 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[35]  Shiming Xiang,et al.  Real-time Object Classification in Video Surveillance Based on Appearance Learning , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.